Note: This is test shard 2 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/1
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20251215 14:54:57.939939 8678 test_util.cc:276] Using random seed: -881301065
2025-12-15T14:54:57Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-15T14:54:57Z Disabled control of system clock
I20251215 14:54:57.969863 8678 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
/tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.121.190:44279
--webserver_interface=127.8.121.190
--webserver_port=0
--builtin_ntp_servers=127.8.121.148:35915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20251215 14:54:58.278062 8686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251215 14:54:58.278399 8686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251215 14:54:58.278503 8686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251215 14:54:58.286731 8686 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20251215 14:54:58.286839 8686 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20251215 14:54:58.286890 8686 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251215 14:54:58.286953 8686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251215 14:54:58.287027 8686 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251215 14:54:58.287076 8686 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251215 14:54:58.297077 8686 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.121.148:35915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.121.190:44279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.121.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type FASTDEBUG
built by None at 15 Dec 2025 14:43:20 UTC on 24a791456cd2
build id 9528
ASAN enabled
I20251215 14:54:58.298663 8686 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251215 14:54:58.300531 8686 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 14:54:58.308013 8692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 14:54:58.308544 8694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 14:54:58.308035 8691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 14:54:58.309475 8686 server_base.cc:1047] running on GCE node
I20251215 14:54:58.310171 8686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251215 14:54:58.311497 8686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251215 14:54:58.312687 8686 hybrid_clock.cc:648] HybridClock initialized: now 1765810498312647 us; error 29 us; skew 500 ppm
I20251215 14:54:58.312989 8686 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 14:54:58.315016 8686 webserver.cc:492] Webserver started at http://127.8.121.190:40239/ using document root <none> and password file <none>
I20251215 14:54:58.315737 8686 fs_manager.cc:362] Metadata directory not provided
I20251215 14:54:58.315834 8686 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 14:54:58.316156 8686 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 14:54:58.318342 8686 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/instance:
uuid: "cad1fca07ac7419cb608c21541f672f3"
format_stamp: "Formatted at 2025-12-15 14:54:58 on dist-test-slave-z089"
I20251215 14:54:58.319046 8686 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal/instance:
uuid: "cad1fca07ac7419cb608c21541f672f3"
format_stamp: "Formatted at 2025-12-15 14:54:58 on dist-test-slave-z089"
I20251215 14:54:58.323890 8686 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20251215 14:54:58.326961 8700 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 14:54:58.328233 8686 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20251215 14:54:58.328380 8686 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data,/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
uuid: "cad1fca07ac7419cb608c21541f672f3"
format_stamp: "Formatted at 2025-12-15 14:54:58 on dist-test-slave-z089"
I20251215 14:54:58.328567 8686 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 14:54:58.345402 8686 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 14:54:58.346354 8686 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251215 14:54:58.346634 8686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 14:54:58.366709 8686 rpc_server.cc:307] RPC server started. Bound to: 127.8.121.190:44279
I20251215 14:54:58.366729 8751 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.121.190:44279 every 8 connection(s)
I20251215 14:54:58.368180 8686 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/info.pb
I20251215 14:54:58.372171 8752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:54:58.373991 8678 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu as pid 8686
I20251215 14:54:58.374245 8678 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal/instance
I20251215 14:54:58.376719 8678 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
/tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.121.189:45723
--webserver_interface=127.8.121.189
--webserver_port=0
--builtin_ntp_servers=127.8.121.148:35915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20251215 14:54:58.377674 8752 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } has no permanent_uuid. Determining permanent_uuid...
I20251215 14:54:58.395255 8752 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } has no permanent_uuid. Determining permanent_uuid...
W20251215 14:54:58.396374 8703 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.121.189:45723: connect: Connection refused (error 111)
W20251215 14:54:58.397856 8752 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.121.189:45723: Network error: Client connection negotiation failed: client connection to 127.8.121.189:45723: connect: Connection refused (error 111)
I20251215 14:54:58.447206 8752 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } attempt: 1
W20251215 14:54:58.449180 8752 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.121.189:45723: Network error: Client connection negotiation failed: client connection to 127.8.121.189:45723: connect: Connection refused (error 111)
I20251215 14:54:58.517417 8752 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } attempt: 2
W20251215 14:54:58.519378 8752 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.121.189:45723: Network error: Client connection negotiation failed: client connection to 127.8.121.189:45723: connect: Connection refused (error 111)
I20251215 14:54:58.610664 8752 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } attempt: 3
W20251215 14:54:58.612730 8752 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.121.189:45723: Network error: Client connection negotiation failed: client connection to 127.8.121.189:45723: connect: Connection refused (error 111)
W20251215 14:54:58.702967 8754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251215 14:54:58.703298 8754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251215 14:54:58.703397 8754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251215 14:54:58.711414 8754 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20251215 14:54:58.711498 8754 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20251215 14:54:58.711552 8754 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251215 14:54:58.711618 8754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251215 14:54:58.711696 8754 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251215 14:54:58.711758 8754 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251215 14:54:58.721360 8754 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.121.148:35915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.121.189:45723
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.8.121.189
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type FASTDEBUG
built by None at 15 Dec 2025 14:43:20 UTC on 24a791456cd2
build id 9528
ASAN enabled
I20251215 14:54:58.722887 8754 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251215 14:54:58.724594 8754 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 14:54:58.732007 8763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 14:54:58.732184 8762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 14:54:58.732650 8765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 14:54:58.733407 8754 server_base.cc:1047] running on GCE node
I20251215 14:54:58.734302 8754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251215 14:54:58.735702 8754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251215 14:54:58.736914 8754 hybrid_clock.cc:648] HybridClock initialized: now 1765810498736874 us; error 36 us; skew 500 ppm
I20251215 14:54:58.737229 8754 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 14:54:58.739266 8754 webserver.cc:492] Webserver started at http://127.8.121.189:39979/ using document root <none> and password file <none>
I20251215 14:54:58.739956 8754 fs_manager.cc:362] Metadata directory not provided
I20251215 14:54:58.740051 8754 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 14:54:58.740379 8754 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 14:54:58.742671 8754 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/data/instance:
uuid: "40747def373e4b19abfa5d21ba0a4315"
format_stamp: "Formatted at 2025-12-15 14:54:58 on dist-test-slave-z089"
I20251215 14:54:58.743428 8754 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/wal/instance:
uuid: "40747def373e4b19abfa5d21ba0a4315"
format_stamp: "Formatted at 2025-12-15 14:54:58 on dist-test-slave-z089"
I20251215 14:54:58.748432 8754 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20251215 14:54:58.751626 8771 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 14:54:58.752924 8754 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20251215 14:54:58.753065 8754 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/data,/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/wal
uuid: "40747def373e4b19abfa5d21ba0a4315"
format_stamp: "Formatted at 2025-12-15 14:54:58 on dist-test-slave-z089"
I20251215 14:54:58.753242 8754 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 14:54:58.755975 8752 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } attempt: 4
W20251215 14:54:58.757829 8752 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.121.189:45723: Network error: Client connection negotiation failed: client connection to 127.8.121.189:45723: connect: Connection refused (error 111)
I20251215 14:54:58.778477 8754 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 14:54:58.779554 8754 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251215 14:54:58.779844 8754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 14:54:58.799001 8754 rpc_server.cc:307] RPC server started. Bound to: 127.8.121.189:45723
I20251215 14:54:58.799010 8822 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.121.189:45723 every 8 connection(s)
I20251215 14:54:58.800369 8754 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/data/info.pb
I20251215 14:54:58.802790 8678 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu as pid 8754
I20251215 14:54:58.802937 8678 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-1/wal/instance
I20251215 14:54:58.803959 8678 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
/tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.121.188:43131
--webserver_interface=127.8.121.188
--webserver_port=0
--builtin_ntp_servers=127.8.121.148:35915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20251215 14:54:58.804340 8823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:54:58.810401 8823 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } has no permanent_uuid. Determining permanent_uuid...
I20251215 14:54:58.822702 8823 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } has no permanent_uuid. Determining permanent_uuid...
I20251215 14:54:58.838724 8823 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } has no permanent_uuid. Determining permanent_uuid...
W20251215 14:54:58.840040 8772 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.121.188:43131: connect: Connection refused (error 111)
W20251215 14:54:58.841794 8823 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.121.188:43131: Network error: Client connection negotiation failed: client connection to 127.8.121.188:43131: connect: Connection refused (error 111)
I20251215 14:54:58.891151 8823 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } attempt: 1
W20251215 14:54:58.893110 8823 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.121.188:43131: Network error: Client connection negotiation failed: client connection to 127.8.121.188:43131: connect: Connection refused (error 111)
I20251215 14:54:58.961366 8823 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } attempt: 2
W20251215 14:54:58.963310 8823 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.121.188:43131: Network error: Client connection negotiation failed: client connection to 127.8.121.188:43131: connect: Connection refused (error 111)
I20251215 14:54:59.054593 8823 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } attempt: 3
W20251215 14:54:59.056583 8823 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.121.188:43131: Network error: Client connection negotiation failed: client connection to 127.8.121.188:43131: connect: Connection refused (error 111)
I20251215 14:54:59.057053 8752 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } attempt: 5
I20251215 14:54:59.063553 8752 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } has no permanent_uuid. Determining permanent_uuid...
W20251215 14:54:59.065200 8752 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.121.188:43131: Network error: Client connection negotiation failed: client connection to 127.8.121.188:43131: connect: Connection refused (error 111)
I20251215 14:54:59.116417 8752 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } attempt: 1
W20251215 14:54:59.118546 8752 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.121.188:43131: Network error: Client connection negotiation failed: client connection to 127.8.121.188:43131: connect: Connection refused (error 111)
W20251215 14:54:59.129841 8825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251215 14:54:59.130154 8825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251215 14:54:59.130267 8825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251215 14:54:59.138837 8825 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20251215 14:54:59.138931 8825 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20251215 14:54:59.139003 8825 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251215 14:54:59.139070 8825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251215 14:54:59.139154 8825 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251215 14:54:59.139230 8825 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251215 14:54:59.149325 8825 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.121.148:35915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.121.188:43131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.8.121.188
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type FASTDEBUG
built by None at 15 Dec 2025 14:43:20 UTC on 24a791456cd2
build id 9528
ASAN enabled
I20251215 14:54:59.151046 8825 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251215 14:54:59.152892 8825 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 14:54:59.161942 8833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 14:54:59.161972 8834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 14:54:59.162596 8836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 14:54:59.163275 8825 server_base.cc:1047] running on GCE node
I20251215 14:54:59.164093 8825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251215 14:54:59.165629 8825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251215 14:54:59.166874 8825 hybrid_clock.cc:648] HybridClock initialized: now 1765810499166823 us; error 42 us; skew 500 ppm
I20251215 14:54:59.167373 8825 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 14:54:59.169888 8825 webserver.cc:492] Webserver started at http://127.8.121.188:43947/ using document root <none> and password file <none>
I20251215 14:54:59.170677 8825 fs_manager.cc:362] Metadata directory not provided
I20251215 14:54:59.170787 8825 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 14:54:59.171151 8825 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 14:54:59.173660 8825 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/data/instance:
uuid: "1f310d741d8247488792985606a1c19e"
format_stamp: "Formatted at 2025-12-15 14:54:59 on dist-test-slave-z089"
I20251215 14:54:59.174484 8825 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/wal/instance:
uuid: "1f310d741d8247488792985606a1c19e"
format_stamp: "Formatted at 2025-12-15 14:54:59 on dist-test-slave-z089"
I20251215 14:54:59.179970 8825 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20251215 14:54:59.183702 8842 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 14:54:59.185513 8825 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20251215 14:54:59.185954 8825 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/data,/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/wal
uuid: "1f310d741d8247488792985606a1c19e"
format_stamp: "Formatted at 2025-12-15 14:54:59 on dist-test-slave-z089"
I20251215 14:54:59.186216 8825 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 14:54:59.186805 8752 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } attempt: 2
W20251215 14:54:59.188727 8752 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.121.188:43131: Network error: Client connection negotiation failed: client connection to 127.8.121.188:43131: connect: Connection refused (error 111)
I20251215 14:54:59.199816 8823 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } attempt: 4
W20251215 14:54:59.201618 8823 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.8.121.188:43131: Network error: Client connection negotiation failed: client connection to 127.8.121.188:43131: connect: Connection refused (error 111)
I20251215 14:54:59.203545 8825 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 14:54:59.204372 8825 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251215 14:54:59.204591 8825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 14:54:59.222007 8825 rpc_server.cc:307] RPC server started. Bound to: 127.8.121.188:43131
I20251215 14:54:59.222024 8893 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.121.188:43131 every 8 connection(s)
I20251215 14:54:59.223454 8825 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/data/info.pb
I20251215 14:54:59.225364 8678 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu as pid 8825
I20251215 14:54:59.225538 8678 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-2/wal/instance
I20251215 14:54:59.227546 8894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:54:59.235078 8894 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } has no permanent_uuid. Determining permanent_uuid...
I20251215 14:54:59.246348 8894 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } has no permanent_uuid. Determining permanent_uuid...
I20251215 14:54:59.253499 8894 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } has no permanent_uuid. Determining permanent_uuid...
I20251215 14:54:59.265064 8894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Bootstrap starting.
I20251215 14:54:59.268158 8894 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Neither blocks nor log segments found. Creating new log.
I20251215 14:54:59.269464 8894 log.cc:826] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Log is configured to *not* fsync() on all Append() calls
I20251215 14:54:59.271957 8894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: No bootstrap required, opened a new log
I20251215 14:54:59.277168 8894 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:54:59.277472 8894 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:54:59.277593 8894 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f310d741d8247488792985606a1c19e, State: Initialized, Role: FOLLOWER
I20251215 14:54:59.278139 8894 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:54:59.278961 8903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:54:59.279217 8903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [sys.catalog]: This master's current role is: FOLLOWER
I20251215 14:54:59.279951 8894 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [sys.catalog]: configured and running, proceeding with master startup.
I20251215 14:54:59.288275 8903 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:54:59.288518 8903 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:54:59.289934 8903 leader_election.cc:290] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cad1fca07ac7419cb608c21541f672f3 (127.8.121.190:44279), 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723)
W20251215 14:54:59.291712 8914 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251215 14:54:59.291824 8914 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251215 14:54:59.286824 8825 master_runner.cc:186] Error getting master registration for 127.8.121.190:44279: OK, instance_id { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" instance_seqno: 1765810498361732 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20251215 14:54:59.293107 8825 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251215 14:54:59.294922 8752 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } attempt: 3
W20251215 14:54:59.303498 8914 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251215 14:54:59.303630 8914 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251215 14:54:59.308157 8752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Bootstrap starting.
I20251215 14:54:59.312155 8752 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Neither blocks nor log segments found. Creating new log.
I20251215 14:54:59.313478 8752 log.cc:826] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Log is configured to *not* fsync() on all Append() calls
W20251215 14:54:59.314944 8914 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251215 14:54:59.315079 8914 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251215 14:54:59.316825 8752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: No bootstrap required, opened a new log
I20251215 14:54:59.323972 8752 raft_consensus.cc:359] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:54:59.324280 8752 raft_consensus.cc:385] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:54:59.324393 8752 raft_consensus.cc:740] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cad1fca07ac7419cb608c21541f672f3, State: Initialized, Role: FOLLOWER
I20251215 14:54:59.325074 8752 consensus_queue.cc:260] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
W20251215 14:54:59.326359 8914 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251215 14:54:59.326515 8914 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251215 14:54:59.326520 8917 sys_catalog.cc:455] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:54:59.326946 8917 sys_catalog.cc:458] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: This master's current role is: FOLLOWER
I20251215 14:54:59.327559 8752 sys_catalog.cc:565] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: configured and running, proceeding with master startup.
I20251215 14:54:59.328796 8727 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1f310d741d8247488792985606a1c19e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cad1fca07ac7419cb608c21541f672f3" is_pre_election: true
I20251215 14:54:59.329311 8727 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f310d741d8247488792985606a1c19e in term 0.
I20251215 14:54:59.330054 8843 leader_election.cc:304] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f310d741d8247488792985606a1c19e, cad1fca07ac7419cb608c21541f672f3; no voters:
I20251215 14:54:59.330509 8903 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:54:59.330639 8903 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:54:59.330704 8903 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:54:59.333014 8903 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:54:59.334075 8727 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1f310d741d8247488792985606a1c19e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cad1fca07ac7419cb608c21541f672f3"
I20251215 14:54:59.334160 8903 leader_election.cc:290] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [CANDIDATE]: Term 1 election: Requested vote from peers cad1fca07ac7419cb608c21541f672f3 (127.8.121.190:44279), 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723)
I20251215 14:54:59.334275 8727 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:54:59.337394 8727 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f310d741d8247488792985606a1c19e in term 1.
W20251215 14:54:59.337838 8914 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251215 14:54:59.337945 8914 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251215 14:54:59.338408 8843 leader_election.cc:304] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f310d741d8247488792985606a1c19e, cad1fca07ac7419cb608c21541f672f3; no voters:
I20251215 14:54:59.338722 8903 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:54:59.339339 8903 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 1 LEADER]: Becoming Leader. State: Replica: 1f310d741d8247488792985606a1c19e, State: Running, Role: LEADER
I20251215 14:54:59.339979 8903 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
W20251215 14:54:59.349427 8914 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251215 14:54:59.349577 8914 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20251215 14:54:59.349606 8706 tablet.cc:2378] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251215 14:54:59.350983 8921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f310d741d8247488792985606a1c19e. Latest consensus state: current_term: 1 leader_uuid: "1f310d741d8247488792985606a1c19e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:54:59.351469 8921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [sys.catalog]: This master's current role is: LEADER
I20251215 14:54:59.352728 8925 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251215 14:54:59.355760 8925 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251215 14:54:59.384290 8727 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 1 FOLLOWER]: Refusing update from remote peer 1f310d741d8247488792985606a1c19e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 14:54:59.385360 8921 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [LEADER]: Connected to new peer: Peer: permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:54:59.394227 8917 sys_catalog.cc:455] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f310d741d8247488792985606a1c19e. Latest consensus state: current_term: 1 leader_uuid: "1f310d741d8247488792985606a1c19e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:54:59.394469 8917 sys_catalog.cc:458] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: This master's current role is: FOLLOWER
I20251215 14:54:59.398437 8928 mvcc.cc:204] Tried to move back new op lower bound from 7232759805460357120 to 7232759805302132736. Current Snapshot: MvccSnapshot[applied={T|T < 7232759805460357120}]
I20251215 14:54:59.396865 8686 master_runner.cc:186] Error getting master registration for 127.8.121.189:45723: OK, instance_id { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" instance_seqno: 1765810498794235 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20251215 14:54:59.406402 8686 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251215 14:54:59.407016 8917 sys_catalog.cc:455] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1f310d741d8247488792985606a1c19e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:54:59.407240 8917 sys_catalog.cc:458] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: This master's current role is: FOLLOWER
W20251215 14:54:59.410499 8932 catalog_manager.cc:1568] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251215 14:54:59.411586 8932 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251215 14:54:59.415824 8903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1f310d741d8247488792985606a1c19e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:54:59.416085 8903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [sys.catalog]: This master's current role is: LEADER
I20251215 14:54:59.416967 8925 catalog_manager.cc:1357] Generated new cluster ID: ed5da7b2c3a646fcbe8e0bb3a7589268
I20251215 14:54:59.417064 8925 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251215 14:54:59.423424 8932 catalog_manager.cc:1269] Loaded cluster ID: ed5da7b2c3a646fcbe8e0bb3a7589268
I20251215 14:54:59.423585 8932 catalog_manager.cc:1562] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: loading cluster ID for follower catalog manager: success
W20251215 14:54:59.424783 8932 catalog_manager.cc:1586] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20251215 14:54:59.424957 8932 catalog_manager.cc:883] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20251215 14:54:59.434551 8925 catalog_manager.cc:1380] Generated new certificate authority record
I20251215 14:54:59.439285 8925 catalog_manager.cc:1514] Loading token signing keys...
I20251215 14:54:59.442718 8932 catalog_manager.cc:1584] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: acquiring CA information for follower catalog manager: success
W20251215 14:54:59.445235 8932 catalog_manager.cc:883] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
W20251215 14:54:59.458069 8932 catalog_manager.cc:883] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20251215 14:54:59.466137 8925 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Generated new TSK 0
I20251215 14:54:59.468523 8925 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251215 14:54:59.475714 8932 catalog_manager.cc:1612] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251215 14:54:59.478392 8678 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
/tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.121.129:0
--local_ip_for_outbound_sockets=127.8.121.129
--webserver_interface=127.8.121.129
--webserver_port=0
--tserver_master_addrs=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--builtin_ntp_servers=127.8.121.148:35915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20251215 14:54:59.500846 8823 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } attempt: 5
I20251215 14:54:59.513612 8823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Bootstrap starting.
I20251215 14:54:59.517582 8823 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Neither blocks nor log segments found. Creating new log.
I20251215 14:54:59.518940 8823 log.cc:826] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Log is configured to *not* fsync() on all Append() calls
I20251215 14:54:59.533977 8823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: No bootstrap required, opened a new log
I20251215 14:54:59.550122 8823 raft_consensus.cc:359] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:54:59.550801 8823 raft_consensus.cc:385] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:54:59.551067 8823 raft_consensus.cc:740] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40747def373e4b19abfa5d21ba0a4315, State: Initialized, Role: FOLLOWER
I20251215 14:54:59.552752 8823 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:54:59.563732 8940 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:54:59.567277 8940 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [sys.catalog]: This master's current role is: FOLLOWER
I20251215 14:54:59.567539 8940 raft_consensus.cc:493] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:54:59.567802 8940 raft_consensus.cc:515] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:54:59.569378 8940 leader_election.cc:290] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cad1fca07ac7419cb608c21541f672f3 (127.8.121.190:44279), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:54:59.570139 8727 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "40747def373e4b19abfa5d21ba0a4315" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cad1fca07ac7419cb608c21541f672f3" is_pre_election: true
I20251215 14:54:59.570205 8869 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "40747def373e4b19abfa5d21ba0a4315" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:54:59.571064 8772 leader_election.cc:304] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40747def373e4b19abfa5d21ba0a4315; no voters: 1f310d741d8247488792985606a1c19e, cad1fca07ac7419cb608c21541f672f3
I20251215 14:54:59.575372 8940 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:54:59.578306 8796 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:54:59.581086 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1f310d741d8247488792985606a1c19e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:54:59.581799 8797 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1f310d741d8247488792985606a1c19e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315"
I20251215 14:54:59.584533 8796 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 1 FOLLOWER]: Refusing update from remote peer 1f310d741d8247488792985606a1c19e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 14:54:59.585321 8823 sys_catalog.cc:565] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [sys.catalog]: configured and running, proceeding with master startup.
I20251215 14:54:59.585278 8921 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [LEADER]: Connected to new peer: Peer: permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:54:59.614068 8942 mvcc.cc:204] Tried to move back new op lower bound from 7232759805460357120 to 7232759805302132736. Current Snapshot: MvccSnapshot[applied={T|T < 7232759805460357120}]
I20251215 14:54:59.633597 8940 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1f310d741d8247488792985606a1c19e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:54:59.633575 8941 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f310d741d8247488792985606a1c19e. Latest consensus state: current_term: 1 leader_uuid: "1f310d741d8247488792985606a1c19e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:54:59.633960 8940 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [sys.catalog]: This master's current role is: FOLLOWER
I20251215 14:54:59.633999 8941 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [sys.catalog]: This master's current role is: FOLLOWER
I20251215 14:54:59.681504 8956 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20251215 14:54:59.711369 8956 catalog_manager.cc:1269] Loaded cluster ID: ed5da7b2c3a646fcbe8e0bb3a7589268
I20251215 14:54:59.711510 8956 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: loading cluster ID for follower catalog manager: success
I20251215 14:54:59.715556 8956 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: acquiring CA information for follower catalog manager: success
I20251215 14:54:59.719151 8956 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20251215 14:54:59.955044 8938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251215 14:54:59.955390 8938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251215 14:54:59.955525 8938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251215 14:54:59.964542 8938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251215 14:54:59.964766 8938 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.121.129
I20251215 14:54:59.975049 8938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.121.148:35915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.121.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.8.121.129
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.121.129
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type FASTDEBUG
built by None at 15 Dec 2025 14:43:20 UTC on 24a791456cd2
build id 9528
ASAN enabled
I20251215 14:54:59.976671 8938 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251215 14:54:59.978392 8938 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 14:54:59.987576 8962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 14:54:59.996102 8963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 14:54:59.996611 8965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 14:54:59.998041 8938 server_base.cc:1047] running on GCE node
I20251215 14:54:59.998667 8938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251215 14:55:00.003489 8938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251215 14:55:00.004814 8938 hybrid_clock.cc:648] HybridClock initialized: now 1765810500004760 us; error 64 us; skew 500 ppm
I20251215 14:55:00.005203 8938 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 14:55:00.007588 8938 webserver.cc:492] Webserver started at http://127.8.121.129:38165/ using document root <none> and password file <none>
I20251215 14:55:00.008531 8938 fs_manager.cc:362] Metadata directory not provided
I20251215 14:55:00.008656 8938 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 14:55:00.009035 8938 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 14:55:00.011713 8938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/data/instance:
uuid: "67978ac4539d4b289e53f4eedd9a8156"
format_stamp: "Formatted at 2025-12-15 14:55:00 on dist-test-slave-z089"
I20251215 14:55:00.012507 8938 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/instance:
uuid: "67978ac4539d4b289e53f4eedd9a8156"
format_stamp: "Formatted at 2025-12-15 14:55:00 on dist-test-slave-z089"
I20251215 14:55:00.019394 8938 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20251215 14:55:00.030082 8921 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1f310d741d8247488792985606a1c19e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:55:00.030503 8921 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [sys.catalog]: This master's current role is: LEADER
I20251215 14:55:00.036728 8972 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 14:55:00.038420 8938 fs_manager.cc:730] Time spent opening block manager: real 0.014s user 0.009s sys 0.002s
I20251215 14:55:00.038584 8938 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal
uuid: "67978ac4539d4b289e53f4eedd9a8156"
format_stamp: "Formatted at 2025-12-15 14:55:00 on dist-test-slave-z089"
I20251215 14:55:00.038789 8938 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 14:55:00.052726 8938 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 14:55:00.053551 8938 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251215 14:55:00.053804 8938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 14:55:00.054750 8938 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 14:55:00.056533 8938 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 14:55:00.056631 8938 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 14:55:00.056738 8938 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 14:55:00.056809 8938 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 14:55:00.093864 8938 rpc_server.cc:307] RPC server started. Bound to: 127.8.121.129:35891
I20251215 14:55:00.093941 9086 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.121.129:35891 every 8 connection(s)
I20251215 14:55:00.095278 8938 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/data/info.pb
I20251215 14:55:00.099504 8678 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu as pid 8938
I20251215 14:55:00.099705 8678 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/instance
I20251215 14:55:00.104477 8678 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
/tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.121.130:0
--local_ip_for_outbound_sockets=127.8.121.130
--webserver_interface=127.8.121.130
--webserver_port=0
--tserver_master_addrs=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--builtin_ntp_servers=127.8.121.148:35915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20251215 14:55:00.135908 9088 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:00.136453 9088 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:00.137075 9089 heartbeater.cc:344] Connected to a master server at 127.8.121.189:45723
I20251215 14:55:00.137291 9089 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:00.138453 9089 heartbeater.cc:507] Master 127.8.121.189:45723 requested a full tablet report, sending...
I20251215 14:55:00.138623 9088 heartbeater.cc:507] Master 127.8.121.190:44279 requested a full tablet report, sending...
I20251215 14:55:00.141332 8788 ts_manager.cc:194] Registered new tserver with Master: 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:00.143551 8717 ts_manager.cc:194] Registered new tserver with Master: 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:00.144342 9087 heartbeater.cc:344] Connected to a master server at 127.8.121.188:43131
I20251215 14:55:00.144495 9087 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:00.145068 9087 heartbeater.cc:507] Master 127.8.121.188:43131 requested a full tablet report, sending...
I20251215 14:55:00.146605 8859 ts_manager.cc:194] Registered new tserver with Master: 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:00.148659 8859 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.121.129:34281
W20251215 14:55:00.453377 9097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251215 14:55:00.453723 9097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251215 14:55:00.453814 9097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251215 14:55:00.462586 9097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251215 14:55:00.462779 9097 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.121.130
I20251215 14:55:00.472857 9097 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.121.148:35915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.121.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.8.121.130
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.121.130
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type FASTDEBUG
built by None at 15 Dec 2025 14:43:20 UTC on 24a791456cd2
build id 9528
ASAN enabled
I20251215 14:55:00.474417 9097 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251215 14:55:00.476181 9097 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 14:55:00.485764 9103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 14:55:00.485766 9102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 14:55:00.486342 9105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 14:55:00.487397 9097 server_base.cc:1047] running on GCE node
I20251215 14:55:00.487991 9097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251215 14:55:00.488950 9097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251215 14:55:00.490166 9097 hybrid_clock.cc:648] HybridClock initialized: now 1765810500490115 us; error 48 us; skew 500 ppm
I20251215 14:55:00.490437 9097 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 14:55:00.492724 9097 webserver.cc:492] Webserver started at http://127.8.121.130:39609/ using document root <none> and password file <none>
I20251215 14:55:00.493458 9097 fs_manager.cc:362] Metadata directory not provided
I20251215 14:55:00.493546 9097 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 14:55:00.493858 9097 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 14:55:00.496239 9097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/data/instance:
uuid: "3ea5306c36594ef4a62211f2bd6669a3"
format_stamp: "Formatted at 2025-12-15 14:55:00 on dist-test-slave-z089"
I20251215 14:55:00.497076 9097 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/instance:
uuid: "3ea5306c36594ef4a62211f2bd6669a3"
format_stamp: "Formatted at 2025-12-15 14:55:00 on dist-test-slave-z089"
I20251215 14:55:00.503381 9097 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20251215 14:55:00.507292 9111 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 14:55:00.508752 9097 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20251215 14:55:00.509038 9097 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal
uuid: "3ea5306c36594ef4a62211f2bd6669a3"
format_stamp: "Formatted at 2025-12-15 14:55:00 on dist-test-slave-z089"
I20251215 14:55:00.509289 9097 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 14:55:00.522732 9097 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 14:55:00.523614 9097 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251215 14:55:00.523854 9097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 14:55:00.524724 9097 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 14:55:00.526331 9097 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 14:55:00.526417 9097 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 14:55:00.526494 9097 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 14:55:00.526548 9097 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 14:55:00.530977 9121 raft_consensus.cc:493] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f310d741d8247488792985606a1c19e)
I20251215 14:55:00.531276 9121 raft_consensus.cc:515] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:00.531935 9121 leader_election.cc:290] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cad1fca07ac7419cb608c21541f672f3 (127.8.121.190:44279), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:00.532469 8727 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "40747def373e4b19abfa5d21ba0a4315" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cad1fca07ac7419cb608c21541f672f3" is_pre_election: true
I20251215 14:55:00.532539 8869 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "40747def373e4b19abfa5d21ba0a4315" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:00.533257 8772 leader_election.cc:304] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40747def373e4b19abfa5d21ba0a4315; no voters: 1f310d741d8247488792985606a1c19e, cad1fca07ac7419cb608c21541f672f3
I20251215 14:55:00.533490 9121 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 14:55:00.558446 9097 rpc_server.cc:307] RPC server started. Bound to: 127.8.121.130:38013
I20251215 14:55:00.558468 9224 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.121.130:38013 every 8 connection(s)
I20251215 14:55:00.559828 9097 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/data/info.pb
I20251215 14:55:00.569104 8678 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu as pid 9097
I20251215 14:55:00.569304 8678 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/instance
I20251215 14:55:00.573004 8678 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
/tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.8.121.131:0
--local_ip_for_outbound_sockets=127.8.121.131
--webserver_interface=127.8.121.131
--webserver_port=0
--tserver_master_addrs=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--builtin_ntp_servers=127.8.121.148:35915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20251215 14:55:00.580556 9225 heartbeater.cc:344] Connected to a master server at 127.8.121.188:43131
I20251215 14:55:00.580927 9225 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:00.581836 9225 heartbeater.cc:507] Master 127.8.121.188:43131 requested a full tablet report, sending...
I20251215 14:55:00.582631 9227 heartbeater.cc:344] Connected to a master server at 127.8.121.189:45723
I20251215 14:55:00.582793 9227 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:00.583343 9227 heartbeater.cc:507] Master 127.8.121.189:45723 requested a full tablet report, sending...
I20251215 14:55:00.583452 8859 ts_manager.cc:194] Registered new tserver with Master: 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:00.584388 8788 ts_manager.cc:194] Registered new tserver with Master: 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:00.584439 8859 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.121.130:55071
I20251215 14:55:00.585310 9226 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:00.585454 9226 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:00.585984 9226 heartbeater.cc:507] Master 127.8.121.190:44279 requested a full tablet report, sending...
I20251215 14:55:00.587065 8717 ts_manager.cc:194] Registered new tserver with Master: 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:00.652253 9087 heartbeater.cc:499] Master 127.8.121.188:43131 was elected leader, sending a full tablet report...
I20251215 14:55:00.846448 9233 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f310d741d8247488792985606a1c19e)
I20251215 14:55:00.846675 9233 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:00.847970 9233 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:00.848562 8796 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:55:00.848623 8869 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:00.849310 8703 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:55:00.849713 9233 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:55:00.900063 9232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251215 14:55:00.900326 9232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251215 14:55:00.900452 9232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251215 14:55:00.908437 9232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251215 14:55:00.908618 9232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.8.121.131
I20251215 14:55:00.917796 9232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.121.148:35915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.8.121.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.8.121.131
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.8.121.131
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type FASTDEBUG
built by None at 15 Dec 2025 14:43:20 UTC on 24a791456cd2
build id 9528
ASAN enabled
I20251215 14:55:00.919229 9232 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251215 14:55:00.920836 9232 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251215 14:55:00.929690 9239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 14:55:00.929733 9238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 14:55:00.930727 9241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 14:55:00.930941 9232 server_base.cc:1047] running on GCE node
I20251215 14:55:00.931496 9232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251215 14:55:00.932313 9232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251215 14:55:00.933624 9232 hybrid_clock.cc:648] HybridClock initialized: now 1765810500933578 us; error 41 us; skew 500 ppm
I20251215 14:55:00.933909 9232 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 14:55:00.936116 9232 webserver.cc:492] Webserver started at http://127.8.121.131:39225/ using document root <none> and password file <none>
I20251215 14:55:00.936830 9232 fs_manager.cc:362] Metadata directory not provided
I20251215 14:55:00.936920 9232 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 14:55:00.937242 9232 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251215 14:55:00.939554 9232 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/data/instance:
uuid: "e89303a500544272b601d7c29be802b4"
format_stamp: "Formatted at 2025-12-15 14:55:00 on dist-test-slave-z089"
I20251215 14:55:00.940282 9232 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/instance:
uuid: "e89303a500544272b601d7c29be802b4"
format_stamp: "Formatted at 2025-12-15 14:55:00 on dist-test-slave-z089"
I20251215 14:55:00.945498 9232 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20251215 14:55:00.948957 9247 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 14:55:00.950163 9232 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20251215 14:55:00.950309 9232 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal
uuid: "e89303a500544272b601d7c29be802b4"
format_stamp: "Formatted at 2025-12-15 14:55:00 on dist-test-slave-z089"
I20251215 14:55:00.950493 9232 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 14:55:00.975252 9232 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 14:55:00.976140 9232 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251215 14:55:00.976387 9232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 14:55:00.977440 9232 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251215 14:55:00.979031 9232 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251215 14:55:00.979117 9232 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251215 14:55:00.979254 9232 ts_tablet_manager.cc:616] Registered 0 tablets
I20251215 14:55:00.979327 9232 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251215 14:55:01.008461 9232 rpc_server.cc:307] RPC server started. Bound to: 127.8.121.131:32959
I20251215 14:55:01.008528 9359 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.121.131:32959 every 8 connection(s)
I20251215 14:55:01.009771 9232 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/data/info.pb
I20251215 14:55:01.011261 8678 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu as pid 9232
I20251215 14:55:01.011436 8678 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/instance
I20251215 14:55:01.027441 9361 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:01.027526 9362 heartbeater.cc:344] Connected to a master server at 127.8.121.189:45723
I20251215 14:55:01.027654 9360 heartbeater.cc:344] Connected to a master server at 127.8.121.188:43131
I20251215 14:55:01.027859 9362 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:01.027858 9361 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:01.027861 9360 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:01.028893 9360 heartbeater.cc:507] Master 127.8.121.188:43131 requested a full tablet report, sending...
I20251215 14:55:01.028899 9361 heartbeater.cc:507] Master 127.8.121.190:44279 requested a full tablet report, sending...
I20251215 14:55:01.029062 9362 heartbeater.cc:507] Master 127.8.121.189:45723 requested a full tablet report, sending...
I20251215 14:55:01.030771 8859 ts_manager.cc:194] Registered new tserver with Master: e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:01.031038 8717 ts_manager.cc:194] Registered new tserver with Master: e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:01.031134 8788 ts_manager.cc:194] Registered new tserver with Master: e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:01.031694 8859 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.8.121.131:34335
I20251215 14:55:01.038547 8678 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251215 14:55:01.071605 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_a6d35dc19d6e417e8afa2918adf01218"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:01.071626 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_815c5eca697a473a85eab3bcd43a8c60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:01.072626 8855 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_62f75d7b0250485d9f7f50cc42b934da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.073390 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_815c5eca697a473a85eab3bcd43a8c60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.073450 8856 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_ca67fbbef81f49389bad96d388b11544"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.073985 8856 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ca67fbbef81f49389bad96d388b11544 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:01.074465 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6d35dc19d6e417e8afa2918adf01218 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.074466 8858 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_a09e62eba83d49ceb5dac10953ea38f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.075531 8858 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a09e62eba83d49ceb5dac10953ea38f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:01.075985 8855 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62f75d7b0250485d9f7f50cc42b934da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.084860 8853 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_044bcb3e9732428c8f1ecc5285914c97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.085675 8853 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_044bcb3e9732428c8f1ecc5285914c97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.087234 8854 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_798ba7fe599249a4b5cab2b560cc080c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:01.087450 9225 heartbeater.cc:499] Master 127.8.121.188:43131 was elected leader, sending a full tablet report...
W20251215 14:55:01.087909 8854 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_798ba7fe599249a4b5cab2b560cc080c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.089476 8851 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_60abc84eda3b44f785d61f709318a2d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.090082 8851 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_60abc84eda3b44f785d61f709318a2d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.091423 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_1e1266cdfe7d4dba8091a9df2d81a4cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:01.091439 8852 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_5137da5b531d4ca0b2a91137b5f825fb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.092051 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e1266cdfe7d4dba8091a9df2d81a4cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:01.092175 8852 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5137da5b531d4ca0b2a91137b5f825fb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.164280 8856 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_1e1266cdfe7d4dba8091a9df2d81a4cf" } modify_external_catalogs: true
I20251215 14:55:01.164570 8856 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_1e1266cdfe7d4dba8091a9df2d81a4cf" } modify_external_catalogs: true
I20251215 14:55:01.165472 8855 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_a09e62eba83d49ceb5dac10953ea38f0" } new_table_name: "default.Table_6326587168434469983b7215bb514379" modify_external_catalogs: true
I20251215 14:55:01.165601 8859 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_62f75d7b0250485d9f7f50cc42b934da" } new_table_name: "default.Table_adf3bac6c3e142c58b7d5800645458d8" modify_external_catalogs: true
I20251215 14:55:01.166273 8854 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_815c5eca697a473a85eab3bcd43a8c60" } new_table_name: "default.Table_53ee7a88682840ed8db27eeb7b5b89bf" modify_external_catalogs: true
I20251215 14:55:01.166712 8851 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_798ba7fe599249a4b5cab2b560cc080c" } modify_external_catalogs: true
I20251215 14:55:01.166895 8851 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_798ba7fe599249a4b5cab2b560cc080c" } modify_external_catalogs: true
I20251215 14:55:01.166956 8850 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_044bcb3e9732428c8f1ecc5285914c97" } modify_external_catalogs: true
I20251215 14:55:01.167183 8850 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_044bcb3e9732428c8f1ecc5285914c97" } modify_external_catalogs: true
I20251215 14:55:01.167414 8858 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_ca67fbbef81f49389bad96d388b11544" } new_table_name: "default.Table_4437875587ce4e46a16cd8154d6ccc6b" modify_external_catalogs: true
I20251215 14:55:01.169384 8852 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_60abc84eda3b44f785d61f709318a2d2" } modify_external_catalogs: true
I20251215 14:55:01.169991 8857 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_a6d35dc19d6e417e8afa2918adf01218" } new_table_name: "default.Table_b14b6efc32fb4b5288be46be8bfb2005" modify_external_catalogs: true
I20251215 14:55:01.170125 8853 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_5137da5b531d4ca0b2a91137b5f825fb" } modify_external_catalogs: true
I20251215 14:55:01.170293 8853 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_5137da5b531d4ca0b2a91137b5f825fb" } modify_external_catalogs: true
I20251215 14:55:01.171617 8852 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_60abc84eda3b44f785d61f709318a2d2" } modify_external_catalogs: true
I20251215 14:55:01.179857 8678 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu pid 8686
W20251215 14:55:01.180272 8855 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2ff9b217e17d45b9a492902ddc54da01 has no consensus state
I20251215 14:55:01.181329 8747 generic_service.cc:196] Checking for leaks (request via RPC)
I20251215 14:55:01.184484 8851 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 1f4e9962e4154441ab2b74a327691ac4
I20251215 14:55:01.187147 8850 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 0809096d4e6a45ddb5e21a66c215d938
I20251215 14:55:01.188591 8856 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet b5c85cafdd94446aaf46992a4c795761
W20251215 14:55:01.189868 8859 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 769b0b615f334735a21564de213453b9 has no consensus state
W20251215 14:55:01.190078 8858 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7fc23183b3cb4330a32fca4d9a099d7a has no consensus state
I20251215 14:55:01.194938 8853 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 5649982b87614022bfbcb664ed2331e4
W20251215 14:55:01.197714 8857 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet de764ce68d7e43fd8925b7f2bbc23f2a has no consensus state
W20251215 14:55:01.198161 8854 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5841bc20f8134b2483b23676d66504e1 has no consensus state
I20251215 14:55:01.198786 8852 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 4c342d1ce1bf4e379679cbd43a9f4dfc
W20251215 14:55:01.212898 8844 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 2ff9b217e17d45b9a492902ddc54da01 (table default.Table_6326587168434469983b7215bb514379 [id=b77dd33e03384d6dadf621ad29c6d9e2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2ff9b217e17d45b9a492902ddc54da01 consensus state has no leader
I20251215 14:55:01.218818 9160 tablet_service.cc:1505] Processing CreateTablet for tablet 2ff9b217e17d45b9a492902ddc54da01 (DEFAULT_TABLE table=default.Table_6326587168434469983b7215bb514379 [id=b77dd33e03384d6dadf621ad29c6d9e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.220659 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff9b217e17d45b9a492902ddc54da01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.220567 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 7fc23183b3cb4330a32fca4d9a099d7a (DEFAULT_TABLE table=default.Table_4437875587ce4e46a16cd8154d6ccc6b [id=beb4a6485efb47f889e1e3ae24167c9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.221932 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fc23183b3cb4330a32fca4d9a099d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.224151 9157 tablet_service.cc:1505] Processing CreateTablet for tablet 5841bc20f8134b2483b23676d66504e1 (DEFAULT_TABLE table=default.Table_53ee7a88682840ed8db27eeb7b5b89bf [id=6a65bee750c2458a8ac47914928e1b43]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.224625 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5841bc20f8134b2483b23676d66504e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.224666 9158 tablet_service.cc:1505] Processing CreateTablet for tablet 769b0b615f334735a21564de213453b9 (DEFAULT_TABLE table=default.Table_adf3bac6c3e142c58b7d5800645458d8 [id=2956f54f93c242ff9624fca6bf3de2e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.225131 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769b0b615f334735a21564de213453b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.228958 9156 tablet_service.cc:1505] Processing CreateTablet for tablet de764ce68d7e43fd8925b7f2bbc23f2a (DEFAULT_TABLE table=default.Table_b14b6efc32fb4b5288be46be8bfb2005 [id=654a552b658648808b442355e8e960e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.229507 9156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de764ce68d7e43fd8925b7f2bbc23f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.238049 9022 tablet_service.cc:1505] Processing CreateTablet for tablet 2ff9b217e17d45b9a492902ddc54da01 (DEFAULT_TABLE table=default.Table_6326587168434469983b7215bb514379 [id=b77dd33e03384d6dadf621ad29c6d9e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.239475 9020 tablet_service.cc:1505] Processing CreateTablet for tablet 769b0b615f334735a21564de213453b9 (DEFAULT_TABLE table=default.Table_adf3bac6c3e142c58b7d5800645458d8 [id=2956f54f93c242ff9624fca6bf3de2e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.240103 9018 tablet_service.cc:1505] Processing CreateTablet for tablet de764ce68d7e43fd8925b7f2bbc23f2a (DEFAULT_TABLE table=default.Table_b14b6efc32fb4b5288be46be8bfb2005 [id=654a552b658648808b442355e8e960e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.240679 9021 tablet_service.cc:1505] Processing CreateTablet for tablet 7fc23183b3cb4330a32fca4d9a099d7a (DEFAULT_TABLE table=default.Table_4437875587ce4e46a16cd8154d6ccc6b [id=beb4a6485efb47f889e1e3ae24167c9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.241122 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 5841bc20f8134b2483b23676d66504e1 (DEFAULT_TABLE table=default.Table_53ee7a88682840ed8db27eeb7b5b89bf [id=6a65bee750c2458a8ac47914928e1b43]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.241842 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff9b217e17d45b9a492902ddc54da01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.244280 9021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fc23183b3cb4330a32fca4d9a099d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.246943 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de764ce68d7e43fd8925b7f2bbc23f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.247335 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769b0b615f334735a21564de213453b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.249747 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5841bc20f8134b2483b23676d66504e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.256723 9426 tablet_bootstrap.cc:492] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:01.260367 9426 tablet_bootstrap.cc:654] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.261698 9426 log.cc:826] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3: Log is configured to *not* fsync() on all Append() calls
I20251215 14:55:01.270887 9426 tablet_bootstrap.cc:492] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:01.271381 9426 ts_tablet_manager.cc:1403] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.015s user 0.014s sys 0.000s
I20251215 14:55:01.274518 9427 tablet_bootstrap.cc:492] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:01.278187 9427 tablet_bootstrap.cc:654] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.278270 9294 tablet_service.cc:1505] Processing CreateTablet for tablet 7fc23183b3cb4330a32fca4d9a099d7a (DEFAULT_TABLE table=default.Table_4437875587ce4e46a16cd8154d6ccc6b [id=beb4a6485efb47f889e1e3ae24167c9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.279225 8852 master_service.cc:954] ReplaceTablet: received request to replace tablet de764ce68d7e43fd8925b7f2bbc23f2a from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:01.279546 9427 log.cc:826] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156: Log is configured to *not* fsync() on all Append() calls
I20251215 14:55:01.284713 8854 master_service.cc:954] ReplaceTablet: received request to replace tablet 7fc23183b3cb4330a32fca4d9a099d7a from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:01.284925 8853 master_service.cc:954] ReplaceTablet: received request to replace tablet de764ce68d7e43fd8925b7f2bbc23f2a from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:01.285048 8857 master_service.cc:954] ReplaceTablet: received request to replace tablet 2ff9b217e17d45b9a492902ddc54da01 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:01.284978 9291 tablet_service.cc:1505] Processing CreateTablet for tablet de764ce68d7e43fd8925b7f2bbc23f2a (DEFAULT_TABLE table=default.Table_b14b6efc32fb4b5288be46be8bfb2005 [id=654a552b658648808b442355e8e960e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.285841 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 2ff9b217e17d45b9a492902ddc54da01 (DEFAULT_TABLE table=default.Table_6326587168434469983b7215bb514379 [id=b77dd33e03384d6dadf621ad29c6d9e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.286320 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 769b0b615f334735a21564de213453b9 (DEFAULT_TABLE table=default.Table_adf3bac6c3e142c58b7d5800645458d8 [id=2956f54f93c242ff9624fca6bf3de2e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.286526 9292 tablet_service.cc:1505] Processing CreateTablet for tablet 5841bc20f8134b2483b23676d66504e1 (DEFAULT_TABLE table=default.Table_53ee7a88682840ed8db27eeb7b5b89bf [id=6a65bee750c2458a8ac47914928e1b43]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.286757 8858 master_service.cc:954] ReplaceTablet: received request to replace tablet 5841bc20f8134b2483b23676d66504e1 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:01.288478 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de764ce68d7e43fd8925b7f2bbc23f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.295405 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 769b0b615f334735a21564de213453b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.296018 8852 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet de764ce68d7e43fd8925b7f2bbc23f2a
I20251215 14:55:01.296900 8852 catalog_manager.cc:6724] ReplaceTablet: tablet de764ce68d7e43fd8925b7f2bbc23f2a deleted and replaced by tablet 8612ebb3fc3c4554be4b881a60ad6fd4
I20251215 14:55:01.298519 9427 tablet_bootstrap.cc:492] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:01.298825 9427 ts_tablet_manager.cc:1403] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.025s user 0.006s sys 0.007s
I20251215 14:55:01.299407 8857 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 2ff9b217e17d45b9a492902ddc54da01
I20251215 14:55:01.299899 8857 catalog_manager.cc:6724] ReplaceTablet: tablet 2ff9b217e17d45b9a492902ddc54da01 deleted and replaced by tablet e420bc0a9c384e349a66d3eb8fb915d2
I20251215 14:55:01.299729 9158 tablet_service.cc:1552] Processing DeleteTablet for tablet de764ce68d7e43fd8925b7f2bbc23f2a with delete_type TABLET_DATA_DELETED (replaced by tablet 8612ebb3fc3c4554be4b881a60ad6fd4) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.300760 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 2ff9b217e17d45b9a492902ddc54da01 with delete_type TABLET_DATA_DELETED (replaced by tablet e420bc0a9c384e349a66d3eb8fb915d2) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.301193 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet 2ff9b217e17d45b9a492902ddc54da01 with delete_type TABLET_DATA_DELETED (replaced by tablet e420bc0a9c384e349a66d3eb8fb915d2) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.301779 9292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5841bc20f8134b2483b23676d66504e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.306942 8858 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 5841bc20f8134b2483b23676d66504e1
I20251215 14:55:01.307211 8854 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 7fc23183b3cb4330a32fca4d9a099d7a
I20251215 14:55:01.307502 8858 catalog_manager.cc:6724] ReplaceTablet: tablet 5841bc20f8134b2483b23676d66504e1 deleted and replaced by tablet bf500ddc89754110be1cacf9d4289090
I20251215 14:55:01.307585 8854 catalog_manager.cc:6724] ReplaceTablet: tablet 7fc23183b3cb4330a32fca4d9a099d7a deleted and replaced by tablet cbf290c214374f619d5a09b12872b5c0
I20251215 14:55:01.307957 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet de764ce68d7e43fd8925b7f2bbc23f2a with delete_type TABLET_DATA_DELETED (replaced by tablet 8612ebb3fc3c4554be4b881a60ad6fd4) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.308065 9289 tablet_service.cc:1552] Processing DeleteTablet for tablet 2ff9b217e17d45b9a492902ddc54da01 with delete_type TABLET_DATA_DELETED (replaced by tablet e420bc0a9c384e349a66d3eb8fb915d2) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.308523 9287 tablet_service.cc:1552] Processing DeleteTablet for tablet 7fc23183b3cb4330a32fca4d9a099d7a with delete_type TABLET_DATA_DELETED (replaced by tablet cbf290c214374f619d5a09b12872b5c0) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.308866 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 7fc23183b3cb4330a32fca4d9a099d7a with delete_type TABLET_DATA_DELETED (replaced by tablet cbf290c214374f619d5a09b12872b5c0) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.309091 9288 tablet_service.cc:1552] Processing DeleteTablet for tablet 5841bc20f8134b2483b23676d66504e1 with delete_type TABLET_DATA_DELETED (replaced by tablet bf500ddc89754110be1cacf9d4289090) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.309340 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet 5841bc20f8134b2483b23676d66504e1 with delete_type TABLET_DATA_DELETED (replaced by tablet bf500ddc89754110be1cacf9d4289090) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.307968 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ff9b217e17d45b9a492902ddc54da01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.311278 9021 tablet_service.cc:1552] Processing DeleteTablet for tablet 5841bc20f8134b2483b23676d66504e1 with delete_type TABLET_DATA_DELETED (replaced by tablet bf500ddc89754110be1cacf9d4289090) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.311558 9020 tablet_service.cc:1552] Processing DeleteTablet for tablet 7fc23183b3cb4330a32fca4d9a099d7a with delete_type TABLET_DATA_DELETED (replaced by tablet cbf290c214374f619d5a09b12872b5c0) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.311945 9019 tablet_service.cc:1552] Processing DeleteTablet for tablet de764ce68d7e43fd8925b7f2bbc23f2a with delete_type TABLET_DATA_DELETED (replaced by tablet 8612ebb3fc3c4554be4b881a60ad6fd4) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.314340 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fc23183b3cb4330a32fca4d9a099d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.320730 9160 tablet_service.cc:1505] Processing CreateTablet for tablet 8612ebb3fc3c4554be4b881a60ad6fd4 (DEFAULT_TABLE table=default.Table_b14b6efc32fb4b5288be46be8bfb2005 [id=654a552b658648808b442355e8e960e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.321424 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8612ebb3fc3c4554be4b881a60ad6fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.324115 9288 tablet_service.cc:1505] Processing CreateTablet for tablet 8612ebb3fc3c4554be4b881a60ad6fd4 (DEFAULT_TABLE table=default.Table_b14b6efc32fb4b5288be46be8bfb2005 [id=654a552b658648808b442355e8e960e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.325131 9288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8612ebb3fc3c4554be4b881a60ad6fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.325103 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 8612ebb3fc3c4554be4b881a60ad6fd4 (DEFAULT_TABLE table=default.Table_b14b6efc32fb4b5288be46be8bfb2005 [id=654a552b658648808b442355e8e960e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.325567 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8612ebb3fc3c4554be4b881a60ad6fd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.334161 9020 tablet_service.cc:1505] Processing CreateTablet for tablet e420bc0a9c384e349a66d3eb8fb915d2 (DEFAULT_TABLE table=default.Table_6326587168434469983b7215bb514379 [id=b77dd33e03384d6dadf621ad29c6d9e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.334679 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e420bc0a9c384e349a66d3eb8fb915d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.336437 9427 raft_consensus.cc:359] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.342768 8853 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_7da12d7e9c3e442ca5fd8bd669a4dcf4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:01.343024 9159 tablet_service.cc:1505] Processing CreateTablet for tablet e420bc0a9c384e349a66d3eb8fb915d2 (DEFAULT_TABLE table=default.Table_6326587168434469983b7215bb514379 [id=b77dd33e03384d6dadf621ad29c6d9e2]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:01.343438 8853 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7da12d7e9c3e442ca5fd8bd669a4dcf4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.343530 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e420bc0a9c384e349a66d3eb8fb915d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.343806 8854 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_bffe8e8d6e27493eb40362594310e612"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.344365 8854 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bffe8e8d6e27493eb40362594310e612 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.347565 9157 tablet_service.cc:1505] Processing CreateTablet for tablet cbf290c214374f619d5a09b12872b5c0 (DEFAULT_TABLE table=default.Table_4437875587ce4e46a16cd8154d6ccc6b [id=beb4a6485efb47f889e1e3ae24167c9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.348039 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbf290c214374f619d5a09b12872b5c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.352198 9290 tablet_service.cc:1505] Processing CreateTablet for tablet e420bc0a9c384e349a66d3eb8fb915d2 (DEFAULT_TABLE table=default.Table_6326587168434469983b7215bb514379 [id=b77dd33e03384d6dadf621ad29c6d9e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.352458 8858 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_c5906c964a4b4bfdb59ca029909a5f70"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:01.352824 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e420bc0a9c384e349a66d3eb8fb915d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.352730 9156 tablet_service.cc:1505] Processing CreateTablet for tablet bf500ddc89754110be1cacf9d4289090 (DEFAULT_TABLE table=default.Table_53ee7a88682840ed8db27eeb7b5b89bf [id=6a65bee750c2458a8ac47914928e1b43]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.353127 9156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf500ddc89754110be1cacf9d4289090. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:01.353104 8858 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5906c964a4b4bfdb59ca029909a5f70 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.349344 9020 tablet_service.cc:1505] Processing CreateTablet for tablet cbf290c214374f619d5a09b12872b5c0 (DEFAULT_TABLE table=default.Table_4437875587ce4e46a16cd8154d6ccc6b [id=beb4a6485efb47f889e1e3ae24167c9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.354627 9021 tablet_service.cc:1505] Processing CreateTablet for tablet bf500ddc89754110be1cacf9d4289090 (DEFAULT_TABLE table=default.Table_53ee7a88682840ed8db27eeb7b5b89bf [id=6a65bee750c2458a8ac47914928e1b43]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.355049 9021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf500ddc89754110be1cacf9d4289090. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.355651 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbf290c214374f619d5a09b12872b5c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.355760 9287 tablet_service.cc:1505] Processing CreateTablet for tablet cbf290c214374f619d5a09b12872b5c0 (DEFAULT_TABLE table=default.Table_4437875587ce4e46a16cd8154d6ccc6b [id=beb4a6485efb47f889e1e3ae24167c9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.356360 9287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbf290c214374f619d5a09b12872b5c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.361766 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_2da13dbc33354231b3a34592394649ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:01.362183 8856 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_1290357576a4475985bf0cd26aad05b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.362448 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2da13dbc33354231b3a34592394649ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:01.362668 8856 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1290357576a4475985bf0cd26aad05b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.363641 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_40f2cfc11d6749ea8c11ae2c03b66d4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:01.361888 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_b65017b0164e42939c1fc79f7d09cd26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.364149 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40f2cfc11d6749ea8c11ae2c03b66d4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:01.364456 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b65017b0164e42939c1fc79f7d09cd26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.364123 8852 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_f03100dc381b44e3ad63fe80974ffb47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.366104 8852 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f03100dc381b44e3ad63fe80974ffb47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.367390 8853 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_f6179b6a903946ac9b6a982c9ff87304"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.367820 8853 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f6179b6a903946ac9b6a982c9ff87304 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.370398 8851 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_07c61e3442a245ed8d12bba7ca7b540d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.370817 8851 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07c61e3442a245ed8d12bba7ca7b540d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.373895 9427 raft_consensus.cc:385] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.374467 9427 raft_consensus.cc:740] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.377158 9427 consensus_queue.cc:260] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.385515 9286 tablet_service.cc:1505] Processing CreateTablet for tablet bf500ddc89754110be1cacf9d4289090 (DEFAULT_TABLE table=default.Table_53ee7a88682840ed8db27eeb7b5b89bf [id=6a65bee750c2458a8ac47914928e1b43]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.386127 9286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf500ddc89754110be1cacf9d4289090. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:01.401959 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet de764ce68d7e43fd8925b7f2bbc23f2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de764ce68d7e43fd8925b7f2bbc23f2a already in progress: creating tablet
W20251215 14:55:01.402637 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 2ff9b217e17d45b9a492902ddc54da01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ff9b217e17d45b9a492902ddc54da01 already in progress: creating tablet
W20251215 14:55:01.403318 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 7fc23183b3cb4330a32fca4d9a099d7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fc23183b3cb4330a32fca4d9a099d7a already in progress: creating tablet
I20251215 14:55:01.403961 9435 tablet_bootstrap.cc:492] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:01.404654 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 2ff9b217e17d45b9a492902ddc54da01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ff9b217e17d45b9a492902ddc54da01 already in progress: creating tablet
W20251215 14:55:01.405265 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 7fc23183b3cb4330a32fca4d9a099d7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fc23183b3cb4330a32fca4d9a099d7a already in progress: creating tablet
W20251215 14:55:01.405483 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet de764ce68d7e43fd8925b7f2bbc23f2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de764ce68d7e43fd8925b7f2bbc23f2a already in progress: creating tablet
W20251215 14:55:01.405563 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 5841bc20f8134b2483b23676d66504e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5841bc20f8134b2483b23676d66504e1 already in progress: creating tablet
W20251215 14:55:01.405675 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 5841bc20f8134b2483b23676d66504e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5841bc20f8134b2483b23676d66504e1 already in progress: creating tablet
I20251215 14:55:01.407915 9435 tablet_bootstrap.cc:654] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:01.408535 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 2ff9b217e17d45b9a492902ddc54da01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ff9b217e17d45b9a492902ddc54da01 already in progress: creating tablet
W20251215 14:55:01.409220 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 5841bc20f8134b2483b23676d66504e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5841bc20f8134b2483b23676d66504e1 already in progress: creating tablet
I20251215 14:55:01.409924 9427 ts_tablet_manager.cc:1434] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.111s user 0.005s sys 0.008s
I20251215 14:55:01.410431 9427 tablet_bootstrap.cc:492] T de764ce68d7e43fd8925b7f2bbc23f2a P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:01.410245 9426 raft_consensus.cc:359] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.410655 9426 raft_consensus.cc:385] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.410754 9426 raft_consensus.cc:740] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.411434 9426 consensus_queue.cc:260] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.412135 9427 tablet_bootstrap.cc:654] T de764ce68d7e43fd8925b7f2bbc23f2a P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:01.412295 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 7fc23183b3cb4330a32fca4d9a099d7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fc23183b3cb4330a32fca4d9a099d7a already in progress: creating tablet
W20251215 14:55:01.412923 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet de764ce68d7e43fd8925b7f2bbc23f2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de764ce68d7e43fd8925b7f2bbc23f2a already in progress: creating tablet
I20251215 14:55:01.418814 9435 log.cc:826] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4: Log is configured to *not* fsync() on all Append() calls
I20251215 14:55:01.420279 8850 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_2da13dbc33354231b3a34592394649ec" } modify_external_catalogs: true
I20251215 14:55:01.420465 9426 ts_tablet_manager.cc:1434] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.149s user 0.012s sys 0.003s
I20251215 14:55:01.420482 8850 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_2da13dbc33354231b3a34592394649ec" } modify_external_catalogs: true
I20251215 14:55:01.421644 8854 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_7da12d7e9c3e442ca5fd8bd669a4dcf4" } new_table_name: "default.Table_5150978dc817409084ef9ea8c442b55a" modify_external_catalogs: true
I20251215 14:55:01.422644 8855 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_adf3bac6c3e142c58b7d5800645458d8" } modify_external_catalogs: true
I20251215 14:55:01.422787 8855 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_adf3bac6c3e142c58b7d5800645458d8" } modify_external_catalogs: true
I20251215 14:55:01.423487 8852 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_b65017b0164e42939c1fc79f7d09cd26" } modify_external_catalogs: true
I20251215 14:55:01.423620 8852 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_b65017b0164e42939c1fc79f7d09cd26" } modify_external_catalogs: true
I20251215 14:55:01.423671 9426 tablet_bootstrap.cc:492] T de764ce68d7e43fd8925b7f2bbc23f2a P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:01.421645 8857 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_bffe8e8d6e27493eb40362594310e612" } new_table_name: "default.Table_37b271542ee44db68c2370937f9daa7a" modify_external_catalogs: true
I20251215 14:55:01.423095 8859 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_6326587168434469983b7215bb514379" } modify_external_catalogs: true
I20251215 14:55:01.425161 8859 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_6326587168434469983b7215bb514379" } modify_external_catalogs: true
I20251215 14:55:01.425263 9426 tablet_bootstrap.cc:654] T de764ce68d7e43fd8925b7f2bbc23f2a P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.426321 8853 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_b14b6efc32fb4b5288be46be8bfb2005" } new_table_name: "default.Table_8a5fba89ed254208aebb339a847af804" modify_external_catalogs: true
I20251215 14:55:01.427387 8858 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_f03100dc381b44e3ad63fe80974ffb47" } new_table_name: "default.Table_42eef26c1ed74af99920acbaabc32301" modify_external_catalogs: true
I20251215 14:55:01.430689 9435 tablet_bootstrap.cc:492] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:01.431018 9435 ts_tablet_manager.cc:1403] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.027s user 0.006s sys 0.003s
I20251215 14:55:01.433130 9426 tablet_bootstrap.cc:492] T de764ce68d7e43fd8925b7f2bbc23f2a P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:01.433282 9426 ts_tablet_manager.cc:1403] T de764ce68d7e43fd8925b7f2bbc23f2a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20251215 14:55:01.434156 9426 raft_consensus.cc:359] T de764ce68d7e43fd8925b7f2bbc23f2a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.434335 9426 raft_consensus.cc:385] T de764ce68d7e43fd8925b7f2bbc23f2a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.434408 9426 raft_consensus.cc:740] T de764ce68d7e43fd8925b7f2bbc23f2a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.434648 9426 consensus_queue.cc:260] T de764ce68d7e43fd8925b7f2bbc23f2a P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.434859 8850 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet a7821f14d79f4925a7916b8a5038acdd
I20251215 14:55:01.436175 8851 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_53ee7a88682840ed8db27eeb7b5b89bf" } new_table_name: "default.Table_f9872d0312584944b7732038b2ae68ed" modify_external_catalogs: true
I20251215 14:55:01.438201 9019 tablet_service.cc:1552] Processing DeleteTablet for tablet 5841bc20f8134b2483b23676d66504e1 with delete_type TABLET_DATA_DELETED (replaced by tablet bf500ddc89754110be1cacf9d4289090) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.438632 9431 tablet_replica.cc:333] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:01.439182 9431 raft_consensus.cc:2243] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.439466 9427 tablet_bootstrap.cc:492] T de764ce68d7e43fd8925b7f2bbc23f2a P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:01.439610 9431 raft_consensus.cc:2272] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.441455 9431 ts_tablet_manager.cc:1916] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251215 14:55:01.442147 8854 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7c9141d604c34314a462b892076b7224 has no consensus state
I20251215 14:55:01.442489 8854 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_4437875587ce4e46a16cd8154d6ccc6b" } modify_external_catalogs: true
I20251215 14:55:01.443506 8854 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_4437875587ce4e46a16cd8154d6ccc6b" } modify_external_catalogs: true
I20251215 14:55:01.443969 9158 tablet_service.cc:1552] Processing DeleteTablet for tablet 769b0b615f334735a21564de213453b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.444243 9430 tablet_replica.cc:333] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:01.444650 9430 raft_consensus.cc:2243] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.445042 9430 raft_consensus.cc:2272] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.443009 8855 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 769b0b615f334735a21564de213453b9
I20251215 14:55:01.446681 9430 ts_tablet_manager.cc:1916] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.446906 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 769b0b615f334735a21564de213453b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.448530 9158 tablet_service.cc:1552] Processing DeleteTablet for tablet 769b0b615f334735a21564de213453b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:54874
W20251215 14:55:01.448743 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 769b0b615f334735a21564de213453b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 769b0b615f334735a21564de213453b9 already in progress: creating tablet
I20251215 14:55:01.450671 9019 tablet_service.cc:1552] Processing DeleteTablet for tablet 769b0b615f334735a21564de213453b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.443308 8852 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 1df2d8b344f94693bb6b819782b1cfb7
I20251215 14:55:01.453321 9430 ts_tablet_manager.cc:1929] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.453487 8859 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet e420bc0a9c384e349a66d3eb8fb915d2
I20251215 14:55:01.454134 9019 tablet_service.cc:1552] Processing DeleteTablet for tablet e420bc0a9c384e349a66d3eb8fb915d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:01.454348 8853 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8612ebb3fc3c4554be4b881a60ad6fd4 consensus state has no leader
W20251215 14:55:01.454713 8858 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 88c8499633f4417e9f6d2d6372f157c4 has no consensus state
I20251215 14:55:01.454885 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet e420bc0a9c384e349a66d3eb8fb915d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:01.455067 8851 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bf500ddc89754110be1cacf9d4289090 consensus state has no leader
W20251215 14:55:01.455982 8857 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3670e4f699894059a3f09a33a744e9f9 has no consensus state
W20251215 14:55:01.456445 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet e420bc0a9c384e349a66d3eb8fb915d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e420bc0a9c384e349a66d3eb8fb915d2 already in progress: creating tablet
I20251215 14:55:01.455812 9158 tablet_service.cc:1552] Processing DeleteTablet for tablet e420bc0a9c384e349a66d3eb8fb915d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.457257 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet de764ce68d7e43fd8925b7f2bbc23f2a with delete_type TABLET_DATA_DELETED (replaced by tablet 8612ebb3fc3c4554be4b881a60ad6fd4) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.458554 9430 log.cc:1199] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/769b0b615f334735a21564de213453b9
I20251215 14:55:01.459044 9430 ts_tablet_manager.cc:1950] T 769b0b615f334735a21564de213453b9 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:01.458184 9431 ts_tablet_manager.cc:1929] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.459776 8678 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu with pid 8686
I20251215 14:55:01.460861 9431 log.cc:1199] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/5841bc20f8134b2483b23676d66504e1
I20251215 14:55:01.461258 9431 ts_tablet_manager.cc:1950] T 5841bc20f8134b2483b23676d66504e1 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:01.461859 9435 raft_consensus.cc:359] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:01.462287 9435 raft_consensus.cc:385] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.462405 9435 raft_consensus.cc:740] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.462807 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 5841bc20f8134b2483b23676d66504e1 (table default.Table_f9872d0312584944b7732038b2ae68ed [id=6a65bee750c2458a8ac47914928e1b43]) successfully deleted
I20251215 14:55:01.439615 9427 ts_tablet_manager.cc:1403] T de764ce68d7e43fd8925b7f2bbc23f2a P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20251215 14:55:01.463739 9427 raft_consensus.cc:359] T de764ce68d7e43fd8925b7f2bbc23f2a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.463663 9435 consensus_queue.cc:260] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:01.463932 9427 raft_consensus.cc:385] T de764ce68d7e43fd8925b7f2bbc23f2a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.464020 9427 raft_consensus.cc:740] T de764ce68d7e43fd8925b7f2bbc23f2a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.465155 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 769b0b615f334735a21564de213453b9 (table default.Table_adf3bac6c3e142c58b7d5800645458d8 [id=2956f54f93c242ff9624fca6bf3de2e7]) successfully deleted
I20251215 14:55:01.465350 8854 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet cbf290c214374f619d5a09b12872b5c0
I20251215 14:55:01.465454 9427 consensus_queue.cc:260] T de764ce68d7e43fd8925b7f2bbc23f2a P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.466415 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet cbf290c214374f619d5a09b12872b5c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:01.467073 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet cbf290c214374f619d5a09b12872b5c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbf290c214374f619d5a09b12872b5c0 already in progress: creating tablet
I20251215 14:55:01.467377 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet cbf290c214374f619d5a09b12872b5c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.468073 9019 tablet_service.cc:1552] Processing DeleteTablet for tablet cbf290c214374f619d5a09b12872b5c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.470067 9427 ts_tablet_manager.cc:1434] T de764ce68d7e43fd8925b7f2bbc23f2a P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
W20251215 14:55:01.470619 8844 catalog_manager.cc:4952] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 769b0b615f334735a21564de213453b9 because the tablet was not found. No further retry: Not found: Tablet not found: 769b0b615f334735a21564de213453b9
I20251215 14:55:01.470679 9019 tablet_service.cc:1552] Processing DeleteTablet for tablet de764ce68d7e43fd8925b7f2bbc23f2a with delete_type TABLET_DATA_DELETED (replaced by tablet 8612ebb3fc3c4554be4b881a60ad6fd4) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:01.471153 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet e420bc0a9c384e349a66d3eb8fb915d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e420bc0a9c384e349a66d3eb8fb915d2 already in progress: creating tablet
I20251215 14:55:01.472857 9427 tablet_bootstrap.cc:492] T 769b0b615f334735a21564de213453b9 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:01.474453 9427 tablet_bootstrap.cc:654] T 769b0b615f334735a21564de213453b9 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:01.475696 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet de764ce68d7e43fd8925b7f2bbc23f2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de764ce68d7e43fd8925b7f2bbc23f2a already in progress: creating tablet
W20251215 14:55:01.476270 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 769b0b615f334735a21564de213453b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 769b0b615f334735a21564de213453b9 already in progress: creating tablet
W20251215 14:55:01.476869 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet cbf290c214374f619d5a09b12872b5c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbf290c214374f619d5a09b12872b5c0 already in progress: creating tablet
W20251215 14:55:01.477452 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet e420bc0a9c384e349a66d3eb8fb915d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e420bc0a9c384e349a66d3eb8fb915d2 already in progress: creating tablet
W20251215 14:55:01.478039 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet cbf290c214374f619d5a09b12872b5c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbf290c214374f619d5a09b12872b5c0 already in progress: creating tablet
I20251215 14:55:01.478286 9431 tablet_replica.cc:333] T de764ce68d7e43fd8925b7f2bbc23f2a P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:01.478461 9431 raft_consensus.cc:2243] T de764ce68d7e43fd8925b7f2bbc23f2a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.478487 9360 heartbeater.cc:499] Master 127.8.121.188:43131 was elected leader, sending a full tablet report...
I20251215 14:55:01.478623 9431 raft_consensus.cc:2272] T de764ce68d7e43fd8925b7f2bbc23f2a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.480813 9426 ts_tablet_manager.cc:1434] T de764ce68d7e43fd8925b7f2bbc23f2a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.047s user 0.006s sys 0.000s
I20251215 14:55:01.483333 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet de764ce68d7e43fd8925b7f2bbc23f2a with delete_type TABLET_DATA_DELETED (replaced by tablet 8612ebb3fc3c4554be4b881a60ad6fd4) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.483395 9426 tablet_bootstrap.cc:492] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:01.485178 9426 tablet_bootstrap.cc:654] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.485239 9435 ts_tablet_manager.cc:1434] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.054s user 0.015s sys 0.011s
I20251215 14:55:01.485447 9294 tablet_service.cc:1505] Processing CreateTablet for tablet 88c8499633f4417e9f6d2d6372f157c4 (DEFAULT_TABLE table=default.Table_42eef26c1ed74af99920acbaabc32301 [id=b16ae3d8bb2a40eda9602301a2a2dc2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.485462 9430 tablet_replica.cc:333] T de764ce68d7e43fd8925b7f2bbc23f2a P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:01.485826 9430 raft_consensus.cc:2243] T de764ce68d7e43fd8925b7f2bbc23f2a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.486079 9430 raft_consensus.cc:2272] T de764ce68d7e43fd8925b7f2bbc23f2a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.486603 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 88c8499633f4417e9f6d2d6372f157c4 (DEFAULT_TABLE table=default.Table_42eef26c1ed74af99920acbaabc32301 [id=b16ae3d8bb2a40eda9602301a2a2dc2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.486943 9430 ts_tablet_manager.cc:1916] T de764ce68d7e43fd8925b7f2bbc23f2a P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.486979 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c8499633f4417e9f6d2d6372f157c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.487011 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c8499633f4417e9f6d2d6372f157c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.487561 9295 tablet_service.cc:1505] Processing CreateTablet for tablet f233746b84a94c589eb96d6ef3a8281d (DEFAULT_TABLE table=default.Table_f6179b6a903946ac9b6a982c9ff87304 [id=a3674eb3a67e4505a0db527d556d5e93]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.487921 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f233746b84a94c589eb96d6ef3a8281d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.489609 9020 tablet_service.cc:1505] Processing CreateTablet for tablet 7c9141d604c34314a462b892076b7224 (DEFAULT_TABLE table=default.Table_5150978dc817409084ef9ea8c442b55a [id=82454c5953454b9199c7432010c3b3d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.489989 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9141d604c34314a462b892076b7224. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.491474 9022 tablet_service.cc:1505] Processing CreateTablet for tablet f233746b84a94c589eb96d6ef3a8281d (DEFAULT_TABLE table=default.Table_f6179b6a903946ac9b6a982c9ff87304 [id=a3674eb3a67e4505a0db527d556d5e93]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.491838 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f233746b84a94c589eb96d6ef3a8281d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.492022 9160 tablet_service.cc:1505] Processing CreateTablet for tablet 88c8499633f4417e9f6d2d6372f157c4 (DEFAULT_TABLE table=default.Table_42eef26c1ed74af99920acbaabc32301 [id=b16ae3d8bb2a40eda9602301a2a2dc2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.492529 9158 tablet_service.cc:1505] Processing CreateTablet for tablet f233746b84a94c589eb96d6ef3a8281d (DEFAULT_TABLE table=default.Table_f6179b6a903946ac9b6a982c9ff87304 [id=a3674eb3a67e4505a0db527d556d5e93]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.494567 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88c8499633f4417e9f6d2d6372f157c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.495144 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f233746b84a94c589eb96d6ef3a8281d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.495368 8854 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 8612ebb3fc3c4554be4b881a60ad6fd4 (table default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6]). Expected version 2 got 0
I20251215 14:55:01.495509 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 7c9141d604c34314a462b892076b7224 (DEFAULT_TABLE table=default.Table_5150978dc817409084ef9ea8c442b55a [id=82454c5953454b9199c7432010c3b3d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.495648 8854 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet bf500ddc89754110be1cacf9d4289090 (table default.Table_f9872d0312584944b7732038b2ae68ed [id=6a65bee750c2458a8ac47914928e1b43]). Expected version 2 got 0
I20251215 14:55:01.495952 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9141d604c34314a462b892076b7224. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.495899 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 7c9141d604c34314a462b892076b7224 (DEFAULT_TABLE table=default.Table_5150978dc817409084ef9ea8c442b55a [id=82454c5953454b9199c7432010c3b3d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.496287 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9141d604c34314a462b892076b7224. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.497702 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet e420bc0a9c384e349a66d3eb8fb915d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:01.498570 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet e420bc0a9c384e349a66d3eb8fb915d2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e420bc0a9c384e349a66d3eb8fb915d2 already in progress: creating tablet
I20251215 14:55:01.502560 8850 master_service.cc:954] ReplaceTablet: received request to replace tablet de764ce68d7e43fd8925b7f2bbc23f2a from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:01.504581 8850 master_service.cc:954] ReplaceTablet: received request to replace tablet cbf290c214374f619d5a09b12872b5c0 from {username='slave'} at 127.0.0.1:34038
W20251215 14:55:01.504566 9248 connection.cc:537] client connection to 127.8.121.190:44279 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251215 14:55:01.505337 8843 connection.cc:537] client connection to 127.8.121.190:44279 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251215 14:55:01.505373 9361 heartbeater.cc:646] Failed to heartbeat to 127.8.121.190:44279 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251215 14:55:01.505456 9286 tablet_service.cc:1552] Processing DeleteTablet for tablet cbf290c214374f619d5a09b12872b5c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:01.505546 8843 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251215 14:55:01.505255 8975 connection.cc:537] client connection to 127.8.121.190:44279 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251215 14:55:01.506104 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet cbf290c214374f619d5a09b12872b5c0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cbf290c214374f619d5a09b12872b5c0 already in progress: creating tablet
W20251215 14:55:01.506132 9088 heartbeater.cc:646] Failed to heartbeat to 127.8.121.190:44279 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251215 14:55:01.506423 9112 connection.cc:537] client connection to 127.8.121.190:44279 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251215 14:55:01.506919 9226 heartbeater.cc:646] Failed to heartbeat to 127.8.121.190:44279 (0 consecutive failures): Network error: Failed to send heartbeat to master: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251215 14:55:01.507293 9286 tablet_service.cc:1552] Processing DeleteTablet for tablet de764ce68d7e43fd8925b7f2bbc23f2a with delete_type TABLET_DATA_DELETED (replaced by tablet 8612ebb3fc3c4554be4b881a60ad6fd4) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:01.507839 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet de764ce68d7e43fd8925b7f2bbc23f2a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de764ce68d7e43fd8925b7f2bbc23f2a already in progress: creating tablet
I20251215 14:55:01.510021 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 42ee36f017f44890aa7419e642abdc9b (DEFAULT_TABLE table=default.Table_40f2cfc11d6749ea8c11ae2c03b66d4c [id=474a03e23b9c4389bb07035b37e59612]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.510432 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ee36f017f44890aa7419e642abdc9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.510921 9431 ts_tablet_manager.cc:1916] T de764ce68d7e43fd8925b7f2bbc23f2a P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.510452 9435 tablet_bootstrap.cc:492] T 769b0b615f334735a21564de213453b9 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:01.513775 9289 tablet_service.cc:1552] Processing DeleteTablet for tablet 2ff9b217e17d45b9a492902ddc54da01 with delete_type TABLET_DATA_DELETED (replaced by tablet e420bc0a9c384e349a66d3eb8fb915d2) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.514098 9432 tablet_replica.cc:333] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4: stopping tablet replica
W20251215 14:55:01.514110 9363 tablet.cc:2378] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251215 14:55:01.515323 9432 raft_consensus.cc:2243] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.515748 9432 raft_consensus.cc:2272] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.517326 9431 ts_tablet_manager.cc:1929] T de764ce68d7e43fd8925b7f2bbc23f2a P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.517426 9432 ts_tablet_manager.cc:1916] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.517539 9431 log.cc:1199] T de764ce68d7e43fd8925b7f2bbc23f2a P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/de764ce68d7e43fd8925b7f2bbc23f2a
I20251215 14:55:01.517946 9431 ts_tablet_manager.cc:1950] T de764ce68d7e43fd8925b7f2bbc23f2a P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:01.518983 9435 tablet_bootstrap.cc:654] T 769b0b615f334735a21564de213453b9 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.522161 9158 tablet_service.cc:1505] Processing CreateTablet for tablet 42ee36f017f44890aa7419e642abdc9b (DEFAULT_TABLE table=default.Table_40f2cfc11d6749ea8c11ae2c03b66d4c [id=474a03e23b9c4389bb07035b37e59612]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.523068 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 3670e4f699894059a3f09a33a744e9f9 (DEFAULT_TABLE table=default.Table_37b271542ee44db68c2370937f9daa7a [id=ebef5a7cb50445b9a84f9d458c3c7129]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.523546 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3670e4f699894059a3f09a33a744e9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.523692 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ee36f017f44890aa7419e642abdc9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.525003 9432 ts_tablet_manager.cc:1929] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.525190 9432 log.cc:1199] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/2ff9b217e17d45b9a492902ddc54da01
I20251215 14:55:01.525527 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 3670e4f699894059a3f09a33a744e9f9 (DEFAULT_TABLE table=default.Table_37b271542ee44db68c2370937f9daa7a [id=ebef5a7cb50445b9a84f9d458c3c7129]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.525674 9432 ts_tablet_manager.cc:1950] T 2ff9b217e17d45b9a492902ddc54da01 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:01.526120 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3670e4f699894059a3f09a33a744e9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.527529 9160 tablet_service.cc:1505] Processing CreateTablet for tablet a28289e1e5334512b2240c3b571d9424 (DEFAULT_TABLE table=default.Table_c5906c964a4b4bfdb59ca029909a5f70 [id=cf0e40d55af1486db1df4e85048a070b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.528007 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a28289e1e5334512b2240c3b571d9424. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.528246 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 7fc23183b3cb4330a32fca4d9a099d7a with delete_type TABLET_DATA_DELETED (replaced by tablet cbf290c214374f619d5a09b12872b5c0) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.529083 9294 tablet_service.cc:1505] Processing CreateTablet for tablet b2d65d8d32cc4ea19ddc4bbaf5291820 (DEFAULT_TABLE table=default.Table_1290357576a4475985bf0cd26aad05b1 [id=066e8ae14004436cb8b4f3f740b45b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.529292 9157 tablet_service.cc:1505] Processing CreateTablet for tablet b2d65d8d32cc4ea19ddc4bbaf5291820 (DEFAULT_TABLE table=default.Table_1290357576a4475985bf0cd26aad05b1 [id=066e8ae14004436cb8b4f3f740b45b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.529501 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2d65d8d32cc4ea19ddc4bbaf5291820. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.529608 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2d65d8d32cc4ea19ddc4bbaf5291820. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.522399 9295 tablet_service.cc:1505] Processing CreateTablet for tablet a28289e1e5334512b2240c3b571d9424 (DEFAULT_TABLE table=default.Table_c5906c964a4b4bfdb59ca029909a5f70 [id=cf0e40d55af1486db1df4e85048a070b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.531445 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a28289e1e5334512b2240c3b571d9424. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.537640 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 769b0b615f334735a21564de213453b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.538528 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 5841bc20f8134b2483b23676d66504e1 with delete_type TABLET_DATA_DELETED (replaced by tablet bf500ddc89754110be1cacf9d4289090) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.542616 9020 tablet_service.cc:1505] Processing CreateTablet for tablet 42ee36f017f44890aa7419e642abdc9b (DEFAULT_TABLE table=default.Table_40f2cfc11d6749ea8c11ae2c03b66d4c [id=474a03e23b9c4389bb07035b37e59612]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.543093 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42ee36f017f44890aa7419e642abdc9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.543344 9021 tablet_service.cc:1505] Processing CreateTablet for tablet b2d65d8d32cc4ea19ddc4bbaf5291820 (DEFAULT_TABLE table=default.Table_1290357576a4475985bf0cd26aad05b1 [id=066e8ae14004436cb8b4f3f740b45b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.543745 9021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2d65d8d32cc4ea19ddc4bbaf5291820. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.543722 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet de764ce68d7e43fd8925b7f2bbc23f2a (table default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6]) successfully deleted
I20251215 14:55:01.545177 9018 tablet_service.cc:1505] Processing CreateTablet for tablet f2aae2798eee4775afaa3afc59e98a6c (DEFAULT_TABLE table=default.Table_07c61e3442a245ed8d12bba7ca7b540d [id=1354e65a875745e9a1d979f3936bf342]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.545509 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2aae2798eee4775afaa3afc59e98a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.547483 9022 tablet_service.cc:1505] Processing CreateTablet for tablet a28289e1e5334512b2240c3b571d9424 (DEFAULT_TABLE table=default.Table_c5906c964a4b4bfdb59ca029909a5f70 [id=cf0e40d55af1486db1df4e85048a070b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.547832 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a28289e1e5334512b2240c3b571d9424. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:01.549433 8843 consensus_peers.cc:597] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e -> Peer cad1fca07ac7419cb608c21541f672f3 (127.8.121.190:44279): Couldn't send request to peer cad1fca07ac7419cb608c21541f672f3. Status: Network error: Client connection negotiation failed: client connection to 127.8.121.190:44279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:01.550592 9294 tablet_service.cc:1505] Processing CreateTablet for tablet f2aae2798eee4775afaa3afc59e98a6c (DEFAULT_TABLE table=default.Table_07c61e3442a245ed8d12bba7ca7b540d [id=1354e65a875745e9a1d979f3936bf342]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.550948 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2aae2798eee4775afaa3afc59e98a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.551090 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 3670e4f699894059a3f09a33a744e9f9 (DEFAULT_TABLE table=default.Table_37b271542ee44db68c2370937f9daa7a [id=ebef5a7cb50445b9a84f9d458c3c7129]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.552246 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3670e4f699894059a3f09a33a744e9f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.556524 9157 tablet_service.cc:1505] Processing CreateTablet for tablet f2aae2798eee4775afaa3afc59e98a6c (DEFAULT_TABLE table=default.Table_07c61e3442a245ed8d12bba7ca7b540d [id=1354e65a875745e9a1d979f3936bf342]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.559340 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2aae2798eee4775afaa3afc59e98a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.564219 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 2ff9b217e17d45b9a492902ddc54da01 (table default.Table_6326587168434469983b7215bb514379 [id=b77dd33e03384d6dadf621ad29c6d9e2]) successfully deleted
W20251215 14:55:01.564468 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 7fc23183b3cb4330a32fca4d9a099d7a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fc23183b3cb4330a32fca4d9a099d7a already in progress: creating tablet
W20251215 14:55:01.564674 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 769b0b615f334735a21564de213453b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 769b0b615f334735a21564de213453b9 already in progress: creating tablet
W20251215 14:55:01.564877 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 5841bc20f8134b2483b23676d66504e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5841bc20f8134b2483b23676d66504e1 already in progress: creating tablet
I20251215 14:55:01.565057 8854 master_service.cc:954] ReplaceTablet: received request to replace tablet e420bc0a9c384e349a66d3eb8fb915d2 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:01.569006 8850 master_service.cc:954] ReplaceTablet: received request to replace tablet cbf290c214374f619d5a09b12872b5c0 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:01.569006 8854 master_service.cc:954] ReplaceTablet: received request to replace tablet 7fc23183b3cb4330a32fca4d9a099d7a from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:01.571296 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_08c8c65e626a4446878f527008df67ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.571959 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08c8c65e626a4446878f527008df67ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.581284 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_909f6c88c1f44f73915c5eef5288abbb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.581993 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_909f6c88c1f44f73915c5eef5288abbb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.583873 8854 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_3995dad6a76c42daaaf9552d1ed28c0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.584515 8854 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3995dad6a76c42daaaf9552d1ed28c0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.586539 9435 tablet_bootstrap.cc:492] T 769b0b615f334735a21564de213453b9 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:01.586699 9435 ts_tablet_manager.cc:1403] T 769b0b615f334735a21564de213453b9 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.076s user 0.019s sys 0.022s
I20251215 14:55:01.587509 9426 tablet_bootstrap.cc:492] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:01.587502 9435 raft_consensus.cc:359] T 769b0b615f334735a21564de213453b9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.587672 9435 raft_consensus.cc:385] T 769b0b615f334735a21564de213453b9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.587688 9426 ts_tablet_manager.cc:1403] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.104s user 0.004s sys 0.003s
I20251215 14:55:01.587750 9435 raft_consensus.cc:740] T 769b0b615f334735a21564de213453b9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.587993 9435 consensus_queue.cc:260] T 769b0b615f334735a21564de213453b9 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.588399 9426 raft_consensus.cc:359] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.588580 9426 raft_consensus.cc:385] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.588658 9426 raft_consensus.cc:740] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.588927 9426 consensus_queue.cc:260] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.589385 9426 ts_tablet_manager.cc:1434] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:01.590859 9435 ts_tablet_manager.cc:1434] T 769b0b615f334735a21564de213453b9 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:01.591717 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 769b0b615f334735a21564de213453b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.591969 9432 tablet_replica.cc:333] T 769b0b615f334735a21564de213453b9 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:01.592139 9432 raft_consensus.cc:2243] T 769b0b615f334735a21564de213453b9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.592296 9432 raft_consensus.cc:2272] T 769b0b615f334735a21564de213453b9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.592780 9432 ts_tablet_manager.cc:1916] T 769b0b615f334735a21564de213453b9 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.594509 9294 tablet_service.cc:1505] Processing CreateTablet for tablet 26648bf286c94b2495e565969f945858 (DEFAULT_TABLE table=default.Table_08c8c65e626a4446878f527008df67ec [id=d8e445192eeb4f489a4a47422aa5150e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.594923 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26648bf286c94b2495e565969f945858. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.597765 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 26648bf286c94b2495e565969f945858 (DEFAULT_TABLE table=default.Table_08c8c65e626a4446878f527008df67ec [id=d8e445192eeb4f489a4a47422aa5150e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.597905 8855 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_4c9e2fc042e34c5d8ebaf68a00cd786a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:01.598165 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26648bf286c94b2495e565969f945858. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:01.598461 8855 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c9e2fc042e34c5d8ebaf68a00cd786a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.598620 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 26648bf286c94b2495e565969f945858 (DEFAULT_TABLE table=default.Table_08c8c65e626a4446878f527008df67ec [id=d8e445192eeb4f489a4a47422aa5150e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.598628 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_0d20baf8af894f4ba3e1f1bbf5a6794e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.599116 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d20baf8af894f4ba3e1f1bbf5a6794e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.600179 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26648bf286c94b2495e565969f945858. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.603606 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_4e8289ad9bc747669339100d67364d2e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.604043 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e8289ad9bc747669339100d67364d2e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.604974 8851 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_91cf85ed6e3a4949b666ed705a86a668"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.605446 8851 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91cf85ed6e3a4949b666ed705a86a668 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.608311 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 7fc23183b3cb4330a32fca4d9a099d7a with delete_type TABLET_DATA_DELETED (replaced by tablet cbf290c214374f619d5a09b12872b5c0) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.609977 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 4a6846144c8c409cad340e99374a38c6 (DEFAULT_TABLE table=default.Table_909f6c88c1f44f73915c5eef5288abbb [id=f47f7fac75974e199fd5424ac86f5fec]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.611502 9435 tablet_bootstrap.cc:492] T cbf290c214374f619d5a09b12872b5c0 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:01.612013 9294 tablet_service.cc:1505] Processing CreateTablet for tablet 4a6846144c8c409cad340e99374a38c6 (DEFAULT_TABLE table=default.Table_909f6c88c1f44f73915c5eef5288abbb [id=f47f7fac75974e199fd5424ac86f5fec]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.612432 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6846144c8c409cad340e99374a38c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.615592 9426 tablet_bootstrap.cc:492] T 2ff9b217e17d45b9a492902ddc54da01 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:01.616588 9440 raft_consensus.cc:493] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:01.616832 9440 raft_consensus.cc:515] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.618587 9435 tablet_bootstrap.cc:654] T cbf290c214374f619d5a09b12872b5c0 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.618862 9440 leader_election.cc:290] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:01.620002 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_a187bfa88e3c4a74832da7f82a6b8753"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.620543 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a187bfa88e3c4a74832da7f82a6b8753 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.623692 9435 tablet_bootstrap.cc:492] T cbf290c214374f619d5a09b12872b5c0 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:01.623852 9435 ts_tablet_manager.cc:1403] T cbf290c214374f619d5a09b12872b5c0 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.004s
I20251215 14:55:01.623876 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6846144c8c409cad340e99374a38c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.624758 9435 raft_consensus.cc:359] T cbf290c214374f619d5a09b12872b5c0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.624959 9435 raft_consensus.cc:385] T cbf290c214374f619d5a09b12872b5c0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.625028 9435 raft_consensus.cc:740] T cbf290c214374f619d5a09b12872b5c0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.625257 9435 consensus_queue.cc:260] T cbf290c214374f619d5a09b12872b5c0 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.625375 8851 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_70286f4449f742a9add22ff1a08e3d6e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.625838 8851 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70286f4449f742a9add22ff1a08e3d6e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.628418 9435 ts_tablet_manager.cc:1434] T cbf290c214374f619d5a09b12872b5c0 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20251215 14:55:01.629828 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7fc23183b3cb4330a32fca4d9a099d7a" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
W20251215 14:55:01.632169 9115 leader_election.cc:343] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:01.632364 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet cbf290c214374f619d5a09b12872b5c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.632882 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 4816503e4fa1459dbb311997be85f64a (DEFAULT_TABLE table=default.Table_4c9e2fc042e34c5d8ebaf68a00cd786a [id=5209bd8f71994c1092418b41d8c905db]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.633251 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4816503e4fa1459dbb311997be85f64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.633453 9157 tablet_service.cc:1505] Processing CreateTablet for tablet 4816503e4fa1459dbb311997be85f64a (DEFAULT_TABLE table=default.Table_4c9e2fc042e34c5d8ebaf68a00cd786a [id=5209bd8f71994c1092418b41d8c905db]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.633704 9022 tablet_service.cc:1505] Processing CreateTablet for tablet c276eb6ad0414bb8ae5d553ae623edac (DEFAULT_TABLE table=default.Table_3995dad6a76c42daaaf9552d1ed28c0a [id=7ec65d77d89d4e40a60b716f721e2940]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.633800 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4816503e4fa1459dbb311997be85f64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.634095 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c276eb6ad0414bb8ae5d553ae623edac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.635205 9158 tablet_service.cc:1505] Processing CreateTablet for tablet c276eb6ad0414bb8ae5d553ae623edac (DEFAULT_TABLE table=default.Table_3995dad6a76c42daaaf9552d1ed28c0a [id=7ec65d77d89d4e40a60b716f721e2940]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.635515 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c276eb6ad0414bb8ae5d553ae623edac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.636493 9289 tablet_service.cc:1505] Processing CreateTablet for tablet c276eb6ad0414bb8ae5d553ae623edac (DEFAULT_TABLE table=default.Table_3995dad6a76c42daaaf9552d1ed28c0a [id=7ec65d77d89d4e40a60b716f721e2940]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.636837 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c276eb6ad0414bb8ae5d553ae623edac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.637678 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_4b71028e234041d880d77f141a8ff7d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.638190 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b71028e234041d880d77f141a8ff7d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.639293 8857 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_909f6c88c1f44f73915c5eef5288abbb" } modify_external_catalogs: true
I20251215 14:55:01.639477 8857 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_909f6c88c1f44f73915c5eef5288abbb" } modify_external_catalogs: true
I20251215 14:55:01.644042 8851 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_70286f4449f742a9add22ff1a08e3d6e" } new_table_name: "default.Table_1eea41fb41014a0e88ffd907fa069d19" modify_external_catalogs: true
I20251215 14:55:01.646955 9435 tablet_bootstrap.cc:492] T e420bc0a9c384e349a66d3eb8fb915d2 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:01.647423 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 4816503e4fa1459dbb311997be85f64a (DEFAULT_TABLE table=default.Table_4c9e2fc042e34c5d8ebaf68a00cd786a [id=5209bd8f71994c1092418b41d8c905db]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.648567 9426 tablet_bootstrap.cc:654] T 2ff9b217e17d45b9a492902ddc54da01 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.649500 8854 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_f9872d0312584944b7732038b2ae68ed" } modify_external_catalogs: true
I20251215 14:55:01.649681 8854 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_f9872d0312584944b7732038b2ae68ed" } modify_external_catalogs: true
I20251215 14:55:01.650826 9435 tablet_bootstrap.cc:654] T e420bc0a9c384e349a66d3eb8fb915d2 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.652628 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4816503e4fa1459dbb311997be85f64a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.654160 8850 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_0d20baf8af894f4ba3e1f1bbf5a6794e" } modify_external_catalogs: true
I20251215 14:55:01.654394 8850 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_0d20baf8af894f4ba3e1f1bbf5a6794e" } modify_external_catalogs: true
I20251215 14:55:01.655017 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7fc23183b3cb4330a32fca4d9a099d7a" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:01.655894 9112 leader_election.cc:343] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:01.656752 9426 tablet_bootstrap.cc:492] T 2ff9b217e17d45b9a492902ddc54da01 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:01.656898 9426 ts_tablet_manager.cc:1403] T 2ff9b217e17d45b9a492902ddc54da01 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.000s
I20251215 14:55:01.657999 8858 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_07c61e3442a245ed8d12bba7ca7b540d" } modify_external_catalogs: true
I20251215 14:55:01.658202 8858 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_07c61e3442a245ed8d12bba7ca7b540d" } modify_external_catalogs: true
I20251215 14:55:01.658442 8855 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_3995dad6a76c42daaaf9552d1ed28c0a" } new_table_name: "default.Table_19cbfafb518e496d9a83c66ea3f027f8" modify_external_catalogs: true
I20251215 14:55:01.658771 8853 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_a187bfa88e3c4a74832da7f82a6b8753" } new_table_name: "default.Table_390be178b42a4c78ba4a85ca90d2a4cd" modify_external_catalogs: true
I20251215 14:55:01.659699 8852 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_42eef26c1ed74af99920acbaabc32301" } new_table_name: "default.Table_74b3f3255fd84cc99612cdb3dfe5b88d" modify_external_catalogs: true
I20251215 14:55:01.659806 8859 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_91cf85ed6e3a4949b666ed705a86a668" } new_table_name: "default.Table_f466f52dcdb54303893bb61ccaaf1c31" modify_external_catalogs: true
I20251215 14:55:01.656152 9112 leader_election.cc:304] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:01.661721 9440 raft_consensus.cc:2749] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:01.662881 9435 tablet_bootstrap.cc:492] T e420bc0a9c384e349a66d3eb8fb915d2 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:01.663043 9435 ts_tablet_manager.cc:1403] T e420bc0a9c384e349a66d3eb8fb915d2 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20251215 14:55:01.663491 9157 tablet_service.cc:1505] Processing CreateTablet for tablet c0d0022e48f04b83ac1c998a83fe3f55 (DEFAULT_TABLE table=default.Table_4e8289ad9bc747669339100d67364d2e [id=c421ca23de494f4ba674e4cc86bac3da]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.663914 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0d0022e48f04b83ac1c998a83fe3f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.663844 9435 raft_consensus.cc:359] T e420bc0a9c384e349a66d3eb8fb915d2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.664034 9435 raft_consensus.cc:385] T e420bc0a9c384e349a66d3eb8fb915d2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.664124 9435 raft_consensus.cc:740] T e420bc0a9c384e349a66d3eb8fb915d2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.664340 9435 consensus_queue.cc:260] T e420bc0a9c384e349a66d3eb8fb915d2 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.664639 9289 tablet_service.cc:1505] Processing CreateTablet for tablet c0d0022e48f04b83ac1c998a83fe3f55 (DEFAULT_TABLE table=default.Table_4e8289ad9bc747669339100d67364d2e [id=c421ca23de494f4ba674e4cc86bac3da]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.665143 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0d0022e48f04b83ac1c998a83fe3f55. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:01.665303 8851 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 11a5a6a0895c49648c910fa2ea3ca373 has no consensus state
I20251215 14:55:01.667469 9435 ts_tablet_manager.cc:1434] T e420bc0a9c384e349a66d3eb8fb915d2 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:01.657753 9426 raft_consensus.cc:359] T 2ff9b217e17d45b9a492902ddc54da01 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:01.667858 9426 raft_consensus.cc:385] T 2ff9b217e17d45b9a492902ddc54da01 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.668004 9426 raft_consensus.cc:740] T 2ff9b217e17d45b9a492902ddc54da01 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.668294 9426 consensus_queue.cc:260] T 2ff9b217e17d45b9a492902ddc54da01 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:01.668501 9019 tablet_service.cc:1505] Processing CreateTablet for tablet c0d0022e48f04b83ac1c998a83fe3f55 (DEFAULT_TABLE table=default.Table_4e8289ad9bc747669339100d67364d2e [id=c421ca23de494f4ba674e4cc86bac3da]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.668884 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0d0022e48f04b83ac1c998a83fe3f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.669251 8851 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_4b71028e234041d880d77f141a8ff7d9" } modify_external_catalogs: true
I20251215 14:55:01.669440 8851 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_4b71028e234041d880d77f141a8ff7d9" } modify_external_catalogs: true
I20251215 14:55:01.672755 9426 ts_tablet_manager.cc:1434] T 2ff9b217e17d45b9a492902ddc54da01 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20251215 14:55:01.673008 9432 ts_tablet_manager.cc:1929] T 769b0b615f334735a21564de213453b9 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.673161 9432 log.cc:1199] T 769b0b615f334735a21564de213453b9 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/769b0b615f334735a21564de213453b9
I20251215 14:55:01.673571 9432 ts_tablet_manager.cc:1950] T 769b0b615f334735a21564de213453b9 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:01.674319 9435 tablet_bootstrap.cc:492] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:01.656132 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 4a6846144c8c409cad340e99374a38c6 (DEFAULT_TABLE table=default.Table_909f6c88c1f44f73915c5eef5288abbb [id=f47f7fac75974e199fd5424ac86f5fec]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.674686 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 769b0b615f334735a21564de213453b9 (table default.Table_adf3bac6c3e142c58b7d5800645458d8 [id=2956f54f93c242ff9624fca6bf3de2e7]) successfully deleted
I20251215 14:55:01.674827 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6846144c8c409cad340e99374a38c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.675285 9426 tablet_bootstrap.cc:492] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:01.675597 9289 tablet_service.cc:1552] Processing DeleteTablet for tablet e420bc0a9c384e349a66d3eb8fb915d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.676898 9022 tablet_service.cc:1505] Processing CreateTablet for tablet 018bd6ac8a534a6abc461b57b89b93eb (DEFAULT_TABLE table=default.Table_91cf85ed6e3a4949b666ed705a86a668 [id=b572c0e839954dba935a12d258d49f07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.676429 9158 tablet_service.cc:1552] Processing DeleteTablet for tablet 2ff9b217e17d45b9a492902ddc54da01 with delete_type TABLET_DATA_DELETED (replaced by tablet e420bc0a9c384e349a66d3eb8fb915d2) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.677346 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018bd6ac8a534a6abc461b57b89b93eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.679729 9430 ts_tablet_manager.cc:1929] T de764ce68d7e43fd8925b7f2bbc23f2a P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.679880 9430 log.cc:1199] T de764ce68d7e43fd8925b7f2bbc23f2a P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/de764ce68d7e43fd8925b7f2bbc23f2a
I20251215 14:55:01.680840 9430 ts_tablet_manager.cc:1950] T de764ce68d7e43fd8925b7f2bbc23f2a P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:01.682041 9435 tablet_bootstrap.cc:654] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:01.682694 8853 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4f1f902cbcb643b9b98fa3d72babba79 has no consensus state
W20251215 14:55:01.682767 8855 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c276eb6ad0414bb8ae5d553ae623edac consensus state has no leader
I20251215 14:55:01.674460 9432 tablet_replica.cc:333] T cbf290c214374f619d5a09b12872b5c0 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:01.689415 9432 raft_consensus.cc:2243] T cbf290c214374f619d5a09b12872b5c0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.689678 9432 raft_consensus.cc:2272] T cbf290c214374f619d5a09b12872b5c0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.690600 9295 tablet_service.cc:1505] Processing CreateTablet for tablet cb2f4fc179744458bc7db2f6c7197ec5 (DEFAULT_TABLE table=default.Table_0d20baf8af894f4ba3e1f1bbf5a6794e [id=0cf293c23224428ea3867189106fc0e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.691041 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2f4fc179744458bc7db2f6c7197ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.683809 9426 tablet_bootstrap.cc:654] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.684809 9158 tablet_service.cc:1505] Processing CreateTablet for tablet 018bd6ac8a534a6abc461b57b89b93eb (DEFAULT_TABLE table=default.Table_91cf85ed6e3a4949b666ed705a86a668 [id=b572c0e839954dba935a12d258d49f07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.691527 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018bd6ac8a534a6abc461b57b89b93eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.694258 8857 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 4a6846144c8c409cad340e99374a38c6
W20251215 14:55:01.694700 8859 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 018bd6ac8a534a6abc461b57b89b93eb consensus state has no leader
W20251215 14:55:01.695077 8852 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 88c8499633f4417e9f6d2d6372f157c4 consensus state has no leader
I20251215 14:55:01.695459 8854 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet bf500ddc89754110be1cacf9d4289090
I20251215 14:55:01.696063 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet 4a6846144c8c409cad340e99374a38c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.696135 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 4a6846144c8c409cad340e99374a38c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.696657 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet bf500ddc89754110be1cacf9d4289090 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.696759 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet bf500ddc89754110be1cacf9d4289090 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.697402 8858 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet f2aae2798eee4775afaa3afc59e98a6c
I20251215 14:55:01.698724 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet f2aae2798eee4775afaa3afc59e98a6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.699379 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet f2aae2798eee4775afaa3afc59e98a6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.700901 8851 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 717907ba9caf4482b79328f9fd3eea86
I20251215 14:55:01.700963 8850 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet cb2f4fc179744458bc7db2f6c7197ec5
I20251215 14:55:01.701586 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 018bd6ac8a534a6abc461b57b89b93eb (DEFAULT_TABLE table=default.Table_91cf85ed6e3a4949b666ed705a86a668 [id=b572c0e839954dba935a12d258d49f07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.702090 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018bd6ac8a534a6abc461b57b89b93eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.702255 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet cb2f4fc179744458bc7db2f6c7197ec5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.703135 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet cb2f4fc179744458bc7db2f6c7197ec5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.703965 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet de764ce68d7e43fd8925b7f2bbc23f2a (table default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6]) successfully deleted
I20251215 14:55:01.704310 9430 tablet_replica.cc:333] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:01.704470 9430 raft_consensus.cc:2243] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.704643 9430 raft_consensus.cc:2272] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.705310 9430 ts_tablet_manager.cc:1916] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.706322 9432 ts_tablet_manager.cc:1916] T cbf290c214374f619d5a09b12872b5c0 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.707425 9020 tablet_service.cc:1552] Processing DeleteTablet for tablet 4a6846144c8c409cad340e99374a38c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.707643 9021 tablet_service.cc:1552] Processing DeleteTablet for tablet bf500ddc89754110be1cacf9d4289090 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:01.709165 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 4a6846144c8c409cad340e99374a38c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a6846144c8c409cad340e99374a38c6 already in progress: creating tablet
W20251215 14:55:01.709412 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet bf500ddc89754110be1cacf9d4289090 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf500ddc89754110be1cacf9d4289090 already in progress: creating tablet
I20251215 14:55:01.709599 9021 tablet_service.cc:1552] Processing DeleteTablet for tablet f2aae2798eee4775afaa3afc59e98a6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.709910 9020 tablet_service.cc:1552] Processing DeleteTablet for tablet cb2f4fc179744458bc7db2f6c7197ec5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.710026 9159 tablet_service.cc:1505] Processing CreateTablet for tablet cb2f4fc179744458bc7db2f6c7197ec5 (DEFAULT_TABLE table=default.Table_0d20baf8af894f4ba3e1f1bbf5a6794e [id=0cf293c23224428ea3867189106fc0e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.710160 8850 master_service.cc:954] ReplaceTablet: received request to replace tablet cbf290c214374f619d5a09b12872b5c0 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:01.710381 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2f4fc179744458bc7db2f6c7197ec5. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:01.710610 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet f2aae2798eee4775afaa3afc59e98a6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2aae2798eee4775afaa3afc59e98a6c already in progress: creating tablet
W20251215 14:55:01.710843 8843 catalog_manager.cc:4952] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet cb2f4fc179744458bc7db2f6c7197ec5 because the tablet was not found. No further retry: Not found: Tablet not found: cb2f4fc179744458bc7db2f6c7197ec5
I20251215 14:55:01.712658 9018 tablet_service.cc:1505] Processing CreateTablet for tablet cb2f4fc179744458bc7db2f6c7197ec5 (DEFAULT_TABLE table=default.Table_0d20baf8af894f4ba3e1f1bbf5a6794e [id=0cf293c23224428ea3867189106fc0e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.713001 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2f4fc179744458bc7db2f6c7197ec5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.719350 9432 ts_tablet_manager.cc:1929] T cbf290c214374f619d5a09b12872b5c0 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.719462 9432 log.cc:1199] T cbf290c214374f619d5a09b12872b5c0 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/cbf290c214374f619d5a09b12872b5c0
I20251215 14:55:01.719637 9430 ts_tablet_manager.cc:1929] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.719745 9432 ts_tablet_manager.cc:1950] T cbf290c214374f619d5a09b12872b5c0 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:01.719791 9430 log.cc:1199] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/7fc23183b3cb4330a32fca4d9a099d7a
I20251215 14:55:01.720170 9430 ts_tablet_manager.cc:1950] T 7fc23183b3cb4330a32fca4d9a099d7a P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:01.720582 9432 tablet_replica.cc:333] T e420bc0a9c384e349a66d3eb8fb915d2 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:01.720722 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet cbf290c214374f619d5a09b12872b5c0 (table default.Table_4437875587ce4e46a16cd8154d6ccc6b [id=beb4a6485efb47f889e1e3ae24167c9a]) successfully deleted
I20251215 14:55:01.720754 9432 raft_consensus.cc:2243] T e420bc0a9c384e349a66d3eb8fb915d2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.720912 9432 raft_consensus.cc:2272] T e420bc0a9c384e349a66d3eb8fb915d2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.721017 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 7fc23183b3cb4330a32fca4d9a099d7a (table default.Table_4437875587ce4e46a16cd8154d6ccc6b [id=beb4a6485efb47f889e1e3ae24167c9a]) successfully deleted
I20251215 14:55:01.721107 9427 tablet_bootstrap.cc:492] T 769b0b615f334735a21564de213453b9 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:01.721274 9427 ts_tablet_manager.cc:1403] T 769b0b615f334735a21564de213453b9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.248s user 0.014s sys 0.014s
I20251215 14:55:01.721653 9426 tablet_bootstrap.cc:492] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:01.721813 9426 ts_tablet_manager.cc:1403] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.047s user 0.003s sys 0.000s
I20251215 14:55:01.721936 9435 tablet_bootstrap.cc:492] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:01.721997 9427 raft_consensus.cc:359] T 769b0b615f334735a21564de213453b9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.722113 9435 ts_tablet_manager.cc:1403] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.001s
I20251215 14:55:01.722205 9427 raft_consensus.cc:385] T 769b0b615f334735a21564de213453b9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.722496 9426 raft_consensus.cc:359] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.722612 9427 raft_consensus.cc:740] T 769b0b615f334735a21564de213453b9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.722681 9426 raft_consensus.cc:385] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.722757 9426 raft_consensus.cc:740] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.722862 9427 consensus_queue.cc:260] T 769b0b615f334735a21564de213453b9 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.723003 9426 consensus_queue.cc:260] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.724050 9427 ts_tablet_manager.cc:1434] T 769b0b615f334735a21564de213453b9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:01.724359 9427 tablet_bootstrap.cc:492] T 7fc23183b3cb4330a32fca4d9a099d7a P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:01.725925 9427 tablet_bootstrap.cc:654] T 7fc23183b3cb4330a32fca4d9a099d7a P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.727849 9435 raft_consensus.cc:359] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.728118 9435 raft_consensus.cc:385] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.728245 9435 raft_consensus.cc:740] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.728511 9157 tablet_service.cc:1552] Processing DeleteTablet for tablet 5841bc20f8134b2483b23676d66504e1 with delete_type TABLET_DATA_DELETED (replaced by tablet bf500ddc89754110be1cacf9d4289090) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.728538 9435 consensus_queue.cc:260] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.728919 9426 ts_tablet_manager.cc:1434] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20251215 14:55:01.731945 9435 ts_tablet_manager.cc:1434] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20251215 14:55:01.732621 8850 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 8612ebb3fc3c4554be4b881a60ad6fd4 (table default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6]). Expected version 2 got 0
I20251215 14:55:01.733793 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 11a5a6a0895c49648c910fa2ea3ca373 (DEFAULT_TABLE table=default.Table_1eea41fb41014a0e88ffd907fa069d19 [id=143242e2febc41f7bc9ba1ed9f832886]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.734553 9160 tablet_service.cc:1505] Processing CreateTablet for tablet 4f1f902cbcb643b9b98fa3d72babba79 (DEFAULT_TABLE table=default.Table_390be178b42a4c78ba4a85ca90d2a4cd [id=3790e26b5fe04d74bcade32a6101fdf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.734957 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f1f902cbcb643b9b98fa3d72babba79. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.735458 9020 tablet_service.cc:1505] Processing CreateTablet for tablet 4f1f902cbcb643b9b98fa3d72babba79 (DEFAULT_TABLE table=default.Table_390be178b42a4c78ba4a85ca90d2a4cd [id=3790e26b5fe04d74bcade32a6101fdf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.735829 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f1f902cbcb643b9b98fa3d72babba79. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.736858 9432 ts_tablet_manager.cc:1916] T e420bc0a9c384e349a66d3eb8fb915d2 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.740832 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 4f1f902cbcb643b9b98fa3d72babba79 (DEFAULT_TABLE table=default.Table_390be178b42a4c78ba4a85ca90d2a4cd [id=3790e26b5fe04d74bcade32a6101fdf9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.741425 9157 tablet_service.cc:1505] Processing CreateTablet for tablet 11a5a6a0895c49648c910fa2ea3ca373 (DEFAULT_TABLE table=default.Table_1eea41fb41014a0e88ffd907fa069d19 [id=143242e2febc41f7bc9ba1ed9f832886]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.741817 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a5a6a0895c49648c910fa2ea3ca373. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.743444 9022 tablet_service.cc:1505] Processing CreateTablet for tablet 11a5a6a0895c49648c910fa2ea3ca373 (DEFAULT_TABLE table=default.Table_1eea41fb41014a0e88ffd907fa069d19 [id=143242e2febc41f7bc9ba1ed9f832886]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.743968 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a5a6a0895c49648c910fa2ea3ca373. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.744185 9432 ts_tablet_manager.cc:1929] T e420bc0a9c384e349a66d3eb8fb915d2 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.744351 9432 log.cc:1199] T e420bc0a9c384e349a66d3eb8fb915d2 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/e420bc0a9c384e349a66d3eb8fb915d2
I20251215 14:55:01.744699 9432 ts_tablet_manager.cc:1950] T e420bc0a9c384e349a66d3eb8fb915d2 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:01.746745 8850 master_service.cc:954] ReplaceTablet: received request to replace tablet c0d0022e48f04b83ac1c998a83fe3f55 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:01.751523 9426 tablet_bootstrap.cc:492] T bf500ddc89754110be1cacf9d4289090 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:01.753662 9426 tablet_bootstrap.cc:654] T bf500ddc89754110be1cacf9d4289090 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.753782 8850 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet c0d0022e48f04b83ac1c998a83fe3f55
I20251215 14:55:01.754678 8850 catalog_manager.cc:6724] ReplaceTablet: tablet c0d0022e48f04b83ac1c998a83fe3f55 deleted and replaced by tablet 429c0b2d7cb2428c8de6b02acde36044
I20251215 14:55:01.754561 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet c0d0022e48f04b83ac1c998a83fe3f55 with delete_type TABLET_DATA_DELETED (replaced by tablet 429c0b2d7cb2428c8de6b02acde36044) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.755275 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet c0d0022e48f04b83ac1c998a83fe3f55 with delete_type TABLET_DATA_DELETED (replaced by tablet 429c0b2d7cb2428c8de6b02acde36044) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.755679 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet c0d0022e48f04b83ac1c998a83fe3f55 with delete_type TABLET_DATA_DELETED (replaced by tablet 429c0b2d7cb2428c8de6b02acde36044) from {username='slave'} at 127.0.0.1:54874
W20251215 14:55:01.755949 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet c0d0022e48f04b83ac1c998a83fe3f55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0d0022e48f04b83ac1c998a83fe3f55 already in progress: creating tablet
I20251215 14:55:01.758101 9435 tablet_bootstrap.cc:492] T 5841bc20f8134b2483b23676d66504e1 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:01.758448 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11a5a6a0895c49648c910fa2ea3ca373. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.760373 9435 tablet_bootstrap.cc:654] T 5841bc20f8134b2483b23676d66504e1 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.765413 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f1f902cbcb643b9b98fa3d72babba79. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.765736 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet 769b0b615f334735a21564de213453b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.766090 9431 tablet_replica.cc:333] T 769b0b615f334735a21564de213453b9 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:01.766291 9431 raft_consensus.cc:2243] T 769b0b615f334735a21564de213453b9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.766500 9431 raft_consensus.cc:2272] T 769b0b615f334735a21564de213453b9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.767228 9431 ts_tablet_manager.cc:1916] T 769b0b615f334735a21564de213453b9 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.772334 8851 master_service.cc:954] ReplaceTablet: received request to replace tablet 4816503e4fa1459dbb311997be85f64a from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:01.772647 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet e420bc0a9c384e349a66d3eb8fb915d2 (table default.Table_6326587168434469983b7215bb514379 [id=b77dd33e03384d6dadf621ad29c6d9e2]) successfully deleted
W20251215 14:55:01.772951 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 4a6846144c8c409cad340e99374a38c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a6846144c8c409cad340e99374a38c6 already in progress: creating tablet
I20251215 14:55:01.773245 9022 tablet_service.cc:1505] Processing CreateTablet for tablet 429c0b2d7cb2428c8de6b02acde36044 (DEFAULT_TABLE table=default.Table_4e8289ad9bc747669339100d67364d2e [id=c421ca23de494f4ba674e4cc86bac3da]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.773646 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 429c0b2d7cb2428c8de6b02acde36044. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.774485 8850 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 8612ebb3fc3c4554be4b881a60ad6fd4 (table default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6]). Expected version 2 got 0
W20251215 14:55:01.774900 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet bf500ddc89754110be1cacf9d4289090 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bf500ddc89754110be1cacf9d4289090 already in progress: creating tablet
W20251215 14:55:01.775827 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet f2aae2798eee4775afaa3afc59e98a6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2aae2798eee4775afaa3afc59e98a6c already in progress: creating tablet
I20251215 14:55:01.777086 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 429c0b2d7cb2428c8de6b02acde36044 (DEFAULT_TABLE table=default.Table_4e8289ad9bc747669339100d67364d2e [id=c421ca23de494f4ba674e4cc86bac3da]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.777874 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 429c0b2d7cb2428c8de6b02acde36044. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.779098 8850 master_service.cc:954] ReplaceTablet: received request to replace tablet 4816503e4fa1459dbb311997be85f64a from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:01.779639 9160 tablet_service.cc:1505] Processing CreateTablet for tablet 429c0b2d7cb2428c8de6b02acde36044 (DEFAULT_TABLE table=default.Table_4e8289ad9bc747669339100d67364d2e [id=c421ca23de494f4ba674e4cc86bac3da]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.780129 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 429c0b2d7cb2428c8de6b02acde36044. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.782168 8851 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 4816503e4fa1459dbb311997be85f64a
W20251215 14:55:01.782584 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet cb2f4fc179744458bc7db2f6c7197ec5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb2f4fc179744458bc7db2f6c7197ec5 already in progress: creating tablet
I20251215 14:55:01.782924 8851 catalog_manager.cc:6724] ReplaceTablet: tablet 4816503e4fa1459dbb311997be85f64a deleted and replaced by tablet 80d4c9b533ac4facb4205aff84903134
I20251215 14:55:01.783413 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet 4816503e4fa1459dbb311997be85f64a with delete_type TABLET_DATA_DELETED (replaced by tablet 80d4c9b533ac4facb4205aff84903134) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.783993 9158 tablet_service.cc:1552] Processing DeleteTablet for tablet 4816503e4fa1459dbb311997be85f64a with delete_type TABLET_DATA_DELETED (replaced by tablet 80d4c9b533ac4facb4205aff84903134) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.785992 8851 master_service.cc:954] ReplaceTablet: received request to replace tablet 018bd6ac8a534a6abc461b57b89b93eb from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:01.786104 9020 tablet_service.cc:1552] Processing DeleteTablet for tablet 4816503e4fa1459dbb311997be85f64a with delete_type TABLET_DATA_DELETED (replaced by tablet 80d4c9b533ac4facb4205aff84903134) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:01.786773 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet c0d0022e48f04b83ac1c998a83fe3f55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0d0022e48f04b83ac1c998a83fe3f55 already in progress: creating tablet
W20251215 14:55:01.788600 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 4816503e4fa1459dbb311997be85f64a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4816503e4fa1459dbb311997be85f64a already in progress: creating tablet
I20251215 14:55:01.788945 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_941fe7b7ed49404ba3712230e2ccdbf4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.790210 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_941fe7b7ed49404ba3712230e2ccdbf4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.791024 9431 ts_tablet_manager.cc:1929] T 769b0b615f334735a21564de213453b9 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.791209 9431 log.cc:1199] T 769b0b615f334735a21564de213453b9 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/769b0b615f334735a21564de213453b9
I20251215 14:55:01.791630 9431 ts_tablet_manager.cc:1950] T 769b0b615f334735a21564de213453b9 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:01.792795 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 769b0b615f334735a21564de213453b9 (table default.Table_adf3bac6c3e142c58b7d5800645458d8 [id=2956f54f93c242ff9624fca6bf3de2e7]) successfully deleted
I20251215 14:55:01.795303 8851 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 018bd6ac8a534a6abc461b57b89b93eb
W20251215 14:55:01.795780 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 4816503e4fa1459dbb311997be85f64a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4816503e4fa1459dbb311997be85f64a already in progress: creating tablet
I20251215 14:55:01.796363 8851 catalog_manager.cc:6724] ReplaceTablet: tablet 018bd6ac8a534a6abc461b57b89b93eb deleted and replaced by tablet 924c9dd0cd9d40189bfe1457040f3d37
I20251215 14:55:01.796482 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet 018bd6ac8a534a6abc461b57b89b93eb with delete_type TABLET_DATA_DELETED (replaced by tablet 924c9dd0cd9d40189bfe1457040f3d37) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.797686 9289 tablet_service.cc:1552] Processing DeleteTablet for tablet 018bd6ac8a534a6abc461b57b89b93eb with delete_type TABLET_DATA_DELETED (replaced by tablet 924c9dd0cd9d40189bfe1457040f3d37) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:01.798291 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 018bd6ac8a534a6abc461b57b89b93eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 018bd6ac8a534a6abc461b57b89b93eb already in progress: creating tablet
I20251215 14:55:01.798972 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 018bd6ac8a534a6abc461b57b89b93eb with delete_type TABLET_DATA_DELETED (replaced by tablet 924c9dd0cd9d40189bfe1457040f3d37) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:01.799783 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 018bd6ac8a534a6abc461b57b89b93eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 018bd6ac8a534a6abc461b57b89b93eb already in progress: creating tablet
I20251215 14:55:01.800722 9426 tablet_bootstrap.cc:492] T bf500ddc89754110be1cacf9d4289090 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:01.800884 9426 ts_tablet_manager.cc:1403] T bf500ddc89754110be1cacf9d4289090 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.000s
I20251215 14:55:01.801887 9426 raft_consensus.cc:359] T bf500ddc89754110be1cacf9d4289090 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.802099 9426 raft_consensus.cc:385] T bf500ddc89754110be1cacf9d4289090 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.802207 9426 raft_consensus.cc:740] T bf500ddc89754110be1cacf9d4289090 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.802465 9426 consensus_queue.cc:260] T bf500ddc89754110be1cacf9d4289090 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.803012 9426 ts_tablet_manager.cc:1434] T bf500ddc89754110be1cacf9d4289090 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:01.803390 9430 tablet_replica.cc:333] T 2ff9b217e17d45b9a492902ddc54da01 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:01.803575 9430 raft_consensus.cc:2243] T 2ff9b217e17d45b9a492902ddc54da01 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.803735 9430 raft_consensus.cc:2272] T 2ff9b217e17d45b9a492902ddc54da01 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.804260 9426 tablet_bootstrap.cc:492] T cbf290c214374f619d5a09b12872b5c0 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:01.806094 9426 tablet_bootstrap.cc:654] T cbf290c214374f619d5a09b12872b5c0 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.807878 9435 tablet_bootstrap.cc:492] T 5841bc20f8134b2483b23676d66504e1 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:01.808036 9435 ts_tablet_manager.cc:1403] T 5841bc20f8134b2483b23676d66504e1 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.050s user 0.000s sys 0.004s
I20251215 14:55:01.808859 9435 raft_consensus.cc:359] T 5841bc20f8134b2483b23676d66504e1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.809056 9435 raft_consensus.cc:385] T 5841bc20f8134b2483b23676d66504e1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.809144 9435 raft_consensus.cc:740] T 5841bc20f8134b2483b23676d66504e1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.809376 9435 consensus_queue.cc:260] T 5841bc20f8134b2483b23676d66504e1 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.810585 9435 ts_tablet_manager.cc:1434] T 5841bc20f8134b2483b23676d66504e1 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:01.810899 9435 tablet_bootstrap.cc:492] T de764ce68d7e43fd8925b7f2bbc23f2a P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:01.812655 9435 tablet_bootstrap.cc:654] T de764ce68d7e43fd8925b7f2bbc23f2a P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.813406 9289 tablet_service.cc:1552] Processing DeleteTablet for tablet 5841bc20f8134b2483b23676d66504e1 with delete_type TABLET_DATA_DELETED (replaced by tablet bf500ddc89754110be1cacf9d4289090) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.813740 9432 tablet_replica.cc:333] T 5841bc20f8134b2483b23676d66504e1 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:01.813917 9432 raft_consensus.cc:2243] T 5841bc20f8134b2483b23676d66504e1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.814079 9430 ts_tablet_manager.cc:1916] T 2ff9b217e17d45b9a492902ddc54da01 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.814110 9432 raft_consensus.cc:2272] T 5841bc20f8134b2483b23676d66504e1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20251215 14:55:01.814688 9228 tablet.cc:2378] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251215 14:55:01.814980 8854 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_73e20d74a96b419fa4b1f7987a0f3ed5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:01.815361 8852 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_416b2a942b694465af5210620bee2834"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.815874 8852 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_416b2a942b694465af5210620bee2834 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.816514 9432 ts_tablet_manager.cc:1916] T 5841bc20f8134b2483b23676d66504e1 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.817046 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_d3128ca44a5a4498bdb08081a61d8def"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.817538 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d3128ca44a5a4498bdb08081a61d8def in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:01.818670 8854 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73e20d74a96b419fa4b1f7987a0f3ed5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.821000 9426 tablet_bootstrap.cc:492] T cbf290c214374f619d5a09b12872b5c0 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:01.821120 9427 tablet_bootstrap.cc:492] T 7fc23183b3cb4330a32fca4d9a099d7a P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:01.821166 9426 ts_tablet_manager.cc:1403] T cbf290c214374f619d5a09b12872b5c0 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.002s
I20251215 14:55:01.821343 9427 ts_tablet_manager.cc:1403] T 7fc23183b3cb4330a32fca4d9a099d7a P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.097s user 0.025s sys 0.048s
I20251215 14:55:01.821957 9426 raft_consensus.cc:359] T cbf290c214374f619d5a09b12872b5c0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.822163 9426 raft_consensus.cc:385] T cbf290c214374f619d5a09b12872b5c0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.822245 9426 raft_consensus.cc:740] T cbf290c214374f619d5a09b12872b5c0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.822189 9427 raft_consensus.cc:359] T 7fc23183b3cb4330a32fca4d9a099d7a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.822492 9427 raft_consensus.cc:385] T 7fc23183b3cb4330a32fca4d9a099d7a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.822471 9426 consensus_queue.cc:260] T cbf290c214374f619d5a09b12872b5c0 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.822664 9427 raft_consensus.cc:740] T 7fc23183b3cb4330a32fca4d9a099d7a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.822932 9426 ts_tablet_manager.cc:1434] T cbf290c214374f619d5a09b12872b5c0 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:01.822926 9427 consensus_queue.cc:260] T 7fc23183b3cb4330a32fca4d9a099d7a P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.823253 9426 tablet_bootstrap.cc:492] T e420bc0a9c384e349a66d3eb8fb915d2 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:01.823844 9432 ts_tablet_manager.cc:1929] T 5841bc20f8134b2483b23676d66504e1 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.823979 9432 log.cc:1199] T 5841bc20f8134b2483b23676d66504e1 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/5841bc20f8134b2483b23676d66504e1
I20251215 14:55:01.824380 9432 ts_tablet_manager.cc:1950] T 5841bc20f8134b2483b23676d66504e1 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:01.824909 9426 tablet_bootstrap.cc:654] T e420bc0a9c384e349a66d3eb8fb915d2 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.825798 9427 ts_tablet_manager.cc:1434] T 7fc23183b3cb4330a32fca4d9a099d7a P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251215 14:55:01.826587 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_9034486cc3ff48dc8ff183466a3a5057"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:01.826740 8855 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_2e94c716d0fd4f4688b6bcbe468f8c5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.827093 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9034486cc3ff48dc8ff183466a3a5057 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:01.827116 8855 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e94c716d0fd4f4688b6bcbe468f8c5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.828397 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 7fc23183b3cb4330a32fca4d9a099d7a with delete_type TABLET_DATA_DELETED (replaced by tablet cbf290c214374f619d5a09b12872b5c0) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.828502 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet cbf290c214374f619d5a09b12872b5c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.828531 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 5841bc20f8134b2483b23676d66504e1 (table default.Table_f9872d0312584944b7732038b2ae68ed [id=6a65bee750c2458a8ac47914928e1b43]) successfully deleted
I20251215 14:55:01.828781 9431 tablet_replica.cc:333] T 7fc23183b3cb4330a32fca4d9a099d7a P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:01.828966 9431 raft_consensus.cc:2243] T 7fc23183b3cb4330a32fca4d9a099d7a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.829145 9431 raft_consensus.cc:2272] T 7fc23183b3cb4330a32fca4d9a099d7a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.829819 9427 tablet_bootstrap.cc:492] T 2ff9b217e17d45b9a492902ddc54da01 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:01.830070 9431 ts_tablet_manager.cc:1916] T 7fc23183b3cb4330a32fca4d9a099d7a P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.832362 9427 tablet_bootstrap.cc:654] T 2ff9b217e17d45b9a492902ddc54da01 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.832345 8851 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_c4412f55395440a585a59f6946511436"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.832890 8851 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4412f55395440a585a59f6946511436 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.834882 9427 tablet_bootstrap.cc:492] T 2ff9b217e17d45b9a492902ddc54da01 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:01.835057 9427 ts_tablet_manager.cc:1403] T 2ff9b217e17d45b9a492902ddc54da01 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20251215 14:55:01.836027 9427 raft_consensus.cc:359] T 2ff9b217e17d45b9a492902ddc54da01 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:01.836226 9427 raft_consensus.cc:385] T 2ff9b217e17d45b9a492902ddc54da01 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.836294 9427 raft_consensus.cc:740] T 2ff9b217e17d45b9a492902ddc54da01 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.836863 9431 ts_tablet_manager.cc:1929] T 7fc23183b3cb4330a32fca4d9a099d7a P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.836745 8853 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_c70c9ed917ff443198b26d639be549fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:01.837006 9431 log.cc:1199] T 7fc23183b3cb4330a32fca4d9a099d7a P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/7fc23183b3cb4330a32fca4d9a099d7a
W20251215 14:55:01.837278 8853 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c70c9ed917ff443198b26d639be549fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.837322 9431 ts_tablet_manager.cc:1950] T 7fc23183b3cb4330a32fca4d9a099d7a P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:01.838260 9427 consensus_queue.cc:260] T 2ff9b217e17d45b9a492902ddc54da01 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:01.838327 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 7fc23183b3cb4330a32fca4d9a099d7a (table default.Table_4437875587ce4e46a16cd8154d6ccc6b [id=beb4a6485efb47f889e1e3ae24167c9a]) successfully deleted
I20251215 14:55:01.838555 9430 ts_tablet_manager.cc:1929] T 2ff9b217e17d45b9a492902ddc54da01 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.838722 9430 log.cc:1199] T 2ff9b217e17d45b9a492902ddc54da01 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/2ff9b217e17d45b9a492902ddc54da01
I20251215 14:55:01.839051 9430 ts_tablet_manager.cc:1950] T 2ff9b217e17d45b9a492902ddc54da01 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:01.840000 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 2ff9b217e17d45b9a492902ddc54da01 (table default.Table_6326587168434469983b7215bb514379 [id=b77dd33e03384d6dadf621ad29c6d9e2]) successfully deleted
I20251215 14:55:01.840500 9427 ts_tablet_manager.cc:1434] T 2ff9b217e17d45b9a492902ddc54da01 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:01.840719 9435 tablet_bootstrap.cc:492] T de764ce68d7e43fd8925b7f2bbc23f2a P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:01.840899 9435 ts_tablet_manager.cc:1403] T de764ce68d7e43fd8925b7f2bbc23f2a P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20251215 14:55:01.841675 9435 raft_consensus.cc:359] T de764ce68d7e43fd8925b7f2bbc23f2a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.841859 9435 raft_consensus.cc:385] T de764ce68d7e43fd8925b7f2bbc23f2a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.841928 9435 raft_consensus.cc:740] T de764ce68d7e43fd8925b7f2bbc23f2a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.842141 9435 consensus_queue.cc:260] T de764ce68d7e43fd8925b7f2bbc23f2a P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.842696 9427 tablet_bootstrap.cc:492] T e420bc0a9c384e349a66d3eb8fb915d2 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:01.844218 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 2ff9b217e17d45b9a492902ddc54da01 with delete_type TABLET_DATA_DELETED (replaced by tablet e420bc0a9c384e349a66d3eb8fb915d2) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.844740 9435 ts_tablet_manager.cc:1434] T de764ce68d7e43fd8925b7f2bbc23f2a P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:01.845036 9427 tablet_bootstrap.cc:654] T e420bc0a9c384e349a66d3eb8fb915d2 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.845055 9435 tablet_bootstrap.cc:492] T 7fc23183b3cb4330a32fca4d9a099d7a P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:01.845646 9431 tablet_replica.cc:333] T 2ff9b217e17d45b9a492902ddc54da01 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:01.845846 9431 raft_consensus.cc:2243] T 2ff9b217e17d45b9a492902ddc54da01 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.846169 9431 raft_consensus.cc:2272] T 2ff9b217e17d45b9a492902ddc54da01 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.846642 9435 tablet_bootstrap.cc:654] T 7fc23183b3cb4330a32fca4d9a099d7a P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.847486 9431 ts_tablet_manager.cc:1916] T 2ff9b217e17d45b9a492902ddc54da01 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251215 14:55:01.848184 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 4a6846144c8c409cad340e99374a38c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a6846144c8c409cad340e99374a38c6 already in progress: creating tablet
I20251215 14:55:01.848554 9430 tablet_replica.cc:333] T bf500ddc89754110be1cacf9d4289090 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:01.848747 9430 raft_consensus.cc:2243] T bf500ddc89754110be1cacf9d4289090 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.848933 9430 raft_consensus.cc:2272] T bf500ddc89754110be1cacf9d4289090 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.849831 9435 tablet_bootstrap.cc:492] T 7fc23183b3cb4330a32fca4d9a099d7a P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:01.849942 9435 ts_tablet_manager.cc:1403] T 7fc23183b3cb4330a32fca4d9a099d7a P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20251215 14:55:01.850667 9435 raft_consensus.cc:359] T 7fc23183b3cb4330a32fca4d9a099d7a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.850873 9435 raft_consensus.cc:385] T 7fc23183b3cb4330a32fca4d9a099d7a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.850962 9435 raft_consensus.cc:740] T 7fc23183b3cb4330a32fca4d9a099d7a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.851577 9430 ts_tablet_manager.cc:1916] T bf500ddc89754110be1cacf9d4289090 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.854645 9427 tablet_bootstrap.cc:492] T e420bc0a9c384e349a66d3eb8fb915d2 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:01.854779 9427 ts_tablet_manager.cc:1403] T e420bc0a9c384e349a66d3eb8fb915d2 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20251215 14:55:01.855675 9427 raft_consensus.cc:359] T e420bc0a9c384e349a66d3eb8fb915d2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.855854 9427 raft_consensus.cc:385] T e420bc0a9c384e349a66d3eb8fb915d2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.855962 9427 raft_consensus.cc:740] T e420bc0a9c384e349a66d3eb8fb915d2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.856199 9427 consensus_queue.cc:260] T e420bc0a9c384e349a66d3eb8fb915d2 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.858354 9427 ts_tablet_manager.cc:1434] T e420bc0a9c384e349a66d3eb8fb915d2 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20251215 14:55:01.858677 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_cab0b4ed4b2d4d059b29a0e4f4a676ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.859299 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cab0b4ed4b2d4d059b29a0e4f4a676ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.859426 9427 tablet_bootstrap.cc:492] T bf500ddc89754110be1cacf9d4289090 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:01.860271 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 80d4c9b533ac4facb4205aff84903134 (DEFAULT_TABLE table=default.Table_4c9e2fc042e34c5d8ebaf68a00cd786a [id=5209bd8f71994c1092418b41d8c905db]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.860692 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d4c9b533ac4facb4205aff84903134. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.860925 9427 tablet_bootstrap.cc:654] T bf500ddc89754110be1cacf9d4289090 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.861759 8858 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:01.862250 8858 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:01.862795 9435 consensus_queue.cc:260] T 7fc23183b3cb4330a32fca4d9a099d7a P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.863293 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet de764ce68d7e43fd8925b7f2bbc23f2a with delete_type TABLET_DATA_DELETED (replaced by tablet 8612ebb3fc3c4554be4b881a60ad6fd4) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.863515 9432 tablet_replica.cc:333] T de764ce68d7e43fd8925b7f2bbc23f2a P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:01.863694 9432 raft_consensus.cc:2243] T de764ce68d7e43fd8925b7f2bbc23f2a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.863852 9432 raft_consensus.cc:2272] T de764ce68d7e43fd8925b7f2bbc23f2a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.863899 9435 ts_tablet_manager.cc:1434] T 7fc23183b3cb4330a32fca4d9a099d7a P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20251215 14:55:01.864485 9432 ts_tablet_manager.cc:1916] T de764ce68d7e43fd8925b7f2bbc23f2a P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.865499 9420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1f310d741d8247488792985606a1c19e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:55:01.865669 9420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [sys.catalog]: This master's current role is: LEADER
I20251215 14:55:01.865871 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 80d4c9b533ac4facb4205aff84903134 (DEFAULT_TABLE table=default.Table_4c9e2fc042e34c5d8ebaf68a00cd786a [id=5209bd8f71994c1092418b41d8c905db]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.867815 9022 tablet_service.cc:1505] Processing CreateTablet for tablet 80d4c9b533ac4facb4205aff84903134 (DEFAULT_TABLE table=default.Table_4c9e2fc042e34c5d8ebaf68a00cd786a [id=5209bd8f71994c1092418b41d8c905db]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.868220 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d4c9b533ac4facb4205aff84903134. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.869779 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet 7fc23183b3cb4330a32fca4d9a099d7a with delete_type TABLET_DATA_DELETED (replaced by tablet cbf290c214374f619d5a09b12872b5c0) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.871829 8852 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_1290357576a4475985bf0cd26aad05b1" } new_table_name: "default.Table_5d92197d1765400c9f43536326cadebf" modify_external_catalogs: true
I20251215 14:55:01.876885 9432 ts_tablet_manager.cc:1929] T de764ce68d7e43fd8925b7f2bbc23f2a P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.877056 9432 log.cc:1199] T de764ce68d7e43fd8925b7f2bbc23f2a P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/de764ce68d7e43fd8925b7f2bbc23f2a
I20251215 14:55:01.877401 9432 ts_tablet_manager.cc:1950] T de764ce68d7e43fd8925b7f2bbc23f2a P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:01.878486 9432 tablet_replica.cc:333] T 7fc23183b3cb4330a32fca4d9a099d7a P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:01.878693 9432 raft_consensus.cc:2243] T 7fc23183b3cb4330a32fca4d9a099d7a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.878870 9432 raft_consensus.cc:2272] T 7fc23183b3cb4330a32fca4d9a099d7a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.878890 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet de764ce68d7e43fd8925b7f2bbc23f2a (table default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6]) successfully deleted
I20251215 14:55:01.879583 9432 ts_tablet_manager.cc:1916] T 7fc23183b3cb4330a32fca4d9a099d7a P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.879577 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet e420bc0a9c384e349a66d3eb8fb915d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.879987 9435 tablet_bootstrap.cc:492] T bf500ddc89754110be1cacf9d4289090 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:01.882072 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80d4c9b533ac4facb4205aff84903134. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.888283 9431 ts_tablet_manager.cc:1929] T 2ff9b217e17d45b9a492902ddc54da01 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.888410 9431 log.cc:1199] T 2ff9b217e17d45b9a492902ddc54da01 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/2ff9b217e17d45b9a492902ddc54da01
I20251215 14:55:01.888784 9431 ts_tablet_manager.cc:1950] T 2ff9b217e17d45b9a492902ddc54da01 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:01.889688 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 2ff9b217e17d45b9a492902ddc54da01 (table default.Table_6326587168434469983b7215bb514379 [id=b77dd33e03384d6dadf621ad29c6d9e2]) successfully deleted
I20251215 14:55:01.890015 9431 tablet_replica.cc:333] T e420bc0a9c384e349a66d3eb8fb915d2 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:01.890221 9431 raft_consensus.cc:2243] T e420bc0a9c384e349a66d3eb8fb915d2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.890384 9431 raft_consensus.cc:2272] T e420bc0a9c384e349a66d3eb8fb915d2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.891243 9431 ts_tablet_manager.cc:1916] T e420bc0a9c384e349a66d3eb8fb915d2 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.892331 8850 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_19cbfafb518e496d9a83c66ea3f027f8" } new_table_name: "default.Table_d884e36a60cf4a109778a5bfa32afaa8" modify_external_catalogs: true
I20251215 14:55:01.892861 9435 tablet_bootstrap.cc:654] T bf500ddc89754110be1cacf9d4289090 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.893721 8856 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_9034486cc3ff48dc8ff183466a3a5057" } new_table_name: "default.Table_ee5a468c7e4544adbe4bf3c1c56049d8" modify_external_catalogs: true
I20251215 14:55:01.896615 8855 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_08c8c65e626a4446878f527008df67ec" } modify_external_catalogs: true
I20251215 14:55:01.896816 8855 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_08c8c65e626a4446878f527008df67ec" } modify_external_catalogs: true
I20251215 14:55:01.897293 8854 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_c5906c964a4b4bfdb59ca029909a5f70" } new_table_name: "default.Table_28c03048db094b5093cd88eb3dc6f7fe" modify_external_catalogs: true
I20251215 14:55:01.899248 8859 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_416b2a942b694465af5210620bee2834" } new_table_name: "default.Table_580cff1ea5174c8d8e8ee2a76346c2e5" modify_external_catalogs: true
I20251215 14:55:01.901139 9430 ts_tablet_manager.cc:1929] T bf500ddc89754110be1cacf9d4289090 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.901336 9430 log.cc:1199] T bf500ddc89754110be1cacf9d4289090 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/bf500ddc89754110be1cacf9d4289090
I20251215 14:55:01.901491 9431 ts_tablet_manager.cc:1929] T e420bc0a9c384e349a66d3eb8fb915d2 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.901646 9431 log.cc:1199] T e420bc0a9c384e349a66d3eb8fb915d2 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/e420bc0a9c384e349a66d3eb8fb915d2
I20251215 14:55:01.901706 9430 ts_tablet_manager.cc:1950] T bf500ddc89754110be1cacf9d4289090 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:01.901990 9431 ts_tablet_manager.cc:1950] T e420bc0a9c384e349a66d3eb8fb915d2 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:01.902834 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet bf500ddc89754110be1cacf9d4289090 (table default.Table_f9872d0312584944b7732038b2ae68ed [id=6a65bee750c2458a8ac47914928e1b43]) successfully deleted
I20251215 14:55:01.902920 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet e420bc0a9c384e349a66d3eb8fb915d2 (table default.Table_6326587168434469983b7215bb514379 [id=b77dd33e03384d6dadf621ad29c6d9e2]) successfully deleted
I20251215 14:55:01.904102 9435 tablet_bootstrap.cc:492] T bf500ddc89754110be1cacf9d4289090 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:01.904302 9435 ts_tablet_manager.cc:1403] T bf500ddc89754110be1cacf9d4289090 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.001s
I20251215 14:55:01.905077 9435 raft_consensus.cc:359] T bf500ddc89754110be1cacf9d4289090 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.905340 9435 raft_consensus.cc:385] T bf500ddc89754110be1cacf9d4289090 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.905413 9435 raft_consensus.cc:740] T bf500ddc89754110be1cacf9d4289090 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.910351 9432 ts_tablet_manager.cc:1929] T 7fc23183b3cb4330a32fca4d9a099d7a P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:01.910478 9432 log.cc:1199] T 7fc23183b3cb4330a32fca4d9a099d7a P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/7fc23183b3cb4330a32fca4d9a099d7a
I20251215 14:55:01.910802 9432 ts_tablet_manager.cc:1950] T 7fc23183b3cb4330a32fca4d9a099d7a P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:01.911844 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 7fc23183b3cb4330a32fca4d9a099d7a (table default.Table_4437875587ce4e46a16cd8154d6ccc6b [id=beb4a6485efb47f889e1e3ae24167c9a]) successfully deleted
I20251215 14:55:01.905666 9435 consensus_queue.cc:260] T bf500ddc89754110be1cacf9d4289090 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.915728 9426 tablet_bootstrap.cc:492] T e420bc0a9c384e349a66d3eb8fb915d2 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:01.916013 9426 ts_tablet_manager.cc:1403] T e420bc0a9c384e349a66d3eb8fb915d2 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.093s user 0.000s sys 0.009s
I20251215 14:55:01.916854 9426 raft_consensus.cc:359] T e420bc0a9c384e349a66d3eb8fb915d2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.917057 9426 raft_consensus.cc:385] T e420bc0a9c384e349a66d3eb8fb915d2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.917151 9426 raft_consensus.cc:740] T e420bc0a9c384e349a66d3eb8fb915d2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.917434 9426 consensus_queue.cc:260] T e420bc0a9c384e349a66d3eb8fb915d2 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:01.919025 8852 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b2d65d8d32cc4ea19ddc4bbaf5291820 consensus state has no leader
I20251215 14:55:01.919275 9426 ts_tablet_manager.cc:1434] T e420bc0a9c384e349a66d3eb8fb915d2 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20251215 14:55:01.919552 9426 tablet_bootstrap.cc:492] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:01.920230 9435 ts_tablet_manager.cc:1434] T bf500ddc89754110be1cacf9d4289090 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20251215 14:55:01.921622 9159 tablet_service.cc:1505] Processing CreateTablet for tablet f9695d47e35448fdad95ff3f24bafd03 (DEFAULT_TABLE table=default.Table_2e94c716d0fd4f4688b6bcbe468f8c5a [id=f8964b6550d0494684b46e09cf8731ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.921994 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9695d47e35448fdad95ff3f24bafd03. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.923128 9435 tablet_bootstrap.cc:492] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:01.923399 8850 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c276eb6ad0414bb8ae5d553ae623edac consensus state has no leader
I20251215 14:55:01.924547 9289 tablet_service.cc:1505] Processing CreateTablet for tablet f9695d47e35448fdad95ff3f24bafd03 (DEFAULT_TABLE table=default.Table_2e94c716d0fd4f4688b6bcbe468f8c5a [id=f8964b6550d0494684b46e09cf8731ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.924898 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9695d47e35448fdad95ff3f24bafd03. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.925907 9022 tablet_service.cc:1505] Processing CreateTablet for tablet f9695d47e35448fdad95ff3f24bafd03 (DEFAULT_TABLE table=default.Table_2e94c716d0fd4f4688b6bcbe468f8c5a [id=f8964b6550d0494684b46e09cf8731ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.926115 9020 tablet_service.cc:1505] Processing CreateTablet for tablet c4f47c22111c427a8ab9c4ae1e105375 (DEFAULT_TABLE table=default.Table_9034486cc3ff48dc8ff183466a3a5057 [id=b76c4f587a0d4acc8e7d2a27dae1fc7a]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:01.926199 8856 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c4f47c22111c427a8ab9c4ae1e105375 consensus state has no leader
I20251215 14:55:01.926327 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9695d47e35448fdad95ff3f24bafd03. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:01.926715 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet f2aae2798eee4775afaa3afc59e98a6c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f2aae2798eee4775afaa3afc59e98a6c already in progress: creating tablet
I20251215 14:55:01.927426 9295 tablet_service.cc:1505] Processing CreateTablet for tablet bdfc164128a6413a83d83d05b69fb74a (DEFAULT_TABLE table=default.Table_d3128ca44a5a4498bdb08081a61d8def [id=81e49ae1f3ea4632b97631348912c1d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.927510 9158 tablet_service.cc:1505] Processing CreateTablet for tablet 9bd8d964650a49b08093608abf3e31fa (DEFAULT_TABLE table=default.Table_416b2a942b694465af5210620bee2834 [id=640d70bd78554e92823dc104e06227d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.927747 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdfc164128a6413a83d83d05b69fb74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.927806 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd8d964650a49b08093608abf3e31fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.929581 9021 tablet_service.cc:1505] Processing CreateTablet for tablet 9bd8d964650a49b08093608abf3e31fa (DEFAULT_TABLE table=default.Table_416b2a942b694465af5210620bee2834 [id=640d70bd78554e92823dc104e06227d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.929925 9021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd8d964650a49b08093608abf3e31fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.929925 8851 master_service.cc:954] ReplaceTablet: received request to replace tablet 5841bc20f8134b2483b23676d66504e1 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:01.931434 9294 tablet_service.cc:1505] Processing CreateTablet for tablet c4f47c22111c427a8ab9c4ae1e105375 (DEFAULT_TABLE table=default.Table_9034486cc3ff48dc8ff183466a3a5057 [id=b76c4f587a0d4acc8e7d2a27dae1fc7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.931731 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f47c22111c427a8ab9c4ae1e105375. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.933414 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f47c22111c427a8ab9c4ae1e105375. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.935429 9286 tablet_service.cc:1505] Processing CreateTablet for tablet 9bd8d964650a49b08093608abf3e31fa (DEFAULT_TABLE table=default.Table_416b2a942b694465af5210620bee2834 [id=640d70bd78554e92823dc104e06227d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.935735 9286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bd8d964650a49b08093608abf3e31fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.936236 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 2df2138e41844e9f897e57264b62cc9d (DEFAULT_TABLE table=default.Table_941fe7b7ed49404ba3712230e2ccdbf4 [id=d0f601c09d8645db87784b72e4f2f962]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.936978 9018 tablet_service.cc:1505] Processing CreateTablet for tablet bdfc164128a6413a83d83d05b69fb74a (DEFAULT_TABLE table=default.Table_d3128ca44a5a4498bdb08081a61d8def [id=81e49ae1f3ea4632b97631348912c1d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.937980 9157 tablet_service.cc:1505] Processing CreateTablet for tablet bdfc164128a6413a83d83d05b69fb74a (DEFAULT_TABLE table=default.Table_d3128ca44a5a4498bdb08081a61d8def [id=81e49ae1f3ea4632b97631348912c1d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.938344 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdfc164128a6413a83d83d05b69fb74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.938524 9016 tablet_service.cc:1505] Processing CreateTablet for tablet 924c9dd0cd9d40189bfe1457040f3d37 (DEFAULT_TABLE table=default.Table_f466f52dcdb54303893bb61ccaaf1c31 [id=b572c0e839954dba935a12d258d49f07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.940325 9156 tablet_service.cc:1505] Processing CreateTablet for tablet 2df2138e41844e9f897e57264b62cc9d (DEFAULT_TABLE table=default.Table_941fe7b7ed49404ba3712230e2ccdbf4 [id=d0f601c09d8645db87784b72e4f2f962]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.940659 9156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df2138e41844e9f897e57264b62cc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.943478 9155 tablet_service.cc:1505] Processing CreateTablet for tablet 44bd51f9bf77492b8890fc7c8411c887 (DEFAULT_TABLE table=default.Table_73e20d74a96b419fa4b1f7987a0f3ed5 [id=ecd517988ca845d7b3fd29af367c67c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.943646 8858 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_390be178b42a4c78ba4a85ca90d2a4cd" } modify_external_catalogs: true
I20251215 14:55:01.943852 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44bd51f9bf77492b8890fc7c8411c887. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.943821 8858 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_390be178b42a4c78ba4a85ca90d2a4cd" } modify_external_catalogs: true
I20251215 14:55:01.944869 9017 tablet_service.cc:1505] Processing CreateTablet for tablet 44bd51f9bf77492b8890fc7c8411c887 (DEFAULT_TABLE table=default.Table_73e20d74a96b419fa4b1f7987a0f3ed5 [id=ecd517988ca845d7b3fd29af367c67c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.946015 9160 tablet_service.cc:1505] Processing CreateTablet for tablet c4f47c22111c427a8ab9c4ae1e105375 (DEFAULT_TABLE table=default.Table_9034486cc3ff48dc8ff183466a3a5057 [id=b76c4f587a0d4acc8e7d2a27dae1fc7a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.946370 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4f47c22111c427a8ab9c4ae1e105375. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.946734 8850 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_5150978dc817409084ef9ea8c442b55a" } modify_external_catalogs: true
I20251215 14:55:01.946890 8850 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_5150978dc817409084ef9ea8c442b55a" } modify_external_catalogs: true
I20251215 14:55:01.947558 9154 tablet_service.cc:1505] Processing CreateTablet for tablet 924c9dd0cd9d40189bfe1457040f3d37 (DEFAULT_TABLE table=default.Table_f466f52dcdb54303893bb61ccaaf1c31 [id=b572c0e839954dba935a12d258d49f07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.948055 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924c9dd0cd9d40189bfe1457040f3d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.948105 8857 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_d3128ca44a5a4498bdb08081a61d8def" } modify_external_catalogs: true
I20251215 14:55:01.948243 8857 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_d3128ca44a5a4498bdb08081a61d8def" } modify_external_catalogs: true
I20251215 14:55:01.950565 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df2138e41844e9f897e57264b62cc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.951087 8856 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_4c9e2fc042e34c5d8ebaf68a00cd786a" } modify_external_catalogs: true
I20251215 14:55:01.951253 8856 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_4c9e2fc042e34c5d8ebaf68a00cd786a" } modify_external_catalogs: true
I20251215 14:55:01.953056 9153 tablet_service.cc:1552] Processing DeleteTablet for tablet e420bc0a9c384e349a66d3eb8fb915d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.955502 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924c9dd0cd9d40189bfe1457040f3d37. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:01.957743 8854 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a28289e1e5334512b2240c3b571d9424 consensus state has no leader
W20251215 14:55:01.958109 8859 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9bd8d964650a49b08093608abf3e31fa consensus state has no leader
I20251215 14:55:01.960489 9017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44bd51f9bf77492b8890fc7c8411c887. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.960434 9291 tablet_service.cc:1505] Processing CreateTablet for tablet 2df2138e41844e9f897e57264b62cc9d (DEFAULT_TABLE table=default.Table_941fe7b7ed49404ba3712230e2ccdbf4 [id=d0f601c09d8645db87784b72e4f2f962]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.960496 8859 master_service.cc:954] ReplaceTablet: received request to replace tablet 2df2138e41844e9f897e57264b62cc9d from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:01.960785 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2df2138e41844e9f897e57264b62cc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.963457 9290 tablet_service.cc:1505] Processing CreateTablet for tablet 924c9dd0cd9d40189bfe1457040f3d37 (DEFAULT_TABLE table=default.Table_f466f52dcdb54303893bb61ccaaf1c31 [id=b572c0e839954dba935a12d258d49f07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.963622 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdfc164128a6413a83d83d05b69fb74a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.963765 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 924c9dd0cd9d40189bfe1457040f3d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.967307 9287 tablet_service.cc:1552] Processing DeleteTablet for tablet bf500ddc89754110be1cacf9d4289090 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.967747 9292 tablet_service.cc:1505] Processing CreateTablet for tablet 44bd51f9bf77492b8890fc7c8411c887 (DEFAULT_TABLE table=default.Table_73e20d74a96b419fa4b1f7987a0f3ed5 [id=ecd517988ca845d7b3fd29af367c67c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:01.968079 9292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44bd51f9bf77492b8890fc7c8411c887. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:01.972348 8855 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 26648bf286c94b2495e565969f945858
I20251215 14:55:01.973716 8850 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 7c9141d604c34314a462b892076b7224
I20251215 14:55:01.974568 9158 tablet_service.cc:1552] Processing DeleteTablet for tablet 7c9141d604c34314a462b892076b7224 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.974851 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 7c9141d604c34314a462b892076b7224 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.975091 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 26648bf286c94b2495e565969f945858 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.975116 8858 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 4f1f902cbcb643b9b98fa3d72babba79
W20251215 14:55:01.975551 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 7c9141d604c34314a462b892076b7224 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c9141d604c34314a462b892076b7224 already in progress: creating tablet
I20251215 14:55:01.975805 9286 tablet_service.cc:1552] Processing DeleteTablet for tablet 26648bf286c94b2495e565969f945858 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.976086 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 4f1f902cbcb643b9b98fa3d72babba79 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:01.976639 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 4f1f902cbcb643b9b98fa3d72babba79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f1f902cbcb643b9b98fa3d72babba79 already in progress: creating tablet
I20251215 14:55:01.976825 9289 tablet_service.cc:1552] Processing DeleteTablet for tablet 4f1f902cbcb643b9b98fa3d72babba79 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.976938 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 4f1f902cbcb643b9b98fa3d72babba79 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.976766 9292 tablet_service.cc:1552] Processing DeleteTablet for tablet 7c9141d604c34314a462b892076b7224 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.978312 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet 26648bf286c94b2495e565969f945858 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:01.978904 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 26648bf286c94b2495e565969f945858 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26648bf286c94b2495e565969f945858 already in progress: creating tablet
I20251215 14:55:01.983089 9430 tablet_replica.cc:333] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:01.983341 9430 raft_consensus.cc:2243] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.983517 9430 raft_consensus.cc:2272] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.983686 8856 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 80d4c9b533ac4facb4205aff84903134
I20251215 14:55:01.983982 9427 tablet_bootstrap.cc:492] T bf500ddc89754110be1cacf9d4289090 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:01.984018 8857 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet bdfc164128a6413a83d83d05b69fb74a
I20251215 14:55:01.984135 9427 ts_tablet_manager.cc:1403] T bf500ddc89754110be1cacf9d4289090 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.125s user 0.014s sys 0.039s
I20251215 14:55:01.984411 9430 ts_tablet_manager.cc:1916] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.984655 8859 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 2df2138e41844e9f897e57264b62cc9d
I20251215 14:55:01.984952 9427 raft_consensus.cc:359] T bf500ddc89754110be1cacf9d4289090 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.985090 8859 catalog_manager.cc:6724] ReplaceTablet: tablet 2df2138e41844e9f897e57264b62cc9d deleted and replaced by tablet fc9bda52c73e4aa6b7e2eb008c63391b
I20251215 14:55:01.985143 9427 raft_consensus.cc:385] T bf500ddc89754110be1cacf9d4289090 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:01.985219 9427 raft_consensus.cc:740] T bf500ddc89754110be1cacf9d4289090 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:01.985888 9426 tablet_bootstrap.cc:654] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.985491 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet 80d4c9b533ac4facb4205aff84903134 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.987109 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet bdfc164128a6413a83d83d05b69fb74a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.987651 9016 tablet_service.cc:1552] Processing DeleteTablet for tablet bdfc164128a6413a83d83d05b69fb74a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:01.987813 9019 tablet_service.cc:1552] Processing DeleteTablet for tablet 80d4c9b533ac4facb4205aff84903134 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:01.987847 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet cb2f4fc179744458bc7db2f6c7197ec5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb2f4fc179744458bc7db2f6c7197ec5 already in progress: creating tablet
I20251215 14:55:01.988160 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet 2df2138e41844e9f897e57264b62cc9d with delete_type TABLET_DATA_DELETED (replaced by tablet fc9bda52c73e4aa6b7e2eb008c63391b) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:01.988864 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet bdfc164128a6413a83d83d05b69fb74a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bdfc164128a6413a83d83d05b69fb74a already in progress: creating tablet
W20251215 14:55:01.989099 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 80d4c9b533ac4facb4205aff84903134 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80d4c9b533ac4facb4205aff84903134 already in progress: creating tablet
W20251215 14:55:01.989329 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 2df2138e41844e9f897e57264b62cc9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df2138e41844e9f897e57264b62cc9d already in progress: creating tablet
I20251215 14:55:01.989889 9432 tablet_replica.cc:333] T bf500ddc89754110be1cacf9d4289090 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:01.990087 9432 raft_consensus.cc:2243] T bf500ddc89754110be1cacf9d4289090 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:01.990275 9432 raft_consensus.cc:2272] T bf500ddc89754110be1cacf9d4289090 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:01.990890 9435 tablet_bootstrap.cc:654] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:01.991300 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet 2df2138e41844e9f897e57264b62cc9d with delete_type TABLET_DATA_DELETED (replaced by tablet fc9bda52c73e4aa6b7e2eb008c63391b) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:01.991700 9427 consensus_queue.cc:260] T bf500ddc89754110be1cacf9d4289090 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:01.994027 9157 tablet_service.cc:1552] Processing DeleteTablet for tablet 80d4c9b533ac4facb4205aff84903134 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.994262 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet bdfc164128a6413a83d83d05b69fb74a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:01.994802 9432 ts_tablet_manager.cc:1916] T bf500ddc89754110be1cacf9d4289090 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:01.995962 9427 ts_tablet_manager.cc:1434] T bf500ddc89754110be1cacf9d4289090 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20251215 14:55:01.999461 9435 tablet_bootstrap.cc:492] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:01.999606 9435 ts_tablet_manager.cc:1403] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.077s user 0.002s sys 0.003s
I20251215 14:55:02.000370 9435 raft_consensus.cc:359] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.000535 9435 raft_consensus.cc:385] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.000614 9435 raft_consensus.cc:740] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.000821 9435 consensus_queue.cc:260] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.000887 9430 ts_tablet_manager.cc:1929] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:02.001034 9430 log.cc:1199] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/5841bc20f8134b2483b23676d66504e1
I20251215 14:55:02.001346 9435 ts_tablet_manager.cc:1434] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:02.001394 9430 ts_tablet_manager.cc:1950] T 5841bc20f8134b2483b23676d66504e1 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:02.001703 9435 tablet_bootstrap.cc:492] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:02.002655 9430 tablet_replica.cc:333] T cbf290c214374f619d5a09b12872b5c0 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:02.002815 9430 raft_consensus.cc:2243] T cbf290c214374f619d5a09b12872b5c0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:02.002979 9430 raft_consensus.cc:2272] T cbf290c214374f619d5a09b12872b5c0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:02.003495 9435 tablet_bootstrap.cc:654] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.006881 9294 tablet_service.cc:1505] Processing CreateTablet for tablet 92e21a77ad074572a57b836743903a0b (DEFAULT_TABLE table=default.Table_cab0b4ed4b2d4d059b29a0e4f4a676ab [id=ed9cd5da58e14660b90b6200d510e9c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.007314 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e21a77ad074572a57b836743903a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.007907 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 2df2138e41844e9f897e57264b62cc9d with delete_type TABLET_DATA_DELETED (replaced by tablet fc9bda52c73e4aa6b7e2eb008c63391b) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:02.011229 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 92e21a77ad074572a57b836743903a0b (DEFAULT_TABLE table=default.Table_cab0b4ed4b2d4d059b29a0e4f4a676ab [id=ed9cd5da58e14660b90b6200d510e9c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.011353 9022 tablet_service.cc:1505] Processing CreateTablet for tablet e6aad8bed15a416a925ae8c8870d4e51 (DEFAULT_TABLE table=default.Table_c70c9ed917ff443198b26d639be549fa [id=475675db74e8401c9c822c7a846fe217]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.011459 8857 master_service.cc:954] ReplaceTablet: received request to replace tablet a28289e1e5334512b2240c3b571d9424 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:02.011651 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e21a77ad074572a57b836743903a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.011924 9295 tablet_service.cc:1505] Processing CreateTablet for tablet b329b0abcad742ff94c1a62a72d1b673 (DEFAULT_TABLE table=default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e [id=6b4b04bb03f04a8a9cd7bc893acf612c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.012259 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b329b0abcad742ff94c1a62a72d1b673. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.012568 9016 tablet_service.cc:1552] Processing DeleteTablet for tablet bf500ddc89754110be1cacf9d4289090 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:02.013105 9291 tablet_service.cc:1505] Processing CreateTablet for tablet e6aad8bed15a416a925ae8c8870d4e51 (DEFAULT_TABLE table=default.Table_c70c9ed917ff443198b26d639be549fa [id=475675db74e8401c9c822c7a846fe217]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.013468 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6aad8bed15a416a925ae8c8870d4e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.014298 8856 master_service.cc:954] ReplaceTablet: received request to replace tablet 9bd8d964650a49b08093608abf3e31fa from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:02.011354 9018 tablet_service.cc:1505] Processing CreateTablet for tablet 813cfeea5399457e91623fb3abf9fd32 (DEFAULT_TABLE table=default.Table_c4412f55395440a585a59f6946511436 [id=e24cda78e15f4f63a89495c42e9c8ab4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.015587 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813cfeea5399457e91623fb3abf9fd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.017900 9017 tablet_service.cc:1505] Processing CreateTablet for tablet b329b0abcad742ff94c1a62a72d1b673 (DEFAULT_TABLE table=default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e [id=6b4b04bb03f04a8a9cd7bc893acf612c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.018275 9017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b329b0abcad742ff94c1a62a72d1b673. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.019281 9431 tablet_replica.cc:333] T bf500ddc89754110be1cacf9d4289090 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:02.019455 9431 raft_consensus.cc:2243] T bf500ddc89754110be1cacf9d4289090 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:02.019655 9431 raft_consensus.cc:2272] T bf500ddc89754110be1cacf9d4289090 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:02.019929 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6aad8bed15a416a925ae8c8870d4e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.020468 9427 tablet_bootstrap.cc:492] T cbf290c214374f619d5a09b12872b5c0 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:02.023941 9427 tablet_bootstrap.cc:654] T cbf290c214374f619d5a09b12872b5c0 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.025331 9431 ts_tablet_manager.cc:1916] T bf500ddc89754110be1cacf9d4289090 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:02.025614 9426 tablet_bootstrap.cc:492] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:02.025786 9426 ts_tablet_manager.cc:1403] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.106s user 0.002s sys 0.001s
I20251215 14:55:02.026592 9426 raft_consensus.cc:359] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.026798 9426 raft_consensus.cc:385] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.026863 9426 raft_consensus.cc:740] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.027137 9426 consensus_queue.cc:260] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.028861 9432 ts_tablet_manager.cc:1929] T bf500ddc89754110be1cacf9d4289090 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:02.029022 9432 log.cc:1199] T bf500ddc89754110be1cacf9d4289090 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/bf500ddc89754110be1cacf9d4289090
I20251215 14:55:02.029172 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 5841bc20f8134b2483b23676d66504e1 (table default.Table_f9872d0312584944b7732038b2ae68ed [id=6a65bee750c2458a8ac47914928e1b43]) successfully deleted
I20251215 14:55:02.029397 9432 ts_tablet_manager.cc:1950] T bf500ddc89754110be1cacf9d4289090 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
W20251215 14:55:02.029466 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet c0d0022e48f04b83ac1c998a83fe3f55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c0d0022e48f04b83ac1c998a83fe3f55 already in progress: creating tablet
W20251215 14:55:02.029768 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 018bd6ac8a534a6abc461b57b89b93eb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 018bd6ac8a534a6abc461b57b89b93eb already in progress: creating tablet
I20251215 14:55:02.030462 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet bf500ddc89754110be1cacf9d4289090 (table default.Table_f9872d0312584944b7732038b2ae68ed [id=6a65bee750c2458a8ac47914928e1b43]) successfully deleted
I20251215 14:55:02.032723 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 813cfeea5399457e91623fb3abf9fd32 (DEFAULT_TABLE table=default.Table_c4412f55395440a585a59f6946511436 [id=e24cda78e15f4f63a89495c42e9c8ab4]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:02.033838 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 26648bf286c94b2495e565969f945858 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26648bf286c94b2495e565969f945858 already in progress: creating tablet
I20251215 14:55:02.033991 9431 ts_tablet_manager.cc:1929] T bf500ddc89754110be1cacf9d4289090 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:02.034140 9431 log.cc:1199] T bf500ddc89754110be1cacf9d4289090 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/bf500ddc89754110be1cacf9d4289090
I20251215 14:55:02.034150 9160 tablet_service.cc:1505] Processing CreateTablet for tablet 92e21a77ad074572a57b836743903a0b (DEFAULT_TABLE table=default.Table_cab0b4ed4b2d4d059b29a0e4f4a676ab [id=ed9cd5da58e14660b90b6200d510e9c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.034507 9431 ts_tablet_manager.cc:1950] T bf500ddc89754110be1cacf9d4289090 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:02.034592 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92e21a77ad074572a57b836743903a0b. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:02.034605 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 4f1f902cbcb643b9b98fa3d72babba79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f1f902cbcb643b9b98fa3d72babba79 already in progress: creating tablet
W20251215 14:55:02.035569 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 7c9141d604c34314a462b892076b7224 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7c9141d604c34314a462b892076b7224 already in progress: creating tablet
W20251215 14:55:02.037405 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 80d4c9b533ac4facb4205aff84903134 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80d4c9b533ac4facb4205aff84903134 already in progress: creating tablet
I20251215 14:55:02.037658 8857 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet a28289e1e5334512b2240c3b571d9424
W20251215 14:55:02.038036 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet bdfc164128a6413a83d83d05b69fb74a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bdfc164128a6413a83d83d05b69fb74a already in progress: creating tablet
I20251215 14:55:02.038147 8857 catalog_manager.cc:6724] ReplaceTablet: tablet a28289e1e5334512b2240c3b571d9424 deleted and replaced by tablet 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:55:02.038688 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet a28289e1e5334512b2240c3b571d9424 with delete_type TABLET_DATA_DELETED (replaced by tablet 0215ff355fce46b5a4cf1bf4bd7164f3) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:02.039618 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet bf500ddc89754110be1cacf9d4289090 (table default.Table_f9872d0312584944b7732038b2ae68ed [id=6a65bee750c2458a8ac47914928e1b43]) successfully deleted
I20251215 14:55:02.040603 9019 tablet_service.cc:1552] Processing DeleteTablet for tablet a28289e1e5334512b2240c3b571d9424 with delete_type TABLET_DATA_DELETED (replaced by tablet 0215ff355fce46b5a4cf1bf4bd7164f3) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:02.041216 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 2df2138e41844e9f897e57264b62cc9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df2138e41844e9f897e57264b62cc9d already in progress: creating tablet
I20251215 14:55:02.042369 9427 tablet_bootstrap.cc:492] T cbf290c214374f619d5a09b12872b5c0 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:02.042544 9427 ts_tablet_manager.cc:1403] T cbf290c214374f619d5a09b12872b5c0 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.005s
I20251215 14:55:02.043668 8856 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 9bd8d964650a49b08093608abf3e31fa
I20251215 14:55:02.044116 8856 catalog_manager.cc:6724] ReplaceTablet: tablet 9bd8d964650a49b08093608abf3e31fa deleted and replaced by tablet c00aecc23c6541cbae4abd7cb1b3077b
I20251215 14:55:02.044544 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet 9bd8d964650a49b08093608abf3e31fa with delete_type TABLET_DATA_DELETED (replaced by tablet c00aecc23c6541cbae4abd7cb1b3077b) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:02.044898 9427 raft_consensus.cc:359] T cbf290c214374f619d5a09b12872b5c0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.045081 9427 raft_consensus.cc:385] T cbf290c214374f619d5a09b12872b5c0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.045171 9427 raft_consensus.cc:740] T cbf290c214374f619d5a09b12872b5c0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.045504 9427 consensus_queue.cc:260] T cbf290c214374f619d5a09b12872b5c0 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.045792 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 9bd8d964650a49b08093608abf3e31fa with delete_type TABLET_DATA_DELETED (replaced by tablet c00aecc23c6541cbae4abd7cb1b3077b) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:02.046381 8856 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_98e186c6949a42f7b3a19ee37eb53ad9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.046967 8856 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98e186c6949a42f7b3a19ee37eb53ad9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.048324 9427 ts_tablet_manager.cc:1434] T cbf290c214374f619d5a09b12872b5c0 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20251215 14:55:02.049347 9427 tablet_bootstrap.cc:492] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:02.051056 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet a28289e1e5334512b2240c3b571d9424 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a28289e1e5334512b2240c3b571d9424 already in progress: creating tablet
W20251215 14:55:02.051308 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet a28289e1e5334512b2240c3b571d9424 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a28289e1e5334512b2240c3b571d9424 already in progress: creating tablet
I20251215 14:55:02.051523 9290 tablet_service.cc:1505] Processing CreateTablet for tablet 813cfeea5399457e91623fb3abf9fd32 (DEFAULT_TABLE table=default.Table_c4412f55395440a585a59f6946511436 [id=e24cda78e15f4f63a89495c42e9c8ab4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.051990 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813cfeea5399457e91623fb3abf9fd32. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:02.052006 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 9bd8d964650a49b08093608abf3e31fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bd8d964650a49b08093608abf3e31fa already in progress: creating tablet
I20251215 14:55:02.053860 9427 tablet_bootstrap.cc:654] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:02.058847 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 9bd8d964650a49b08093608abf3e31fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bd8d964650a49b08093608abf3e31fa already in progress: creating tablet
I20251215 14:55:02.059540 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet cbf290c214374f619d5a09b12872b5c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:01 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:02.059831 9431 tablet_replica.cc:333] T cbf290c214374f619d5a09b12872b5c0 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:02.060034 9431 raft_consensus.cc:2243] T cbf290c214374f619d5a09b12872b5c0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:02.060102 9426 ts_tablet_manager.cc:1434] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.021s user 0.002s sys 0.000s
I20251215 14:55:02.060209 9431 raft_consensus.cc:2272] T cbf290c214374f619d5a09b12872b5c0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:02.060443 9154 tablet_service.cc:1552] Processing DeleteTablet for tablet a28289e1e5334512b2240c3b571d9424 with delete_type TABLET_DATA_DELETED (replaced by tablet 0215ff355fce46b5a4cf1bf4bd7164f3) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:02.060801 9426 tablet_bootstrap.cc:492] T 7c9141d604c34314a462b892076b7224 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:02.060810 9431 ts_tablet_manager.cc:1916] T cbf290c214374f619d5a09b12872b5c0 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:02.060127 9157 tablet_service.cc:1505] Processing CreateTablet for tablet b329b0abcad742ff94c1a62a72d1b673 (DEFAULT_TABLE table=default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e [id=6b4b04bb03f04a8a9cd7bc893acf612c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.061650 9155 tablet_service.cc:1552] Processing DeleteTablet for tablet 9bd8d964650a49b08093608abf3e31fa with delete_type TABLET_DATA_DELETED (replaced by tablet c00aecc23c6541cbae4abd7cb1b3077b) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:02.065739 9430 ts_tablet_manager.cc:1916] T cbf290c214374f619d5a09b12872b5c0 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:02.065932 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 813cfeea5399457e91623fb3abf9fd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.066598 9431 ts_tablet_manager.cc:1929] T cbf290c214374f619d5a09b12872b5c0 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:02.066720 9431 log.cc:1199] T cbf290c214374f619d5a09b12872b5c0 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/cbf290c214374f619d5a09b12872b5c0
I20251215 14:55:02.067018 9431 ts_tablet_manager.cc:1950] T cbf290c214374f619d5a09b12872b5c0 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:02.069556 9427 tablet_bootstrap.cc:492] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:02.069571 9426 tablet_bootstrap.cc:654] T 7c9141d604c34314a462b892076b7224 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.069696 9427 ts_tablet_manager.cc:1403] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.007s
I20251215 14:55:02.069685 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet cbf290c214374f619d5a09b12872b5c0 (table default.Table_4437875587ce4e46a16cd8154d6ccc6b [id=beb4a6485efb47f889e1e3ae24167c9a]) successfully deleted
I20251215 14:55:02.069950 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b329b0abcad742ff94c1a62a72d1b673. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.070173 9158 tablet_service.cc:1505] Processing CreateTablet for tablet e6aad8bed15a416a925ae8c8870d4e51 (DEFAULT_TABLE table=default.Table_c70c9ed917ff443198b26d639be549fa [id=475675db74e8401c9c822c7a846fe217]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.070365 9427 raft_consensus.cc:359] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.070544 9427 raft_consensus.cc:385] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.070607 9427 raft_consensus.cc:740] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.070829 9427 consensus_queue.cc:260] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.071234 8859 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 8612ebb3fc3c4554be4b881a60ad6fd4 (table default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6]). Expected version 2 got 0
I20251215 14:55:02.073096 9427 ts_tablet_manager.cc:1434] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20251215 14:55:02.074146 9427 tablet_bootstrap.cc:492] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:02.074133 8859 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 8612ebb3fc3c4554be4b881a60ad6fd4 (table default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6]). Expected version 2 got 0
I20251215 14:55:02.076097 9427 tablet_bootstrap.cc:654] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.076205 9155 tablet_service.cc:1505] Processing CreateTablet for tablet fc9bda52c73e4aa6b7e2eb008c63391b (DEFAULT_TABLE table=default.Table_941fe7b7ed49404ba3712230e2ccdbf4 [id=d0f601c09d8645db87784b72e4f2f962]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.076581 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc9bda52c73e4aa6b7e2eb008c63391b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.076714 8859 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 8612ebb3fc3c4554be4b881a60ad6fd4 (table default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6]). Expected version 2 got 0
I20251215 14:55:02.077234 8857 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 8612ebb3fc3c4554be4b881a60ad6fd4 (table default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6]). Expected version 2 got 0
I20251215 14:55:02.077574 8856 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_55ea1e683a2d497caae977ff05d734d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.078114 8856 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55ea1e683a2d497caae977ff05d734d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.078295 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6aad8bed15a416a925ae8c8870d4e51. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.078902 9427 tablet_bootstrap.cc:492] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:02.079034 9427 ts_tablet_manager.cc:1403] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20251215 14:55:02.079774 9427 raft_consensus.cc:359] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.079950 9427 raft_consensus.cc:385] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.080045 9427 raft_consensus.cc:740] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.080629 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_8c028f23aaf4428fab6a375c292e49b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:02.080900 8858 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_c1c8e8e6871048b6960ce0f9cbc46fb8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.081156 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c028f23aaf4428fab6a375c292e49b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:02.081461 8858 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1c8e8e6871048b6960ce0f9cbc46fb8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.081921 9290 tablet_service.cc:1505] Processing CreateTablet for tablet fc9bda52c73e4aa6b7e2eb008c63391b (DEFAULT_TABLE table=default.Table_941fe7b7ed49404ba3712230e2ccdbf4 [id=d0f601c09d8645db87784b72e4f2f962]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.082341 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc9bda52c73e4aa6b7e2eb008c63391b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.082365 9018 tablet_service.cc:1505] Processing CreateTablet for tablet fc9bda52c73e4aa6b7e2eb008c63391b (DEFAULT_TABLE table=default.Table_941fe7b7ed49404ba3712230e2ccdbf4 [id=d0f601c09d8645db87784b72e4f2f962]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.082511 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_a81ecb9c418b400b979ab32fd274f8e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:02.082696 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc9bda52c73e4aa6b7e2eb008c63391b. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:02.082923 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a81ecb9c418b400b979ab32fd274f8e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.086655 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_61baffeb220d48de886fb374be968b11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.087154 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61baffeb220d48de886fb374be968b11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.080284 9427 consensus_queue.cc:260] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.088660 9427 ts_tablet_manager.cc:1434] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20251215 14:55:02.088913 9427 tablet_bootstrap.cc:492] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:02.090626 9427 tablet_bootstrap.cc:654] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.090729 8855 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 88c8499633f4417e9f6d2d6372f157c4 (table default.Table_74b3f3255fd84cc99612cdb3dfe5b88d [id=b16ae3d8bb2a40eda9602301a2a2dc2e]). Expected version 2 got 0
I20251215 14:55:02.100744 9435 tablet_bootstrap.cc:492] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:02.100952 9435 ts_tablet_manager.cc:1403] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.099s user 0.010s sys 0.009s
I20251215 14:55:02.101740 9435 raft_consensus.cc:359] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.101987 9435 raft_consensus.cc:385] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.102063 9435 raft_consensus.cc:740] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.102342 9435 consensus_queue.cc:260] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.104012 8855 master_service.cc:954] ReplaceTablet: received request to replace tablet f9695d47e35448fdad95ff3f24bafd03 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:02.105376 9435 ts_tablet_manager.cc:1434] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:02.105727 8854 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 88c8499633f4417e9f6d2d6372f157c4 (table default.Table_74b3f3255fd84cc99612cdb3dfe5b88d [id=b16ae3d8bb2a40eda9602301a2a2dc2e]). Expected version 2 got 0
I20251215 14:55:02.106503 9435 tablet_bootstrap.cc:492] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:02.108289 9435 tablet_bootstrap.cc:654] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.109769 8854 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 88c8499633f4417e9f6d2d6372f157c4 (table default.Table_74b3f3255fd84cc99612cdb3dfe5b88d [id=b16ae3d8bb2a40eda9602301a2a2dc2e]). Expected version 2 got 0
I20251215 14:55:02.114372 9430 ts_tablet_manager.cc:1929] T cbf290c214374f619d5a09b12872b5c0 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:02.114521 9430 log.cc:1199] T cbf290c214374f619d5a09b12872b5c0 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/cbf290c214374f619d5a09b12872b5c0
I20251215 14:55:02.115099 9430 ts_tablet_manager.cc:1950] T cbf290c214374f619d5a09b12872b5c0 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:02.116046 9430 tablet_replica.cc:333] T e420bc0a9c384e349a66d3eb8fb915d2 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:02.116423 9430 raft_consensus.cc:2243] T e420bc0a9c384e349a66d3eb8fb915d2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:02.116598 9430 raft_consensus.cc:2272] T e420bc0a9c384e349a66d3eb8fb915d2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:02.119385 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet cbf290c214374f619d5a09b12872b5c0 (table default.Table_4437875587ce4e46a16cd8154d6ccc6b [id=beb4a6485efb47f889e1e3ae24167c9a]) successfully deleted
I20251215 14:55:02.119732 9430 ts_tablet_manager.cc:1916] T e420bc0a9c384e349a66d3eb8fb915d2 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:02.122846 9426 tablet_bootstrap.cc:492] T 7c9141d604c34314a462b892076b7224 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:02.123059 9426 ts_tablet_manager.cc:1403] T 7c9141d604c34314a462b892076b7224 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.063s user 0.010s sys 0.012s
I20251215 14:55:02.125097 9426 raft_consensus.cc:359] T 7c9141d604c34314a462b892076b7224 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.125298 9426 raft_consensus.cc:385] T 7c9141d604c34314a462b892076b7224 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.125387 9426 raft_consensus.cc:740] T 7c9141d604c34314a462b892076b7224 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.129920 9426 consensus_queue.cc:260] T 7c9141d604c34314a462b892076b7224 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.130507 9426 ts_tablet_manager.cc:1434] T 7c9141d604c34314a462b892076b7224 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20251215 14:55:02.130784 9426 tablet_bootstrap.cc:492] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:02.137091 9430 ts_tablet_manager.cc:1929] T e420bc0a9c384e349a66d3eb8fb915d2 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:02.137235 9430 log.cc:1199] T e420bc0a9c384e349a66d3eb8fb915d2 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/e420bc0a9c384e349a66d3eb8fb915d2
I20251215 14:55:02.137530 9430 ts_tablet_manager.cc:1950] T e420bc0a9c384e349a66d3eb8fb915d2 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:02.138463 9426 tablet_bootstrap.cc:654] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.139449 8855 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet f9695d47e35448fdad95ff3f24bafd03
W20251215 14:55:02.139427 9090 tablet.cc:2378] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251215 14:55:02.140285 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet f9695d47e35448fdad95ff3f24bafd03 with delete_type TABLET_DATA_DELETED (replaced by tablet f9411030d08d40aabbdee6670ba95821) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:02.140360 8855 catalog_manager.cc:6724] ReplaceTablet: tablet f9695d47e35448fdad95ff3f24bafd03 deleted and replaced by tablet f9411030d08d40aabbdee6670ba95821
I20251215 14:55:02.140640 9427 tablet_bootstrap.cc:492] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:02.140813 9427 ts_tablet_manager.cc:1403] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.052s user 0.012s sys 0.019s
W20251215 14:55:02.140990 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet f9695d47e35448fdad95ff3f24bafd03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9695d47e35448fdad95ff3f24bafd03 already in progress: creating tablet
I20251215 14:55:02.142174 9427 raft_consensus.cc:359] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.142419 9427 raft_consensus.cc:385] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.142495 9427 raft_consensus.cc:740] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.142969 9427 consensus_queue.cc:260] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.143581 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet f9695d47e35448fdad95ff3f24bafd03 with delete_type TABLET_DATA_DELETED (replaced by tablet f9411030d08d40aabbdee6670ba95821) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:02.144057 9441 raft_consensus.cc:493] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:02.144313 9441 raft_consensus.cc:515] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.145313 9427 ts_tablet_manager.cc:1434] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:02.145776 9427 tablet_bootstrap.cc:492] T 7c9141d604c34314a462b892076b7224 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:02.146193 9441 leader_election.cc:290] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:02.148021 9426 tablet_bootstrap.cc:492] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:02.148190 9426 ts_tablet_manager.cc:1403] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20251215 14:55:02.148991 9426 raft_consensus.cc:359] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.149197 9426 raft_consensus.cc:385] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.149276 9426 raft_consensus.cc:740] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.149499 9426 consensus_queue.cc:260] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.149966 9426 ts_tablet_manager.cc:1434] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:02.150291 9426 tablet_bootstrap.cc:492] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:02.151954 9426 tablet_bootstrap.cc:654] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.152222 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet e420bc0a9c384e349a66d3eb8fb915d2 (table default.Table_6326587168434469983b7215bb514379 [id=b77dd33e03384d6dadf621ad29c6d9e2]) successfully deleted
I20251215 14:55:02.152956 9430 tablet_replica.cc:333] T 7c9141d604c34314a462b892076b7224 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:02.153139 9430 raft_consensus.cc:2243] T 7c9141d604c34314a462b892076b7224 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:02.153326 9430 raft_consensus.cc:2272] T 7c9141d604c34314a462b892076b7224 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:02.154063 9430 ts_tablet_manager.cc:1916] T 7c9141d604c34314a462b892076b7224 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:02.154649 9426 tablet_bootstrap.cc:492] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:02.154784 9426 ts_tablet_manager.cc:1403] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20251215 14:55:02.155565 9426 raft_consensus.cc:359] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.155823 9426 raft_consensus.cc:385] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.155913 9426 raft_consensus.cc:740] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.156109 9426 consensus_queue.cc:260] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.156533 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet f9695d47e35448fdad95ff3f24bafd03 with delete_type TABLET_DATA_DELETED (replaced by tablet f9411030d08d40aabbdee6670ba95821) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:02.156841 9427 tablet_bootstrap.cc:654] T 7c9141d604c34314a462b892076b7224 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.161151 9426 ts_tablet_manager.cc:1434] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
W20251215 14:55:02.154098 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
I20251215 14:55:02.162217 9426 tablet_bootstrap.cc:492] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:02.163887 9426 tablet_bootstrap.cc:654] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.165086 8858 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_1b120f732d6f48df8e98a87733a029e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.165653 8858 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b120f732d6f48df8e98a87733a029e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.166430 9435 tablet_bootstrap.cc:492] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:02.166567 9435 ts_tablet_manager.cc:1403] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.060s user 0.010s sys 0.018s
I20251215 14:55:02.166822 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_d696eb5b3b9a4d28bbf543c3d3fc864c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.167327 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d696eb5b3b9a4d28bbf543c3d3fc864c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.167356 9435 raft_consensus.cc:359] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.167537 9435 raft_consensus.cc:385] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.167615 9435 raft_consensus.cc:740] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.168644 8857 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_74b3f3255fd84cc99612cdb3dfe5b88d" } new_table_name: "default.Table_ae411cdd8f1740839d5490d643672e18" modify_external_catalogs: true
I20251215 14:55:02.169761 9430 ts_tablet_manager.cc:1929] T 7c9141d604c34314a462b892076b7224 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:02.169708 8856 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_1a7f5cc65c6a418fbd14c863e2466e89"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:02.169880 9430 log.cc:1199] T 7c9141d604c34314a462b892076b7224 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/7c9141d604c34314a462b892076b7224
W20251215 14:55:02.170122 8856 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1a7f5cc65c6a418fbd14c863e2466e89 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.170258 9430 ts_tablet_manager.cc:1950] T 7c9141d604c34314a462b892076b7224 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:02.171536 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_a1b2cadb20a14680bfb8456db86d864b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:02.171633 9435 consensus_queue.cc:260] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:02.171986 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1b2cadb20a14680bfb8456db86d864b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.173023 8854 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_941fe7b7ed49404ba3712230e2ccdbf4" } new_table_name: "default.Table_80272842fed445368d8dfdaf625e4c9e" modify_external_catalogs: true
I20251215 14:55:02.174636 8855 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_580cff1ea5174c8d8e8ee2a76346c2e5" } new_table_name: "default.Table_4372b5372fdf4a0d991207a20dcbca19" modify_external_catalogs: true
I20251215 14:55:02.174712 9435 ts_tablet_manager.cc:1434] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20251215 14:55:02.175026 9435 tablet_bootstrap.cc:492] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:02.176828 9435 tablet_bootstrap.cc:654] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.178745 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 7c9141d604c34314a462b892076b7224 (table default.Table_5150978dc817409084ef9ea8c442b55a [id=82454c5953454b9199c7432010c3b3d2]) successfully deleted
W20251215 14:55:02.179047 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 26648bf286c94b2495e565969f945858 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26648bf286c94b2495e565969f945858 already in progress: creating tablet
W20251215 14:55:02.179353 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 4f1f902cbcb643b9b98fa3d72babba79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f1f902cbcb643b9b98fa3d72babba79 already in progress: creating tablet
W20251215 14:55:02.188091 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 80d4c9b533ac4facb4205aff84903134 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 80d4c9b533ac4facb4205aff84903134 already in progress: creating tablet
W20251215 14:55:02.189364 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet bdfc164128a6413a83d83d05b69fb74a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bdfc164128a6413a83d83d05b69fb74a already in progress: creating tablet
I20251215 14:55:02.190462 8853 master_service.cc:954] ReplaceTablet: received request to replace tablet 11a5a6a0895c49648c910fa2ea3ca373 from {username='slave'} at 127.0.0.1:34038
W20251215 14:55:02.191955 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 2df2138e41844e9f897e57264b62cc9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2df2138e41844e9f897e57264b62cc9d already in progress: creating tablet
I20251215 14:55:02.195604 9435 tablet_bootstrap.cc:492] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:02.195775 9435 ts_tablet_manager.cc:1403] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20251215 14:55:02.196597 9435 raft_consensus.cc:359] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.196815 9435 raft_consensus.cc:385] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.196897 9435 raft_consensus.cc:740] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.197144 9435 consensus_queue.cc:260] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.197616 9435 ts_tablet_manager.cc:1434] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:02.197966 9435 tablet_bootstrap.cc:492] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:02.199625 9435 tablet_bootstrap.cc:654] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.204062 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8612ebb3fc3c4554be4b881a60ad6fd4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:02.204526 9180 raft_consensus.cc:2468] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:02.205148 9249 leader_election.cc:304] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:02.205607 9441 raft_consensus.cc:2804] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:02.205765 9441 raft_consensus.cc:493] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:02.205854 9441 raft_consensus.cc:3060] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:02.192384 8851 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_40f2cfc11d6749ea8c11ae2c03b66d4c" } new_table_name: "default.Table_b5df39fee38d439b9ba457db54ec272b" modify_external_catalogs: true
I20251215 14:55:02.192727 8852 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_61baffeb220d48de886fb374be968b11" } new_table_name: "default.Table_f416fea67a974ab084b7b48a60426131" modify_external_catalogs: true
I20251215 14:55:02.201503 8858 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_f466f52dcdb54303893bb61ccaaf1c31" } modify_external_catalogs: true
I20251215 14:55:02.208995 9441 raft_consensus.cc:515] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.209211 8858 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_f466f52dcdb54303893bb61ccaaf1c31" } modify_external_catalogs: true
I20251215 14:55:02.210644 8678 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
/tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.121.190:44279
--webserver_interface=127.8.121.190
--webserver_port=40239
--builtin_ntp_servers=127.8.121.148:35915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20251215 14:55:02.210666 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet a28289e1e5334512b2240c3b571d9424 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a28289e1e5334512b2240c3b571d9424 already in progress: creating tablet
W20251215 14:55:02.211455 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 9bd8d964650a49b08093608abf3e31fa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bd8d964650a49b08093608abf3e31fa already in progress: creating tablet
W20251215 14:55:02.211756 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet f9695d47e35448fdad95ff3f24bafd03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9695d47e35448fdad95ff3f24bafd03 already in progress: creating tablet
I20251215 14:55:02.217305 9441 leader_election.cc:290] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:02.218209 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8612ebb3fc3c4554be4b881a60ad6fd4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:02.218457 9180 raft_consensus.cc:3060] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:02.191226 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet f9695d47e35448fdad95ff3f24bafd03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9695d47e35448fdad95ff3f24bafd03 already in progress: creating tablet
W20251215 14:55:02.228042 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 9bd8d964650a49b08093608abf3e31fa (table default.Table_580cff1ea5174c8d8e8ee2a76346c2e5 [id=640d70bd78554e92823dc104e06227d3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9bd8d964650a49b08093608abf3e31fa consensus state has no leader
I20251215 14:55:02.228782 9180 raft_consensus.cc:2468] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
W20251215 14:55:02.231663 8857 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 88c8499633f4417e9f6d2d6372f157c4 consensus state has no leader
W20251215 14:55:02.232494 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
I20251215 14:55:02.233603 8857 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 88c8499633f4417e9f6d2d6372f157c4 (table default.Table_ae411cdd8f1740839d5490d643672e18 [id=b16ae3d8bb2a40eda9602301a2a2dc2e]). Expected version 3 got 0
I20251215 14:55:02.234450 8857 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_98e186c6949a42f7b3a19ee37eb53ad9" } modify_external_catalogs: true
I20251215 14:55:02.234651 8857 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_98e186c6949a42f7b3a19ee37eb53ad9" } modify_external_catalogs: true
I20251215 14:55:02.235533 9249 leader_election.cc:304] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:02.235795 8856 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_a81ecb9c418b400b979ab32fd274f8e4" } modify_external_catalogs: true
I20251215 14:55:02.235906 9441 raft_consensus.cc:2804] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:02.235983 8856 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_a81ecb9c418b400b979ab32fd274f8e4" } modify_external_catalogs: true
I20251215 14:55:02.237389 8850 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_73e20d74a96b419fa4b1f7987a0f3ed5" } modify_external_catalogs: true
I20251215 14:55:02.237529 8850 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_73e20d74a96b419fa4b1f7987a0f3ed5" } modify_external_catalogs: true
W20251215 14:55:02.238929 8854 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc9bda52c73e4aa6b7e2eb008c63391b consensus state has no leader
I20251215 14:55:02.239293 8854 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_c70c9ed917ff443198b26d639be549fa" } modify_external_catalogs: true
I20251215 14:55:02.239451 8854 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_c70c9ed917ff443198b26d639be549fa" } modify_external_catalogs: true
I20251215 14:55:02.241567 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8612ebb3fc3c4554be4b881a60ad6fd4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:02.241932 9042 raft_consensus.cc:2468] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
W20251215 14:55:02.242381 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
I20251215 14:55:02.253842 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8612ebb3fc3c4554be4b881a60ad6fd4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:02.254151 9042 raft_consensus.cc:3060] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:02.255726 8855 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c00aecc23c6541cbae4abd7cb1b3077b has no consensus state
I20251215 14:55:02.256013 8855 master_service.cc:954] ReplaceTablet: received request to replace tablet 2df2138e41844e9f897e57264b62cc9d from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:02.257721 8855 master_service.cc:954] ReplaceTablet: received request to replace tablet 11a5a6a0895c49648c910fa2ea3ca373 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:02.257822 9042 raft_consensus.cc:2468] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:02.262492 9489 raft_consensus.cc:493] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:02.262780 9489 raft_consensus.cc:515] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.264309 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42ee36f017f44890aa7419e642abdc9b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:02.265069 9249 leader_election.cc:343] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:02.266031 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42ee36f017f44890aa7419e642abdc9b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:02.267128 9248 leader_election.cc:343] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:02.268965 9248 leader_election.cc:304] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:02.269660 9488 raft_consensus.cc:2749] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:02.272101 8853 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 11a5a6a0895c49648c910fa2ea3ca373
I20251215 14:55:02.272614 8853 catalog_manager.cc:6724] ReplaceTablet: tablet 11a5a6a0895c49648c910fa2ea3ca373 deleted and replaced by tablet b03c5e1f44d34798b4d0dce88f951581
I20251215 14:55:02.272842 8853 master_service.cc:954] ReplaceTablet: received request to replace tablet b2d65d8d32cc4ea19ddc4bbaf5291820 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:02.273612 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet 11a5a6a0895c49648c910fa2ea3ca373 with delete_type TABLET_DATA_DELETED (replaced by tablet b03c5e1f44d34798b4d0dce88f951581) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:02.274377 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 11a5a6a0895c49648c910fa2ea3ca373 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11a5a6a0895c49648c910fa2ea3ca373 already in progress: creating tablet
I20251215 14:55:02.275265 9489 leader_election.cc:290] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:02.277989 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 11a5a6a0895c49648c910fa2ea3ca373 with delete_type TABLET_DATA_DELETED (replaced by tablet b03c5e1f44d34798b4d0dce88f951581) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:02.278615 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet 11a5a6a0895c49648c910fa2ea3ca373 with delete_type TABLET_DATA_DELETED (replaced by tablet b03c5e1f44d34798b4d0dce88f951581) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:02.279361 9441 raft_consensus.cc:697] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
W20251215 14:55:02.279760 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 11a5a6a0895c49648c910fa2ea3ca373 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11a5a6a0895c49648c910fa2ea3ca373 already in progress: creating tablet
I20251215 14:55:02.279855 9441 consensus_queue.cc:237] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:02.280246 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 11a5a6a0895c49648c910fa2ea3ca373 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 11a5a6a0895c49648c910fa2ea3ca373 already in progress: creating tablet
I20251215 14:55:02.280994 8855 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_ece44e44ff964192893318b9b02f5b95"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.281808 8855 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ece44e44ff964192893318b9b02f5b95 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.284373 9426 tablet_bootstrap.cc:492] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:02.284564 9426 ts_tablet_manager.cc:1403] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.122s user 0.034s sys 0.022s
I20251215 14:55:02.284798 9427 tablet_bootstrap.cc:492] T 7c9141d604c34314a462b892076b7224 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:02.284947 9427 ts_tablet_manager.cc:1403] T 7c9141d604c34314a462b892076b7224 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.139s user 0.027s sys 0.064s
I20251215 14:55:02.285410 9426 raft_consensus.cc:359] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.285629 9426 raft_consensus.cc:385] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.285712 9426 raft_consensus.cc:740] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.285661 9427 raft_consensus.cc:359] T 7c9141d604c34314a462b892076b7224 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.285826 9427 raft_consensus.cc:385] T 7c9141d604c34314a462b892076b7224 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.285914 9427 raft_consensus.cc:740] T 7c9141d604c34314a462b892076b7224 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.286094 9426 consensus_queue.cc:260] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.286159 9427 consensus_queue.cc:260] T 7c9141d604c34314a462b892076b7224 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.289150 9426 ts_tablet_manager.cc:1434] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20251215 14:55:02.289420 9427 ts_tablet_manager.cc:1434] T 7c9141d604c34314a462b892076b7224 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:02.290585 9427 tablet_bootstrap.cc:492] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:02.292476 9435 tablet_bootstrap.cc:492] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
W20251215 14:55:02.292650 8851 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42ee36f017f44890aa7419e642abdc9b consensus state has no leader
I20251215 14:55:02.293656 9435 ts_tablet_manager.cc:1403] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.096s user 0.015s sys 0.027s
W20251215 14:55:02.294412 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
I20251215 14:55:02.294457 9435 raft_consensus.cc:359] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.294656 9435 raft_consensus.cc:385] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.294762 9435 raft_consensus.cc:740] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.294934 9426 tablet_bootstrap.cc:492] T a28289e1e5334512b2240c3b571d9424 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:02.294977 9435 consensus_queue.cc:260] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.296564 9426 tablet_bootstrap.cc:654] T a28289e1e5334512b2240c3b571d9424 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:02.296604 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
I20251215 14:55:02.296937 9435 ts_tablet_manager.cc:1434] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:02.297237 9435 tablet_bootstrap.cc:492] T b2d65d8d32cc4ea19ddc4bbaf5291820 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:02.299027 9435 tablet_bootstrap.cc:654] T b2d65d8d32cc4ea19ddc4bbaf5291820 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.300026 9427 tablet_bootstrap.cc:654] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.304265 8859 catalog_manager.cc:5654] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e89303a500544272b601d7c29be802b4 (127.8.121.131). New cstate: current_term: 1 leader_uuid: "e89303a500544272b601d7c29be802b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: HEALTHY } } }
I20251215 14:55:02.305025 8859 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 8612ebb3fc3c4554be4b881a60ad6fd4 (table default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6]). Expected version 2 got 0
I20251215 14:55:02.307713 9426 tablet_bootstrap.cc:492] T a28289e1e5334512b2240c3b571d9424 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:02.307874 9426 ts_tablet_manager.cc:1403] T a28289e1e5334512b2240c3b571d9424 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20251215 14:55:02.308671 9426 raft_consensus.cc:359] T a28289e1e5334512b2240c3b571d9424 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.308890 9426 raft_consensus.cc:385] T a28289e1e5334512b2240c3b571d9424 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.308977 9426 raft_consensus.cc:740] T a28289e1e5334512b2240c3b571d9424 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.309223 9426 consensus_queue.cc:260] T a28289e1e5334512b2240c3b571d9424 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:02.311077 8852 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 32432afc6e8d458bb7ed7abc42fb3dde has no consensus state
I20251215 14:55:02.312165 8850 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 44bd51f9bf77492b8890fc7c8411c887
I20251215 14:55:02.312638 9426 ts_tablet_manager.cc:1434] T a28289e1e5334512b2240c3b571d9424 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20251215 14:55:02.313431 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet 44bd51f9bf77492b8890fc7c8411c887 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:02.313511 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 44bd51f9bf77492b8890fc7c8411c887 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:54874
W20251215 14:55:02.314079 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 44bd51f9bf77492b8890fc7c8411c887 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44bd51f9bf77492b8890fc7c8411c887 already in progress: creating tablet
I20251215 14:55:02.314081 8858 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 924c9dd0cd9d40189bfe1457040f3d37
I20251215 14:55:02.314730 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet 44bd51f9bf77492b8890fc7c8411c887 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:02.315277 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 44bd51f9bf77492b8890fc7c8411c887 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44bd51f9bf77492b8890fc7c8411c887 already in progress: creating tablet
I20251215 14:55:02.315368 8856 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 1ba2d719a37440c28c976d41f940e0e4
I20251215 14:55:02.315780 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet 924c9dd0cd9d40189bfe1457040f3d37 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:02.315822 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 44bd51f9bf77492b8890fc7c8411c887 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 44bd51f9bf77492b8890fc7c8411c887 already in progress: creating tablet
I20251215 14:55:02.315887 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet 924c9dd0cd9d40189bfe1457040f3d37 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:02.316480 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 924c9dd0cd9d40189bfe1457040f3d37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 924c9dd0cd9d40189bfe1457040f3d37 already in progress: creating tablet
I20251215 14:55:02.316818 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 924c9dd0cd9d40189bfe1457040f3d37 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:54874
W20251215 14:55:02.317633 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 924c9dd0cd9d40189bfe1457040f3d37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 924c9dd0cd9d40189bfe1457040f3d37 already in progress: creating tablet
W20251215 14:55:02.317927 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 924c9dd0cd9d40189bfe1457040f3d37 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 924c9dd0cd9d40189bfe1457040f3d37 already in progress: creating tablet
I20251215 14:55:02.319628 9426 tablet_bootstrap.cc:492] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:02.321364 8854 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet e6aad8bed15a416a925ae8c8870d4e51
I20251215 14:55:02.322016 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet e6aad8bed15a416a925ae8c8870d4e51 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:02.322279 9426 tablet_bootstrap.cc:654] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.322520 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet e6aad8bed15a416a925ae8c8870d4e51 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:02.322980 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet e6aad8bed15a416a925ae8c8870d4e51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6aad8bed15a416a925ae8c8870d4e51 already in progress: creating tablet
I20251215 14:55:02.323441 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet e6aad8bed15a416a925ae8c8870d4e51 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:54874
W20251215 14:55:02.324062 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet e6aad8bed15a416a925ae8c8870d4e51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6aad8bed15a416a925ae8c8870d4e51 already in progress: creating tablet
W20251215 14:55:02.324345 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet e6aad8bed15a416a925ae8c8870d4e51 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6aad8bed15a416a925ae8c8870d4e51 already in progress: creating tablet
I20251215 14:55:02.331979 8857 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 2b28a4e1b2334bca953f0ca7c76d252c
I20251215 14:55:02.342854 9433 raft_consensus.cc:493] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:02.343060 9433 raft_consensus.cc:515] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.345091 9433 leader_election.cc:290] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:02.349052 8853 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet b2d65d8d32cc4ea19ddc4bbaf5291820
I20251215 14:55:02.349607 8853 catalog_manager.cc:6724] ReplaceTablet: tablet b2d65d8d32cc4ea19ddc4bbaf5291820 deleted and replaced by tablet 1141b9a4cf3e4aa78529bed7f0375ff8
I20251215 14:55:02.350168 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet b2d65d8d32cc4ea19ddc4bbaf5291820 with delete_type TABLET_DATA_DELETED (replaced by tablet 1141b9a4cf3e4aa78529bed7f0375ff8) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:02.350996 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet b2d65d8d32cc4ea19ddc4bbaf5291820 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2d65d8d32cc4ea19ddc4bbaf5291820 already in progress: creating tablet
I20251215 14:55:02.351534 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet b2d65d8d32cc4ea19ddc4bbaf5291820 with delete_type TABLET_DATA_DELETED (replaced by tablet 1141b9a4cf3e4aa78529bed7f0375ff8) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:02.351781 9430 tablet_replica.cc:333] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:02.352031 9430 raft_consensus.cc:2243] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:02.352211 9430 raft_consensus.cc:2272] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:02.353920 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet b2d65d8d32cc4ea19ddc4bbaf5291820 with delete_type TABLET_DATA_DELETED (replaced by tablet 1141b9a4cf3e4aa78529bed7f0375ff8) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:02.355945 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet b2d65d8d32cc4ea19ddc4bbaf5291820 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b2d65d8d32cc4ea19ddc4bbaf5291820 already in progress: creating tablet
I20251215 14:55:02.361550 9430 ts_tablet_manager.cc:1916] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:02.363611 8850 master_service.cc:954] ReplaceTablet: received request to replace tablet c0d0022e48f04b83ac1c998a83fe3f55 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:02.369637 9430 ts_tablet_manager.cc:1929] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:02.370065 9430 log.cc:1199] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/b2d65d8d32cc4ea19ddc4bbaf5291820
I20251215 14:55:02.371188 9430 ts_tablet_manager.cc:1950] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:02.372467 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet b2d65d8d32cc4ea19ddc4bbaf5291820 (table default.Table_5d92197d1765400c9f43536326cadebf [id=066e8ae14004436cb8b4f3f740b45b19]) successfully deleted
I20251215 14:55:02.374027 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_306b2bfc23214c618f695c55cca31974"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:02.374284 8856 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_78b33227a8994e23ad7f3be637d971c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.374730 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_306b2bfc23214c618f695c55cca31974 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:02.374776 8856 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78b33227a8994e23ad7f3be637d971c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.375412 8851 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_7fc4f71e01fa474594d5f0520e59e3f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.375861 8851 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fc4f71e01fa474594d5f0520e59e3f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.376951 8854 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_4a6a8f85c67347de8eb61c8ffd16abf1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.377367 8854 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a6a8f85c67347de8eb61c8ffd16abf1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.378820 9158 tablet_service.cc:1552] Processing DeleteTablet for tablet a28289e1e5334512b2240c3b571d9424 with delete_type TABLET_DATA_DELETED (replaced by tablet 0215ff355fce46b5a4cf1bf4bd7164f3) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:02.378821 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet b2d65d8d32cc4ea19ddc4bbaf5291820 with delete_type TABLET_DATA_DELETED (replaced by tablet 1141b9a4cf3e4aa78529bed7f0375ff8) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:02.379204 8853 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_cdef28a9eb234425846582441c49d740"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.379669 8853 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cdef28a9eb234425846582441c49d740 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.383344 9430 tablet_replica.cc:333] T a28289e1e5334512b2240c3b571d9424 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:02.383695 9435 tablet_bootstrap.cc:492] T b2d65d8d32cc4ea19ddc4bbaf5291820 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:02.383877 9435 ts_tablet_manager.cc:1403] T b2d65d8d32cc4ea19ddc4bbaf5291820 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.087s user 0.020s sys 0.006s
I20251215 14:55:02.384683 9435 raft_consensus.cc:359] T b2d65d8d32cc4ea19ddc4bbaf5291820 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.384912 9435 raft_consensus.cc:385] T b2d65d8d32cc4ea19ddc4bbaf5291820 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.384999 9435 raft_consensus.cc:740] T b2d65d8d32cc4ea19ddc4bbaf5291820 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.385253 9435 consensus_queue.cc:260] T b2d65d8d32cc4ea19ddc4bbaf5291820 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.385728 9435 ts_tablet_manager.cc:1434] T b2d65d8d32cc4ea19ddc4bbaf5291820 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:02.386584 9435 tablet_bootstrap.cc:492] T a28289e1e5334512b2240c3b571d9424 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:02.388389 9435 tablet_bootstrap.cc:654] T a28289e1e5334512b2240c3b571d9424 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.393774 9430 raft_consensus.cc:2243] T a28289e1e5334512b2240c3b571d9424 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:02.394081 9430 raft_consensus.cc:2272] T a28289e1e5334512b2240c3b571d9424 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:02.394484 9435 tablet_bootstrap.cc:492] T a28289e1e5334512b2240c3b571d9424 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:02.394646 9435 ts_tablet_manager.cc:1403] T a28289e1e5334512b2240c3b571d9424 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20251215 14:55:02.395545 9435 raft_consensus.cc:359] T a28289e1e5334512b2240c3b571d9424 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.395730 9435 raft_consensus.cc:385] T a28289e1e5334512b2240c3b571d9424 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.395824 9435 raft_consensus.cc:740] T a28289e1e5334512b2240c3b571d9424 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.396037 9435 consensus_queue.cc:260] T a28289e1e5334512b2240c3b571d9424 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.396545 9435 ts_tablet_manager.cc:1434] T a28289e1e5334512b2240c3b571d9424 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:02.397787 9435 tablet_bootstrap.cc:492] T f2aae2798eee4775afaa3afc59e98a6c P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:02.399498 9435 tablet_bootstrap.cc:654] T f2aae2798eee4775afaa3afc59e98a6c P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.403486 9430 ts_tablet_manager.cc:1916] T a28289e1e5334512b2240c3b571d9424 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:02.405232 8859 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 3670e4f699894059a3f09a33a744e9f9 (table default.Table_37b271542ee44db68c2370937f9daa7a [id=ebef5a7cb50445b9a84f9d458c3c7129]). Expected version 1 got 0
I20251215 14:55:02.407357 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet b2d65d8d32cc4ea19ddc4bbaf5291820 with delete_type TABLET_DATA_DELETED (replaced by tablet 1141b9a4cf3e4aa78529bed7f0375ff8) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:02.407411 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet a28289e1e5334512b2240c3b571d9424 with delete_type TABLET_DATA_DELETED (replaced by tablet 0215ff355fce46b5a4cf1bf4bd7164f3) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:02.407636 9432 tablet_replica.cc:333] T b2d65d8d32cc4ea19ddc4bbaf5291820 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:02.407801 9432 raft_consensus.cc:2243] T b2d65d8d32cc4ea19ddc4bbaf5291820 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:02.407979 9432 raft_consensus.cc:2272] T b2d65d8d32cc4ea19ddc4bbaf5291820 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:02.408725 9432 ts_tablet_manager.cc:1916] T b2d65d8d32cc4ea19ddc4bbaf5291820 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:02.415132 9432 ts_tablet_manager.cc:1929] T b2d65d8d32cc4ea19ddc4bbaf5291820 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:02.415416 9432 log.cc:1199] T b2d65d8d32cc4ea19ddc4bbaf5291820 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/b2d65d8d32cc4ea19ddc4bbaf5291820
I20251215 14:55:02.415887 9432 ts_tablet_manager.cc:1950] T b2d65d8d32cc4ea19ddc4bbaf5291820 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:02.417053 9432 tablet_replica.cc:333] T a28289e1e5334512b2240c3b571d9424 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:02.417330 9432 raft_consensus.cc:2243] T a28289e1e5334512b2240c3b571d9424 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:02.417335 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet b2d65d8d32cc4ea19ddc4bbaf5291820 (table default.Table_5d92197d1765400c9f43536326cadebf [id=066e8ae14004436cb8b4f3f740b45b19]) successfully deleted
I20251215 14:55:02.417584 9432 raft_consensus.cc:2272] T a28289e1e5334512b2240c3b571d9424 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:02.418756 9432 ts_tablet_manager.cc:1916] T a28289e1e5334512b2240c3b571d9424 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:02.427443 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88c8499633f4417e9f6d2d6372f157c4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:02.427706 9180 raft_consensus.cc:2468] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:02.428946 8976 leader_election.cc:304] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:02.429316 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_ba51add601044f619beba0a4377181e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:02.429497 9433 raft_consensus.cc:2804] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:02.429600 9433 raft_consensus.cc:493] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:02.429668 9433 raft_consensus.cc:3060] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:02.429960 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba51add601044f619beba0a4377181e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.432335 9433 raft_consensus.cc:515] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.433234 9433 leader_election.cc:290] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:02.433923 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88c8499633f4417e9f6d2d6372f157c4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:02.434115 9180 raft_consensus.cc:3060] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:02.437512 9180 raft_consensus.cc:2468] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:02.438097 8976 leader_election.cc:304] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:02.438468 9433 raft_consensus.cc:2804] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:02.446382 9433 raft_consensus.cc:697] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:02.446882 9433 consensus_queue.cc:237] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.456218 8854 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_5d92197d1765400c9f43536326cadebf" } new_table_name: "default.Table_385109da45d14eacb743f9b6540d33c1" modify_external_catalogs: true
I20251215 14:55:02.466873 9441 raft_consensus.cc:493] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:02.467103 9441 raft_consensus.cc:515] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.467644 9426 tablet_bootstrap.cc:492] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:02.467559 8851 catalog_manager.cc:5654] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129). New cstate: current_term: 1 leader_uuid: "67978ac4539d4b289e53f4eedd9a8156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:02.467798 9426 ts_tablet_manager.cc:1403] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.148s user 0.043s sys 0.091s
I20251215 14:55:02.467803 9441 leader_election.cc:290] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:02.467975 8851 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 88c8499633f4417e9f6d2d6372f157c4 (table default.Table_ae411cdd8f1740839d5490d643672e18 [id=b16ae3d8bb2a40eda9602301a2a2dc2e]). Expected version 3 got 0
I20251215 14:55:02.468415 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f233746b84a94c589eb96d6ef3a8281d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:02.468623 9180 raft_consensus.cc:2468] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:02.468569 9426 raft_consensus.cc:359] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.468753 9426 raft_consensus.cc:385] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.468811 9426 raft_consensus.cc:740] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.469040 9426 consensus_queue.cc:260] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.469099 9249 leader_election.cc:304] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:02.469475 9441 raft_consensus.cc:2804] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:02.469569 9441 raft_consensus.cc:493] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:02.469652 9441 raft_consensus.cc:3060] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:02.470571 9426 ts_tablet_manager.cc:1434] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20251215 14:55:02.470862 9426 tablet_bootstrap.cc:492] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:02.472142 9441 raft_consensus.cc:515] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.474510 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f233746b84a94c589eb96d6ef3a8281d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:02.474726 9180 raft_consensus.cc:3060] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:02.474716 8859 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 3670e4f699894059a3f09a33a744e9f9 (table default.Table_37b271542ee44db68c2370937f9daa7a [id=ebef5a7cb50445b9a84f9d458c3c7129]). Expected version 1 got 0
I20251215 14:55:02.474818 9430 ts_tablet_manager.cc:1929] T a28289e1e5334512b2240c3b571d9424 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:02.474937 9430 log.cc:1199] T a28289e1e5334512b2240c3b571d9424 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/a28289e1e5334512b2240c3b571d9424
I20251215 14:55:02.475379 9430 ts_tablet_manager.cc:1950] T a28289e1e5334512b2240c3b571d9424 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:02.477344 9426 tablet_bootstrap.cc:654] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.477645 9180 raft_consensus.cc:2468] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:02.478273 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet a28289e1e5334512b2240c3b571d9424 (table default.Table_28c03048db094b5093cd88eb3dc6f7fe [id=cf0e40d55af1486db1df4e85048a070b]) successfully deleted
W20251215 14:55:02.478554 8844 catalog_manager.cc:4952] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet b2d65d8d32cc4ea19ddc4bbaf5291820 because the tablet was not found. No further retry: Not found: Tablet not found: b2d65d8d32cc4ea19ddc4bbaf5291820
I20251215 14:55:02.480367 9249 leader_election.cc:304] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:02.480662 9489 raft_consensus.cc:2804] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:02.480798 9489 raft_consensus.cc:697] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:02.481063 9489 consensus_queue.cc:237] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.485735 8859 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 3670e4f699894059a3f09a33a744e9f9 (table default.Table_37b271542ee44db68c2370937f9daa7a [id=ebef5a7cb50445b9a84f9d458c3c7129]). Expected version 1 got 0
I20251215 14:55:02.487278 9488 raft_consensus.cc:493] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:02.487453 8854 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1141b9a4cf3e4aa78529bed7f0375ff8 has no consensus state
I20251215 14:55:02.487444 9488 raft_consensus.cc:515] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.488155 9488 leader_election.cc:290] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:02.495007 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88c8499633f4417e9f6d2d6372f157c4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:02.495471 9180 raft_consensus.cc:2393] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:02.496306 9441 leader_election.cc:290] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:02.496919 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88c8499633f4417e9f6d2d6372f157c4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:02.497162 9315 raft_consensus.cc:2468] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:02.497658 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88c8499633f4417e9f6d2d6372f157c4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:02.497839 9315 raft_consensus.cc:3060] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:02.501776 9315 raft_consensus.cc:2468] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:02.502722 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f233746b84a94c589eb96d6ef3a8281d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:02.502974 9042 raft_consensus.cc:2468] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:02.503839 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f233746b84a94c589eb96d6ef3a8281d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:02.504019 9042 raft_consensus.cc:3060] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:02.506721 9042 raft_consensus.cc:2468] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:02.508323 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88c8499633f4417e9f6d2d6372f157c4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:02.511277 9248 leader_election.cc:304] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:02.511631 9489 raft_consensus.cc:2749] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:02.512663 8851 catalog_manager.cc:5654] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e89303a500544272b601d7c29be802b4 (127.8.121.131). New cstate: current_term: 1 leader_uuid: "e89303a500544272b601d7c29be802b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:02.516189 9432 ts_tablet_manager.cc:1929] T a28289e1e5334512b2240c3b571d9424 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:02.516348 9432 log.cc:1199] T a28289e1e5334512b2240c3b571d9424 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/a28289e1e5334512b2240c3b571d9424
I20251215 14:55:02.516894 9432 ts_tablet_manager.cc:1950] T a28289e1e5334512b2240c3b571d9424 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:02.518417 8854 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_ee5a468c7e4544adbe4bf3c1c56049d8" } new_table_name: "default.Table_4d5807324a064aea839523ab764bcc06" modify_external_catalogs: true
I20251215 14:55:02.519119 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet a28289e1e5334512b2240c3b571d9424 (table default.Table_28c03048db094b5093cd88eb3dc6f7fe [id=cf0e40d55af1486db1df4e85048a070b]) successfully deleted
I20251215 14:55:02.522416 9435 tablet_bootstrap.cc:492] T f2aae2798eee4775afaa3afc59e98a6c P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:02.522586 9435 ts_tablet_manager.cc:1403] T f2aae2798eee4775afaa3afc59e98a6c P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.125s user 0.019s sys 0.029s
I20251215 14:55:02.523358 9435 raft_consensus.cc:359] T f2aae2798eee4775afaa3afc59e98a6c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.523545 9435 raft_consensus.cc:385] T f2aae2798eee4775afaa3afc59e98a6c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.523617 9435 raft_consensus.cc:740] T f2aae2798eee4775afaa3afc59e98a6c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.523844 9435 consensus_queue.cc:260] T f2aae2798eee4775afaa3afc59e98a6c P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.526108 9435 ts_tablet_manager.cc:1434] T f2aae2798eee4775afaa3afc59e98a6c P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:02.526458 9435 tablet_bootstrap.cc:492] T 26648bf286c94b2495e565969f945858 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:02.529570 9435 tablet_bootstrap.cc:654] T 26648bf286c94b2495e565969f945858 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:02.530301 8854 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c4f47c22111c427a8ab9c4ae1e105375 consensus state has no leader
W20251215 14:55:02.538942 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet f2aae2798eee4775afaa3afc59e98a6c
I20251215 14:55:02.540855 8859 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_1a7f5cc65c6a418fbd14c863e2466e89" } new_table_name: "default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b" modify_external_catalogs: true
I20251215 14:55:02.541000 8856 master_service.cc:954] ReplaceTablet: received request to replace tablet b329b0abcad742ff94c1a62a72d1b673 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:02.541465 8850 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_a1b2cadb20a14680bfb8456db86d864b" } new_table_name: "default.Table_5b7025739b9b4c3f97a21eb6d726c69c" modify_external_catalogs: true
I20251215 14:55:02.542383 8855 master_service.cc:954] ReplaceTablet: received request to replace tablet 92e21a77ad074572a57b836743903a0b from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:02.543512 8858 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_80272842fed445368d8dfdaf625e4c9e" } new_table_name: "default.Table_e30dfd7361ed4e4981bc438c89e644c3" modify_external_catalogs: true
I20251215 14:55:02.543730 8852 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_d696eb5b3b9a4d28bbf543c3d3fc864c" } modify_external_catalogs: true
I20251215 14:55:02.543926 8852 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_d696eb5b3b9a4d28bbf543c3d3fc864c" } modify_external_catalogs: true
I20251215 14:55:02.543538 8854 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_0c66ce7473b248f58f74dd76a8c48045"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:02.540859 8853 master_service.cc:954] ReplaceTablet: received request to replace tablet 26648bf286c94b2495e565969f945858 from {username='slave'} at 127.0.0.1:34038
W20251215 14:55:02.545435 8854 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c66ce7473b248f58f74dd76a8c48045 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.545686 8853 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_b5df39fee38d439b9ba457db54ec272b" } modify_external_catalogs: true
I20251215 14:55:02.545858 8853 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_b5df39fee38d439b9ba457db54ec272b" } modify_external_catalogs: true
I20251215 14:55:02.547236 9435 tablet_bootstrap.cc:492] T 26648bf286c94b2495e565969f945858 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:02.548161 9435 ts_tablet_manager.cc:1403] T 26648bf286c94b2495e565969f945858 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.004s
I20251215 14:55:02.548343 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_f9cf4c41c7b846e88bae24711ee3421a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.548904 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f9cf4c41c7b846e88bae24711ee3421a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.549063 9435 raft_consensus.cc:359] T 26648bf286c94b2495e565969f945858 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.549255 9435 raft_consensus.cc:385] T 26648bf286c94b2495e565969f945858 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.549353 9435 raft_consensus.cc:740] T 26648bf286c94b2495e565969f945858 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.550223 9427 tablet_bootstrap.cc:492] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:02.550420 9427 ts_tablet_manager.cc:1403] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.260s user 0.020s sys 0.024s
I20251215 14:55:02.551347 9427 raft_consensus.cc:359] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.551563 9427 raft_consensus.cc:385] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.551635 9427 raft_consensus.cc:740] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.551880 9427 consensus_queue.cc:260] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.552397 9427 ts_tablet_manager.cc:1434] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20251215 14:55:02.552951 8851 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_05353059978c4d13804474b05f6c8d7b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:02.553089 9427 tablet_bootstrap.cc:492] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:02.553668 8851 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_05353059978c4d13804474b05f6c8d7b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.555085 9427 tablet_bootstrap.cc:654] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.585402 9427 tablet_bootstrap.cc:492] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:02.586304 9427 ts_tablet_manager.cc:1403] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.000s
I20251215 14:55:02.590003 9440 raft_consensus.cc:493] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:02.590165 9440 raft_consensus.cc:515] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.590792 9440 leader_election.cc:290] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:02.591568 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3670e4f699894059a3f09a33a744e9f9" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:02.592211 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3670e4f699894059a3f09a33a744e9f9" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:02.592407 9315 raft_consensus.cc:2468] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
W20251215 14:55:02.592998 9112 leader_election.cc:343] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:02.593446 9115 leader_election.cc:304] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:02.593905 9440 raft_consensus.cc:2804] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:02.594026 9440 raft_consensus.cc:493] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:02.594117 9440 raft_consensus.cc:3060] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:02.593878 9427 raft_consensus.cc:359] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.594544 9427 raft_consensus.cc:385] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.594650 9427 raft_consensus.cc:740] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.594906 9427 consensus_queue.cc:260] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:02.595281 8843 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.190:44279, user_credentials={real_user=slave}} blocked reactor thread for 53306.5us
I20251215 14:55:02.596830 9440 raft_consensus.cc:515] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.597443 9427 ts_tablet_manager.cc:1434] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20251215 14:55:02.597779 9427 tablet_bootstrap.cc:492] T 42ee36f017f44890aa7419e642abdc9b P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:02.600368 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3670e4f699894059a3f09a33a744e9f9" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:02.600544 9315 raft_consensus.cc:3060] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:02.603621 9315 raft_consensus.cc:2468] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:02.603935 8856 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet b329b0abcad742ff94c1a62a72d1b673
I20251215 14:55:02.604105 9115 leader_election.cc:304] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:02.604444 8856 catalog_manager.cc:6724] ReplaceTablet: tablet b329b0abcad742ff94c1a62a72d1b673 deleted and replaced by tablet 37181f50142f4d8bb88713221a755d50
I20251215 14:55:02.605406 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3670e4f699894059a3f09a33a744e9f9" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
W20251215 14:55:02.605882 9112 leader_election.cc:343] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:02.606017 8856 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_37b271542ee44db68c2370937f9daa7a" } modify_external_catalogs: true
I20251215 14:55:02.606213 9440 leader_election.cc:290] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:02.606235 8856 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_37b271542ee44db68c2370937f9daa7a" } modify_external_catalogs: true
I20251215 14:55:02.606426 9440 raft_consensus.cc:2804] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
W20251215 14:55:02.607430 8850 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a597fd6c7c044228ffb2a5a5f924e70 has no consensus state
I20251215 14:55:02.607558 9440 raft_consensus.cc:697] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:02.607980 9440 consensus_queue.cc:237] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:02.608141 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet f2aae2798eee4775afaa3afc59e98a6c
I20251215 14:55:02.608947 8850 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_1eea41fb41014a0e88ffd907fa069d19" } modify_external_catalogs: true
I20251215 14:55:02.609133 8850 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_1eea41fb41014a0e88ffd907fa069d19" } modify_external_catalogs: true
I20251215 14:55:02.610235 8855 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 92e21a77ad074572a57b836743903a0b
I20251215 14:55:02.610590 8855 catalog_manager.cc:6724] ReplaceTablet: tablet 92e21a77ad074572a57b836743903a0b deleted and replaced by tablet 6bc4a450b3694846b9054b3a3e6112d2
I20251215 14:55:02.610847 8855 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_cab0b4ed4b2d4d059b29a0e4f4a676ab" } modify_external_catalogs: true
I20251215 14:55:02.610971 8855 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_cab0b4ed4b2d4d059b29a0e4f4a676ab" } modify_external_catalogs: true
W20251215 14:55:02.611415 8858 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc9bda52c73e4aa6b7e2eb008c63391b consensus state has no leader
I20251215 14:55:02.611711 8852 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 866a45e3716045eea2d7779c997edf4d
I20251215 14:55:02.612284 8853 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 42ee36f017f44890aa7419e642abdc9b
I20251215 14:55:02.613885 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet b329b0abcad742ff94c1a62a72d1b673 with delete_type TABLET_DATA_DELETED (replaced by tablet 37181f50142f4d8bb88713221a755d50) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:02.614149 9158 tablet_service.cc:1552] Processing DeleteTablet for tablet 92e21a77ad074572a57b836743903a0b with delete_type TABLET_DATA_DELETED (replaced by tablet 6bc4a450b3694846b9054b3a3e6112d2) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:02.614346 9155 tablet_service.cc:1552] Processing DeleteTablet for tablet 42ee36f017f44890aa7419e642abdc9b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:54874
W20251215 14:55:02.614944 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet b329b0abcad742ff94c1a62a72d1b673 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b329b0abcad742ff94c1a62a72d1b673 already in progress: creating tablet
W20251215 14:55:02.615176 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 92e21a77ad074572a57b836743903a0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92e21a77ad074572a57b836743903a0b already in progress: creating tablet
I20251215 14:55:02.615267 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet b329b0abcad742ff94c1a62a72d1b673 with delete_type TABLET_DATA_DELETED (replaced by tablet 37181f50142f4d8bb88713221a755d50) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:02.615396 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 42ee36f017f44890aa7419e642abdc9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42ee36f017f44890aa7419e642abdc9b already in progress: creating tablet
I20251215 14:55:02.615497 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 92e21a77ad074572a57b836743903a0b with delete_type TABLET_DATA_DELETED (replaced by tablet 6bc4a450b3694846b9054b3a3e6112d2) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:02.616040 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet 42ee36f017f44890aa7419e642abdc9b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:02.616256 9432 tablet_replica.cc:333] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:02.616420 9432 raft_consensus.cc:2243] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:02.616600 9432 raft_consensus.cc:2272] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:02.616863 9489 raft_consensus.cc:493] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:02.617055 8859 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b9b39c879d444172871f43349978dc86 has no consensus state
I20251215 14:55:02.617017 9489 raft_consensus.cc:515] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.617415 9432 ts_tablet_manager.cc:1916] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:02.617609 9489 leader_election.cc:290] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:02.618968 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet b329b0abcad742ff94c1a62a72d1b673 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b329b0abcad742ff94c1a62a72d1b673 already in progress: creating tablet
W20251215 14:55:02.619218 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 92e21a77ad074572a57b836743903a0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 92e21a77ad074572a57b836743903a0b already in progress: creating tablet
I20251215 14:55:02.619688 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c9141d604c34314a462b892076b7224" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:02.619910 9042 raft_consensus.cc:2468] T 7c9141d604c34314a462b892076b7224 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:02.620323 9248 leader_election.cc:304] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:02.620839 9249 leader_election.cc:343] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 7c9141d604c34314a462b892076b7224
I20251215 14:55:02.621977 9435 consensus_queue.cc:260] T 26648bf286c94b2495e565969f945858 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.625631 8859 master_service.cc:954] ReplaceTablet: received request to replace tablet 92e21a77ad074572a57b836743903a0b from {username='slave'} at 127.0.0.1:34038
W20251215 14:55:02.626912 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet 26648bf286c94b2495e565969f945858
I20251215 14:55:02.628674 9427 tablet_bootstrap.cc:654] T 42ee36f017f44890aa7419e642abdc9b P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.631023 8851 master_service.cc:954] ReplaceTablet: received request to replace tablet 018bd6ac8a534a6abc461b57b89b93eb from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:02.632304 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet b329b0abcad742ff94c1a62a72d1b673 with delete_type TABLET_DATA_DELETED (replaced by tablet 37181f50142f4d8bb88713221a755d50) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:02.623311 9441 raft_consensus.cc:2804] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:02.633131 9441 raft_consensus.cc:493] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:02.633219 9441 raft_consensus.cc:3060] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:02.636049 9441 raft_consensus.cc:515] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.623555 9432 ts_tablet_manager.cc:1929] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:02.637303 9432 log.cc:1199] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/42ee36f017f44890aa7419e642abdc9b
I20251215 14:55:02.637753 9432 ts_tablet_manager.cc:1950] T 42ee36f017f44890aa7419e642abdc9b P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:02.638352 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7c9141d604c34314a462b892076b7224" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:02.638572 9042 raft_consensus.cc:3060] T 7c9141d604c34314a462b892076b7224 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:02.639472 9441 leader_election.cc:290] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:02.622498 9435 ts_tablet_manager.cc:1434] T 26648bf286c94b2495e565969f945858 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.074s user 0.001s sys 0.000s
I20251215 14:55:02.641369 9435 tablet_bootstrap.cc:492] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:02.641482 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet b2d65d8d32cc4ea19ddc4bbaf5291820 with delete_type TABLET_DATA_DELETED (replaced by tablet 1141b9a4cf3e4aa78529bed7f0375ff8) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:02.641767 9431 tablet_replica.cc:333] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:02.641923 9431 raft_consensus.cc:2243] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:02.642096 9431 raft_consensus.cc:2272] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:02.642993 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_325fc3ac5852480abe281caa59c90f80"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.643651 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_325fc3ac5852480abe281caa59c90f80 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.645308 9042 raft_consensus.cc:2468] T 7c9141d604c34314a462b892076b7224 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:02.648682 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 42ee36f017f44890aa7419e642abdc9b (table default.Table_b5df39fee38d439b9ba457db54ec272b [id=474a03e23b9c4389bb07035b37e59612]) successfully deleted
I20251215 14:55:02.650936 8850 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet b03c5e1f44d34798b4d0dce88f951581
I20251215 14:55:02.652617 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_c1335c74e0f740b08e701ac0246125f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.653178 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1335c74e0f740b08e701ac0246125f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.654382 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 92e21a77ad074572a57b836743903a0b with delete_type TABLET_DATA_DELETED (replaced by tablet 6bc4a450b3694846b9054b3a3e6112d2) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:02.648288 9249 leader_election.cc:343] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 7c9141d604c34314a462b892076b7224
I20251215 14:55:02.655243 9248 leader_election.cc:304] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:02.655495 9435 tablet_bootstrap.cc:654] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.655820 9441 raft_consensus.cc:2804] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:02.656038 9441 raft_consensus.cc:697] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:02.656379 9441 consensus_queue.cc:237] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.657065 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 42ee36f017f44890aa7419e642abdc9b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:02.658257 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet 26648bf286c94b2495e565969f945858
I20251215 14:55:02.663900 8855 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 6bc4a450b3694846b9054b3a3e6112d2
W20251215 14:55:02.666229 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet b329b0abcad742ff94c1a62a72d1b673 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b329b0abcad742ff94c1a62a72d1b673 already in progress: creating tablet
I20251215 14:55:02.666443 9431 ts_tablet_manager.cc:1916] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:02.666929 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_cf4fb411bb6e4356b431fac7a99ea842"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.667500 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf4fb411bb6e4356b431fac7a99ea842 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.668980 8855 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_deec36ad4fac424d94fcea1088113823"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.669503 8855 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_deec36ad4fac424d94fcea1088113823 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.674594 9431 ts_tablet_manager.cc:1929] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:02.674777 9431 log.cc:1199] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/b2d65d8d32cc4ea19ddc4bbaf5291820
I20251215 14:55:02.675516 8856 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 3670e4f699894059a3f09a33a744e9f9
I20251215 14:55:02.676512 9155 tablet_service.cc:1552] Processing DeleteTablet for tablet 3670e4f699894059a3f09a33a744e9f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:02.676802 9430 tablet_replica.cc:333] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:02.677028 9430 raft_consensus.cc:2243] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:02.677446 9430 pending_rounds.cc:70] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3: Trying to abort 1 pending ops.
I20251215 14:55:02.677635 9430 pending_rounds.cc:77] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232759818694455296 op_type: NO_OP noop_request { }
I20251215 14:55:02.677796 9430 raft_consensus.cc:2889] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 14:55:02.677933 9430 raft_consensus.cc:2272] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:02.679363 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 3670e4f699894059a3f09a33a744e9f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:02.679550 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 3670e4f699894059a3f09a33a744e9f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:02.679831 9432 tablet_replica.cc:333] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:02.680032 9432 raft_consensus.cc:2243] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:02.680197 9432 raft_consensus.cc:2272] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:02.680919 9432 ts_tablet_manager.cc:1916] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:02.687722 9432 ts_tablet_manager.cc:1929] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:02.688014 9432 log.cc:1199] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/3670e4f699894059a3f09a33a744e9f9
I20251215 14:55:02.688477 9432 ts_tablet_manager.cc:1950] T 3670e4f699894059a3f09a33a744e9f9 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:02.689769 9435 tablet_bootstrap.cc:492] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:02.689752 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 3670e4f699894059a3f09a33a744e9f9 (table default.Table_37b271542ee44db68c2370937f9daa7a [id=ebef5a7cb50445b9a84f9d458c3c7129]) successfully deleted
I20251215 14:55:02.689934 9435 ts_tablet_manager.cc:1403] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.000s
I20251215 14:55:02.690773 9435 raft_consensus.cc:359] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.690976 9435 raft_consensus.cc:385] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.691049 9435 raft_consensus.cc:740] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.691737 9435 consensus_queue.cc:260] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.692865 9431 ts_tablet_manager.cc:1950] T b2d65d8d32cc4ea19ddc4bbaf5291820 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:02.693598 9435 ts_tablet_manager.cc:1434] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:02.695429 9435 tablet_bootstrap.cc:492] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:02.695539 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet b2d65d8d32cc4ea19ddc4bbaf5291820 (table default.Table_385109da45d14eacb743f9b6540d33c1 [id=066e8ae14004436cb8b4f3f740b45b19]) successfully deleted
W20251215 14:55:02.695845 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 42ee36f017f44890aa7419e642abdc9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 42ee36f017f44890aa7419e642abdc9b already in progress: creating tablet
W20251215 14:55:02.696063 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 3670e4f699894059a3f09a33a744e9f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3670e4f699894059a3f09a33a744e9f9 already in progress: creating tablet
I20251215 14:55:02.697105 9435 tablet_bootstrap.cc:654] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.699932 9430 ts_tablet_manager.cc:1916] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:02.706144 9427 tablet_bootstrap.cc:492] T 42ee36f017f44890aa7419e642abdc9b P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:02.706311 9430 ts_tablet_manager.cc:1929] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:02.706331 9427 ts_tablet_manager.cc:1403] T 42ee36f017f44890aa7419e642abdc9b P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.109s user 0.003s sys 0.000s
I20251215 14:55:02.706444 9430 log.cc:1199] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/3670e4f699894059a3f09a33a744e9f9
I20251215 14:55:02.706804 9430 ts_tablet_manager.cc:1950] T 3670e4f699894059a3f09a33a744e9f9 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:02.707374 9427 raft_consensus.cc:359] T 42ee36f017f44890aa7419e642abdc9b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.707603 9427 raft_consensus.cc:385] T 42ee36f017f44890aa7419e642abdc9b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.707674 9427 raft_consensus.cc:740] T 42ee36f017f44890aa7419e642abdc9b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.707870 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 3670e4f699894059a3f09a33a744e9f9 (table default.Table_37b271542ee44db68c2370937f9daa7a [id=ebef5a7cb50445b9a84f9d458c3c7129]) successfully deleted
I20251215 14:55:02.707934 9427 consensus_queue.cc:260] T 42ee36f017f44890aa7419e642abdc9b P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.710633 9427 ts_tablet_manager.cc:1434] T 42ee36f017f44890aa7419e642abdc9b P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20251215 14:55:02.711678 9427 tablet_bootstrap.cc:492] T a28289e1e5334512b2240c3b571d9424 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:02.715817 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
W20251215 14:55:02.718113 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet 4a6846144c8c409cad340e99374a38c6
I20251215 14:55:02.718178 9180 raft_consensus.cc:1275] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Refusing update from remote peer e89303a500544272b601d7c29be802b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 14:55:02.719082 9489 consensus_queue.cc:1048] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:02.728499 9042 raft_consensus.cc:1275] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Refusing update from remote peer e89303a500544272b601d7c29be802b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 14:55:02.729133 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet 42ee36f017f44890aa7419e642abdc9b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:02.729367 9441 consensus_queue.cc:1048] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:02.729801 9431 tablet_replica.cc:333] T 42ee36f017f44890aa7419e642abdc9b P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:02.730089 9431 raft_consensus.cc:2243] T 42ee36f017f44890aa7419e642abdc9b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:02.730156 9426 tablet_bootstrap.cc:492] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:02.730330 9427 tablet_bootstrap.cc:654] T a28289e1e5334512b2240c3b571d9424 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.730322 9426 ts_tablet_manager.cc:1403] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.260s user 0.092s sys 0.124s
I20251215 14:55:02.730454 9431 raft_consensus.cc:2272] T 42ee36f017f44890aa7419e642abdc9b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:02.731066 9426 raft_consensus.cc:359] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.731280 9426 raft_consensus.cc:385] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.731391 9426 raft_consensus.cc:740] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.731528 9431 ts_tablet_manager.cc:1916] T 42ee36f017f44890aa7419e642abdc9b P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:02.731622 9426 consensus_queue.cc:260] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.732163 9426 ts_tablet_manager.cc:1434] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:02.733973 9426 tablet_bootstrap.cc:492] T f2aae2798eee4775afaa3afc59e98a6c P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:02.735567 9426 tablet_bootstrap.cc:654] T f2aae2798eee4775afaa3afc59e98a6c P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.742189 9426 tablet_bootstrap.cc:492] T f2aae2798eee4775afaa3afc59e98a6c P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:02.742367 9426 ts_tablet_manager.cc:1403] T f2aae2798eee4775afaa3afc59e98a6c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.002s
I20251215 14:55:02.743122 9426 raft_consensus.cc:359] T f2aae2798eee4775afaa3afc59e98a6c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.743331 9426 raft_consensus.cc:385] T f2aae2798eee4775afaa3afc59e98a6c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.743410 9426 raft_consensus.cc:740] T f2aae2798eee4775afaa3afc59e98a6c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.744729 9426 consensus_queue.cc:260] T f2aae2798eee4775afaa3afc59e98a6c P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.746580 9426 ts_tablet_manager.cc:1434] T f2aae2798eee4775afaa3afc59e98a6c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:02.748080 9179 raft_consensus.cc:1275] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Refusing update from remote peer 67978ac4539d4b289e53f4eedd9a8156: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 14:55:02.748812 9433 consensus_queue.cc:1048] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:02.748950 9315 raft_consensus.cc:1275] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Refusing update from remote peer 67978ac4539d4b289e53f4eedd9a8156: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 14:55:02.749804 9433 consensus_queue.cc:1048] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:02.760972 9427 tablet_bootstrap.cc:492] T a28289e1e5334512b2240c3b571d9424 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:02.761150 9427 ts_tablet_manager.cc:1403] T a28289e1e5334512b2240c3b571d9424 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.001s
I20251215 14:55:02.761943 9427 raft_consensus.cc:359] T a28289e1e5334512b2240c3b571d9424 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.762135 9427 raft_consensus.cc:385] T a28289e1e5334512b2240c3b571d9424 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.762238 9427 raft_consensus.cc:740] T a28289e1e5334512b2240c3b571d9424 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.766647 9435 tablet_bootstrap.cc:492] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:02.766800 9435 ts_tablet_manager.cc:1403] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.072s user 0.009s sys 0.012s
I20251215 14:55:02.767623 9435 raft_consensus.cc:359] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.767810 9435 raft_consensus.cc:385] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.767915 9435 raft_consensus.cc:740] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.768146 9435 consensus_queue.cc:260] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.768640 9435 ts_tablet_manager.cc:1434] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:02.771920 9427 consensus_queue.cc:260] T a28289e1e5334512b2240c3b571d9424 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.772608 9427 ts_tablet_manager.cc:1434] T a28289e1e5334512b2240c3b571d9424 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20251215 14:55:02.772927 9427 tablet_bootstrap.cc:492] T 3670e4f699894059a3f09a33a744e9f9 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:02.773489 9435 tablet_bootstrap.cc:492] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:02.775015 9435 tablet_bootstrap.cc:654] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.776364 9426 tablet_bootstrap.cc:492] T 42ee36f017f44890aa7419e642abdc9b P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:02.778004 9426 tablet_bootstrap.cc:654] T 42ee36f017f44890aa7419e642abdc9b P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.778311 9441 raft_consensus.cc:493] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:02.778524 9441 raft_consensus.cc:515] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.780375 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4816503e4fa1459dbb311997be85f64a" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:02.780979 9249 leader_election.cc:343] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:02.782159 9441 leader_election.cc:290] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:02.784356 9523 tablet.cc:1722] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251215 14:55:02.788194 8855 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 8612ebb3fc3c4554be4b881a60ad6fd4 (table default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6]). Expected version 2 got 0
W20251215 14:55:02.791797 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet f2aae2798eee4775afaa3afc59e98a6c
W20251215 14:55:02.791883 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet 26648bf286c94b2495e565969f945858
I20251215 14:55:02.796499 9526 tablet.cc:1722] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:02.797125 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4816503e4fa1459dbb311997be85f64a" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:02.801323 9431 ts_tablet_manager.cc:1929] T 42ee36f017f44890aa7419e642abdc9b P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:02.801473 9431 log.cc:1199] T 42ee36f017f44890aa7419e642abdc9b P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/42ee36f017f44890aa7419e642abdc9b
I20251215 14:55:02.801803 9431 ts_tablet_manager.cc:1950] T 42ee36f017f44890aa7419e642abdc9b P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
W20251215 14:55:02.803975 9248 leader_election.cc:343] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:02.804145 9248 leader_election.cc:304] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:02.804244 9522 tablet.cc:1722] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251215 14:55:02.804652 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 42ee36f017f44890aa7419e642abdc9b (table default.Table_b5df39fee38d439b9ba457db54ec272b [id=474a03e23b9c4389bb07035b37e59612]) successfully deleted
I20251215 14:55:02.805662 8850 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_1b120f732d6f48df8e98a87733a029e1" } new_table_name: "default.Table_d36b592f1eda4d99b3112955a84c390e" modify_external_catalogs: true
I20251215 14:55:02.805727 8853 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_a53d9a69b3164c078e1fb963af1bd2a6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.806344 8853 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a53d9a69b3164c078e1fb963af1bd2a6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.807080 8857 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_deec36ad4fac424d94fcea1088113823" } new_table_name: "default.Table_5d032dd330df4c33aa8ef50ce62c8d08" modify_external_catalogs: true
I20251215 14:55:02.807828 8856 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_be16a6867c2746f89c6ea32a12291354"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.808403 8856 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_be16a6867c2746f89c6ea32a12291354 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.808357 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_bec53ce4c0c04be8bb0aabb4ce60974b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.808812 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bec53ce4c0c04be8bb0aabb4ce60974b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.820885 9427 tablet_bootstrap.cc:654] T 3670e4f699894059a3f09a33a744e9f9 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.821095 9509 mvcc.cc:204] Tried to move back new op lower bound from 7232759819196182528 to 7232759818030288896. Current Snapshot: MvccSnapshot[applied={T|T < 7232759819196182528}]
I20251215 14:55:02.819964 9441 raft_consensus.cc:2749] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:02.824419 9522 tablet.cc:1717] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156: Skipping requested alter to schema version 3, tablet already version 3
I20251215 14:55:02.826320 9527 tablet.cc:1722] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:02.827260 8855 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: default.Table_ae411cdd8f1740839d5490d643672e18 [id=b16ae3d8bb2a40eda9602301a2a2dc2e] alter complete (version 3)
I20251215 14:55:02.832615 8855 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 88c8499633f4417e9f6d2d6372f157c4 (table default.Table_ae411cdd8f1740839d5490d643672e18 [id=b16ae3d8bb2a40eda9602301a2a2dc2e]). Expected version 3 got 0
W20251215 14:55:02.836730 8850 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df70bebdc8ad4f8186ba427e840799cf has no consensus state
W20251215 14:55:02.841650 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet 4816503e4fa1459dbb311997be85f64a
I20251215 14:55:02.843650 8850 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 8612ebb3fc3c4554be4b881a60ad6fd4 (table default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6]). Expected version 2 got 0
I20251215 14:55:02.852629 9522 tablet.cc:1722] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:02.856154 9435 tablet_bootstrap.cc:492] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:02.856428 9435 ts_tablet_manager.cc:1403] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.083s user 0.010s sys 0.008s
I20251215 14:55:02.857769 9435 raft_consensus.cc:359] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.858891 8853 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_4d5807324a064aea839523ab764bcc06" } new_table_name: "default.Table_23c657126ccf46fabe10f93f2e991891" modify_external_catalogs: true
I20251215 14:55:02.861393 9526 tablet.cc:1722] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251215 14:55:02.858089 9435 raft_consensus.cc:385] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.862037 9435 raft_consensus.cc:740] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.863237 8852 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_ba51add601044f619beba0a4377181e6" } new_table_name: "default.Table_fb8fb745144644eea96b20d598f52fa2" modify_external_catalogs: true
I20251215 14:55:02.862579 9435 consensus_queue.cc:260] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.863852 8851 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_7fc4f71e01fa474594d5f0520e59e3f9" } modify_external_catalogs: true
I20251215 14:55:02.864058 8858 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_c1c8e8e6871048b6960ce0f9cbc46fb8" } new_table_name: "default.Table_0593d9b93de9400ba29718af1b328262" modify_external_catalogs: true
I20251215 14:55:02.864096 8851 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_7fc4f71e01fa474594d5f0520e59e3f9" } modify_external_catalogs: true
I20251215 14:55:02.864665 8854 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_55ea1e683a2d497caae977ff05d734d9" } modify_external_catalogs: true
I20251215 14:55:02.864822 8854 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_55ea1e683a2d497caae977ff05d734d9" } modify_external_catalogs: true
I20251215 14:55:02.865127 9435 ts_tablet_manager.cc:1434] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20251215 14:55:02.866482 9435 tablet_bootstrap.cc:492] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:02.870939 8857 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d922d7b24dbd474cbee47c72f2779a07 has no consensus state
I20251215 14:55:02.873435 9526 tablet.cc:1717] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4: Skipping requested alter to schema version 3, tablet already version 3
I20251215 14:55:02.875566 8857 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_306b2bfc23214c618f695c55cca31974" } modify_external_catalogs: true
I20251215 14:55:02.875737 8857 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_306b2bfc23214c618f695c55cca31974" } modify_external_catalogs: true
I20251215 14:55:02.879662 9435 tablet_bootstrap.cc:654] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.886102 9527 tablet.cc:1717] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3: Skipping requested alter to schema version 3, tablet already version 3
I20251215 14:55:02.889832 9426 tablet_bootstrap.cc:492] T 42ee36f017f44890aa7419e642abdc9b P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:02.889987 9426 ts_tablet_manager.cc:1403] T 42ee36f017f44890aa7419e642abdc9b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.114s user 0.001s sys 0.007s
I20251215 14:55:02.890041 8856 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_94cdbda94a9242b388ffa89052d55f05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.890632 8856 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_94cdbda94a9242b388ffa89052d55f05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.890738 9426 raft_consensus.cc:359] T 42ee36f017f44890aa7419e642abdc9b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.890908 9426 raft_consensus.cc:385] T 42ee36f017f44890aa7419e642abdc9b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.890998 9426 raft_consensus.cc:740] T 42ee36f017f44890aa7419e642abdc9b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.891263 9426 consensus_queue.cc:260] T 42ee36f017f44890aa7419e642abdc9b P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.891754 9426 ts_tablet_manager.cc:1434] T 42ee36f017f44890aa7419e642abdc9b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:02.892043 9426 tablet_bootstrap.cc:492] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:02.893751 9426 tablet_bootstrap.cc:654] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.896028 9435 tablet_bootstrap.cc:492] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:02.896255 9435 ts_tablet_manager.cc:1403] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.005s
I20251215 14:55:02.897245 9427 tablet_bootstrap.cc:492] T 3670e4f699894059a3f09a33a744e9f9 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:02.897174 9435 raft_consensus.cc:359] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.897413 9427 ts_tablet_manager.cc:1403] T 3670e4f699894059a3f09a33a744e9f9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.125s user 0.001s sys 0.002s
I20251215 14:55:02.897519 9435 raft_consensus.cc:385] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.897651 9435 raft_consensus.cc:740] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.897938 9435 consensus_queue.cc:260] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.898139 9427 raft_consensus.cc:359] T 3670e4f699894059a3f09a33a744e9f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.898324 9427 raft_consensus.cc:385] T 3670e4f699894059a3f09a33a744e9f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.898393 9427 raft_consensus.cc:740] T 3670e4f699894059a3f09a33a744e9f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.898635 9427 consensus_queue.cc:260] T 3670e4f699894059a3f09a33a744e9f9 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.898973 9435 ts_tablet_manager.cc:1434] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20251215 14:55:02.899096 9427 ts_tablet_manager.cc:1434] T 3670e4f699894059a3f09a33a744e9f9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:02.899425 9435 tablet_bootstrap.cc:492] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:02.899435 9427 tablet_bootstrap.cc:492] T 26648bf286c94b2495e565969f945858 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:02.901258 9435 tablet_bootstrap.cc:654] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.905812 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_dfe31a947f834d55a5f909708df6ff9d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.906427 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dfe31a947f834d55a5f909708df6ff9d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.906950 9499 raft_consensus.cc:493] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:02.907109 9499 raft_consensus.cc:515] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.907889 9499 leader_election.cc:290] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:02.908341 9426 tablet_bootstrap.cc:492] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:02.908385 9435 tablet_bootstrap.cc:492] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:02.908533 9435 ts_tablet_manager.cc:1403] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20251215 14:55:02.908515 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2aae2798eee4775afaa3afc59e98a6c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:02.908740 9180 raft_consensus.cc:2468] T f2aae2798eee4775afaa3afc59e98a6c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:02.909201 8976 leader_election.cc:304] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:02.903394 9427 tablet_bootstrap.cc:654] T 26648bf286c94b2495e565969f945858 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.909237 9435 raft_consensus.cc:359] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.909421 9435 raft_consensus.cc:385] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.909485 9435 raft_consensus.cc:740] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.909678 9499 raft_consensus.cc:2804] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:02.909796 9499 raft_consensus.cc:493] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:02.909736 9435 consensus_queue.cc:260] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.909883 9499 raft_consensus.cc:3060] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:02.910302 9435 ts_tablet_manager.cc:1434] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:02.910597 9435 tablet_bootstrap.cc:492] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:02.912091 9435 tablet_bootstrap.cc:654] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.912652 9499 raft_consensus.cc:515] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.913847 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2aae2798eee4775afaa3afc59e98a6c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:02.914064 9180 raft_consensus.cc:3060] T f2aae2798eee4775afaa3afc59e98a6c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:02.916668 9180 raft_consensus.cc:2468] T f2aae2798eee4775afaa3afc59e98a6c P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:02.917151 8976 leader_election.cc:304] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:02.917474 9433 raft_consensus.cc:2804] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:02.920492 9435 tablet_bootstrap.cc:492] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:02.920635 9435 ts_tablet_manager.cc:1403] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.002s
I20251215 14:55:02.908524 9426 ts_tablet_manager.cc:1403] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.002s
I20251215 14:55:02.922188 9426 raft_consensus.cc:359] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.922353 9435 raft_consensus.cc:359] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.922534 9435 raft_consensus.cc:385] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.922621 9435 raft_consensus.cc:740] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.922863 9435 consensus_queue.cc:260] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.923157 9433 raft_consensus.cc:697] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:02.923478 9433 consensus_queue.cc:237] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.924207 9435 ts_tablet_manager.cc:1434] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:02.925230 9435 tablet_bootstrap.cc:492] T 4f1f902cbcb643b9b98fa3d72babba79 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:02.926782 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2aae2798eee4775afaa3afc59e98a6c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:02.926862 9426 raft_consensus.cc:385] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.926952 9426 raft_consensus.cc:740] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.926951 9314 raft_consensus.cc:3060] T f2aae2798eee4775afaa3afc59e98a6c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:02.924131 9155 tablet_service.cc:1505] Processing CreateTablet for tablet d922d7b24dbd474cbee47c72f2779a07 (DEFAULT_TABLE table=default.Table_5d032dd330df4c33aa8ef50ce62c8d08 [id=977e2ac089d545278d13e59908bad89e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.927222 9426 consensus_queue.cc:260] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.927618 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d922d7b24dbd474cbee47c72f2779a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.927721 9426 ts_tablet_manager.cc:1434] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251215 14:55:02.927944 9499 leader_election.cc:290] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:02.928355 9018 tablet_service.cc:1505] Processing CreateTablet for tablet d922d7b24dbd474cbee47c72f2779a07 (DEFAULT_TABLE table=default.Table_5d032dd330df4c33aa8ef50ce62c8d08 [id=977e2ac089d545278d13e59908bad89e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.928731 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d922d7b24dbd474cbee47c72f2779a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.929611 9314 raft_consensus.cc:2468] T f2aae2798eee4775afaa3afc59e98a6c P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:02.930811 9435 tablet_bootstrap.cc:654] T 4f1f902cbcb643b9b98fa3d72babba79 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.936635 9435 tablet_bootstrap.cc:492] T 4f1f902cbcb643b9b98fa3d72babba79 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:02.936894 9435 ts_tablet_manager.cc:1403] T 4f1f902cbcb643b9b98fa3d72babba79 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.005s
I20251215 14:55:02.937124 9290 tablet_service.cc:1505] Processing CreateTablet for tablet d922d7b24dbd474cbee47c72f2779a07 (DEFAULT_TABLE table=default.Table_5d032dd330df4c33aa8ef50ce62c8d08 [id=977e2ac089d545278d13e59908bad89e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.938315 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d922d7b24dbd474cbee47c72f2779a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.939241 9426 tablet_bootstrap.cc:492] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:02.937737 9435 raft_consensus.cc:359] T 4f1f902cbcb643b9b98fa3d72babba79 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.941031 9435 raft_consensus.cc:385] T 4f1f902cbcb643b9b98fa3d72babba79 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.941179 9435 raft_consensus.cc:740] T 4f1f902cbcb643b9b98fa3d72babba79 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.941473 9435 consensus_queue.cc:260] T 4f1f902cbcb643b9b98fa3d72babba79 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.942091 9435 ts_tablet_manager.cc:1434] T 4f1f902cbcb643b9b98fa3d72babba79 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20251215 14:55:02.942606 9435 tablet_bootstrap.cc:492] T 11a5a6a0895c49648c910fa2ea3ca373 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:02.945845 9155 tablet_service.cc:1505] Processing CreateTablet for tablet f32a6e8df31d482fa9b9686e002d81ff (DEFAULT_TABLE table=default.Table_325fc3ac5852480abe281caa59c90f80 [id=cfb144484dc1441b9353efaaef1d941b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.946394 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32a6e8df31d482fa9b9686e002d81ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.947204 9022 tablet_service.cc:1505] Processing CreateTablet for tablet f32a6e8df31d482fa9b9686e002d81ff (DEFAULT_TABLE table=default.Table_325fc3ac5852480abe281caa59c90f80 [id=cfb144484dc1441b9353efaaef1d941b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.947620 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32a6e8df31d482fa9b9686e002d81ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.947775 9290 tablet_service.cc:1505] Processing CreateTablet for tablet f32a6e8df31d482fa9b9686e002d81ff (DEFAULT_TABLE table=default.Table_325fc3ac5852480abe281caa59c90f80 [id=cfb144484dc1441b9353efaaef1d941b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.948123 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32a6e8df31d482fa9b9686e002d81ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.949281 9426 tablet_bootstrap.cc:654] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.951406 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2aae2798eee4775afaa3afc59e98a6c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:02.953116 9440 raft_consensus.cc:493] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:02.953336 9440 raft_consensus.cc:515] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.954079 9440 leader_election.cc:290] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:02.955322 9315 raft_consensus.cc:2376] T f2aae2798eee4775afaa3afc59e98a6c P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1. Re-sending same reply.
I20251215 14:55:02.955628 9158 tablet_service.cc:1505] Processing CreateTablet for tablet fab39532fe6a403683952057c5ccabd9 (DEFAULT_TABLE table=default.Table_05353059978c4d13804474b05f6c8d7b [id=6dd2c68a85f648e1b4c51e691c1eb632]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:02.956053 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab39532fe6a403683952057c5ccabd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.956024 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26648bf286c94b2495e565969f945858" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:02.956910 9112 leader_election.cc:343] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:02.958249 8855 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6] alter complete (version 2)
I20251215 14:55:02.954926 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26648bf286c94b2495e565969f945858" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:02.960166 9314 raft_consensus.cc:2468] T 26648bf286c94b2495e565969f945858 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:02.961067 9115 leader_election.cc:304] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:02.961807 9440 raft_consensus.cc:2804] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:02.961923 9440 raft_consensus.cc:493] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:02.962044 9440 raft_consensus.cc:3060] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:02.965648 9426 tablet_bootstrap.cc:492] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:02.965809 9426 ts_tablet_manager.cc:1403] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
W20251215 14:55:02.966039 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet f2aae2798eee4775afaa3afc59e98a6c
I20251215 14:55:02.966771 9426 raft_consensus.cc:359] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.966956 9426 raft_consensus.cc:385] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.967061 9426 raft_consensus.cc:740] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.967322 9426 consensus_queue.cc:260] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.968765 9426 ts_tablet_manager.cc:1434] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
W20251215 14:55:02.968977 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet 018bd6ac8a534a6abc461b57b89b93eb
I20251215 14:55:02.969149 9426 tablet_bootstrap.cc:492] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:02.969180 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet 4f1f902cbcb643b9b98fa3d72babba79
W20251215 14:55:02.969311 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet c0d0022e48f04b83ac1c998a83fe3f55
W20251215 14:55:02.969412 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet cb2f4fc179744458bc7db2f6c7197ec5
I20251215 14:55:02.969882 9440 raft_consensus.cc:515] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.969964 8855 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet c276eb6ad0414bb8ae5d553ae623edac (table default.Table_d884e36a60cf4a109778a5bfa32afaa8 [id=7ec65d77d89d4e40a60b716f721e2940]). Expected version 2 got 0
I20251215 14:55:02.971525 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_ae55a511c46246048211ece920992e00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.972108 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae55a511c46246048211ece920992e00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:02.972651 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet a28289e1e5334512b2240c3b571d9424 with delete_type TABLET_DATA_DELETED (replaced by tablet 0215ff355fce46b5a4cf1bf4bd7164f3) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:02.973623 9431 tablet_replica.cc:333] T a28289e1e5334512b2240c3b571d9424 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:02.973802 9435 tablet_bootstrap.cc:654] T 11a5a6a0895c49648c910fa2ea3ca373 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.973819 9431 raft_consensus.cc:2243] T a28289e1e5334512b2240c3b571d9424 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:02.973989 9431 raft_consensus.cc:2272] T a28289e1e5334512b2240c3b571d9424 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:02.974464 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 3670e4f699894059a3f09a33a744e9f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:02.974738 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26648bf286c94b2495e565969f945858" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:02.974956 9314 raft_consensus.cc:3060] T 26648bf286c94b2495e565969f945858 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:02.975641 9431 ts_tablet_manager.cc:1916] T a28289e1e5334512b2240c3b571d9424 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:02.976646 9441 raft_consensus.cc:493] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:02.976801 9441 raft_consensus.cc:515] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.977417 9441 leader_election.cc:290] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:02.977533 9314 raft_consensus.cc:2468] T 26648bf286c94b2495e565969f945858 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:02.978024 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a6846144c8c409cad340e99374a38c6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:02.978276 9115 leader_election.cc:304] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:02.978515 9248 leader_election.cc:343] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:02.978587 9507 raft_consensus.cc:2804] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:02.979075 9507 raft_consensus.cc:697] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:02.979424 9507 consensus_queue.cc:237] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.980386 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26648bf286c94b2495e565969f945858" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
W20251215 14:55:02.980988 9112 leader_election.cc:343] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:02.981310 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a6846144c8c409cad340e99374a38c6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:02.981844 9249 leader_election.cc:343] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:02.981966 9249 leader_election.cc:304] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:02.982312 9441 raft_consensus.cc:2749] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:02.983798 8853 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c4f47c22111c427a8ab9c4ae1e105375 consensus state has no leader
I20251215 14:55:02.984221 8853 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_f6179b6a903946ac9b6a982c9ff87304" } modify_external_catalogs: true
I20251215 14:55:02.984385 8853 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_f6179b6a903946ac9b6a982c9ff87304" } modify_external_catalogs: true
I20251215 14:55:02.985667 9431 ts_tablet_manager.cc:1929] T a28289e1e5334512b2240c3b571d9424 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:02.985790 9431 log.cc:1199] T a28289e1e5334512b2240c3b571d9424 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/a28289e1e5334512b2240c3b571d9424
I20251215 14:55:02.986270 9431 ts_tablet_manager.cc:1950] T a28289e1e5334512b2240c3b571d9424 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:02.987756 9440 leader_election.cc:290] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:02.989562 8858 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 consensus state has no leader
I20251215 14:55:02.989964 8858 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_4a6a8f85c67347de8eb61c8ffd16abf1" } modify_external_catalogs: true
I20251215 14:55:02.990134 8858 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_4a6a8f85c67347de8eb61c8ffd16abf1" } modify_external_catalogs: true
W20251215 14:55:02.991428 8852 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ae8a49b9a3bf4845943b1ad8e318ccbb consensus state has no leader
I20251215 14:55:02.991802 8852 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_8545c01c50ce45489e3e219e52e98acd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:02.992314 8852 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8545c01c50ce45489e3e219e52e98acd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:02.995081 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet 4816503e4fa1459dbb311997be85f64a
I20251215 14:55:02.995430 9435 tablet_bootstrap.cc:492] T 11a5a6a0895c49648c910fa2ea3ca373 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:02.995570 9435 ts_tablet_manager.cc:1403] T 11a5a6a0895c49648c910fa2ea3ca373 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.004s
I20251215 14:55:02.995833 8856 master_service.cc:954] ReplaceTablet: received request to replace tablet c276eb6ad0414bb8ae5d553ae623edac from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:02.996358 9435 raft_consensus.cc:359] T 11a5a6a0895c49648c910fa2ea3ca373 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.996531 9435 raft_consensus.cc:385] T 11a5a6a0895c49648c910fa2ea3ca373 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.996613 9435 raft_consensus.cc:740] T 11a5a6a0895c49648c910fa2ea3ca373 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:02.996683 9431 tablet_replica.cc:333] T 3670e4f699894059a3f09a33a744e9f9 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:02.996908 9431 raft_consensus.cc:2243] T 3670e4f699894059a3f09a33a744e9f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:02.996829 9435 consensus_queue.cc:260] T 11a5a6a0895c49648c910fa2ea3ca373 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:02.996932 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet a28289e1e5334512b2240c3b571d9424 (table default.Table_28c03048db094b5093cd88eb3dc6f7fe [id=cf0e40d55af1486db1df4e85048a070b]) successfully deleted
I20251215 14:55:02.997180 9431 raft_consensus.cc:2272] T 3670e4f699894059a3f09a33a744e9f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:02.997233 8854 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 062a482917794ae5a67ec685a2491ba2
I20251215 14:55:02.997444 8855 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet c276eb6ad0414bb8ae5d553ae623edac (table default.Table_d884e36a60cf4a109778a5bfa32afaa8 [id=7ec65d77d89d4e40a60b716f721e2940]). Expected version 2 got 0
I20251215 14:55:02.997889 8854 master_service.cc:954] ReplaceTablet: received request to replace tablet f9695d47e35448fdad95ff3f24bafd03 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:02.998378 8854 master_service.cc:954] ReplaceTablet: received request to replace tablet 26648bf286c94b2495e565969f945858 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:02.970927 9426 tablet_bootstrap.cc:654] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:02.998602 9427 tablet_bootstrap.cc:492] T 26648bf286c94b2495e565969f945858 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:02.998731 9427 ts_tablet_manager.cc:1403] T 26648bf286c94b2495e565969f945858 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.099s user 0.006s sys 0.000s
I20251215 14:55:02.999527 9427 raft_consensus.cc:359] T 26648bf286c94b2495e565969f945858 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:02.999691 9427 raft_consensus.cc:385] T 26648bf286c94b2495e565969f945858 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:02.999776 9427 raft_consensus.cc:740] T 26648bf286c94b2495e565969f945858 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.000037 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 062a482917794ae5a67ec685a2491ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.000269 9427 consensus_queue.cc:260] T 26648bf286c94b2495e565969f945858 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.000422 9018 tablet_service.cc:1505] Processing CreateTablet for tablet fab39532fe6a403683952057c5ccabd9 (DEFAULT_TABLE table=default.Table_05353059978c4d13804474b05f6c8d7b [id=6dd2c68a85f648e1b4c51e691c1eb632]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.000794 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab39532fe6a403683952057c5ccabd9. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:03.000830 8846 catalog_manager.cc:4952] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 062a482917794ae5a67ec685a2491ba2 because the tablet was not found. No further retry: Not found: Tablet not found: 062a482917794ae5a67ec685a2491ba2
I20251215 14:55:03.001641 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 95583eee8a5041b1ade97e8f8f0db271 (DEFAULT_TABLE table=default.Table_0c66ce7473b248f58f74dd76a8c48045 [id=f735b0a748bf4b35bd47e7b1431994b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.002028 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95583eee8a5041b1ade97e8f8f0db271. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.003156 9427 ts_tablet_manager.cc:1434] T 26648bf286c94b2495e565969f945858 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:03.003446 9427 tablet_bootstrap.cc:492] T 4a6846144c8c409cad340e99374a38c6 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:03.005640 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 95583eee8a5041b1ade97e8f8f0db271 (DEFAULT_TABLE table=default.Table_0c66ce7473b248f58f74dd76a8c48045 [id=f735b0a748bf4b35bd47e7b1431994b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.005765 9017 tablet_service.cc:1505] Processing CreateTablet for tablet ae8a49b9a3bf4845943b1ad8e318ccbb (DEFAULT_TABLE table=default.Table_fb8fb745144644eea96b20d598f52fa2 [id=02a2b4848c874afe8f9860eee9bc6ce7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.006094 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95583eee8a5041b1ade97e8f8f0db271. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.006347 9017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae8a49b9a3bf4845943b1ad8e318ccbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.006382 9016 tablet_service.cc:1505] Processing CreateTablet for tablet 0db6246dee2643d98094408410618259 (DEFAULT_TABLE table=default.Table_7fc4f71e01fa474594d5f0520e59e3f9 [id=8b906a02cb6b4a38b32c281a9693b9fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.006711 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db6246dee2643d98094408410618259. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.007531 9294 tablet_service.cc:1505] Processing CreateTablet for tablet fab39532fe6a403683952057c5ccabd9 (DEFAULT_TABLE table=default.Table_05353059978c4d13804474b05f6c8d7b [id=6dd2c68a85f648e1b4c51e691c1eb632]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.007894 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab39532fe6a403683952057c5ccabd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:02.996938 8859 master_service.cc:954] ReplaceTablet: received request to replace tablet 80d4c9b533ac4facb4205aff84903134 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:03.011631 9015 tablet_service.cc:1505] Processing CreateTablet for tablet 7f38c44dbc884d74a61c7ed98deaf6aa (DEFAULT_TABLE table=default.Table_78b33227a8994e23ad7f3be637d971c5 [id=bec2dd63f0aa4a05961adb6a70fbfd94]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.012153 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f38c44dbc884d74a61c7ed98deaf6aa. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:03.012303 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet 26648bf286c94b2495e565969f945858
I20251215 14:55:03.012735 8859 master_service.cc:954] ReplaceTablet: received request to replace tablet 44bd51f9bf77492b8890fc7c8411c887 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:03.013293 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_c6d082c899204c5280db8f13e837c0de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.013783 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6d082c899204c5280db8f13e837c0de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.015154 9014 tablet_service.cc:1505] Processing CreateTablet for tablet 0a597fd6c7c044228ffb2a5a5f924e70 (DEFAULT_TABLE table=default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.015731 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a597fd6c7c044228ffb2a5a5f924e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.016780 9292 tablet_service.cc:1505] Processing CreateTablet for tablet 0db6246dee2643d98094408410618259 (DEFAULT_TABLE table=default.Table_7fc4f71e01fa474594d5f0520e59e3f9 [id=8b906a02cb6b4a38b32c281a9693b9fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.017275 9292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db6246dee2643d98094408410618259. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.017323 9284 tablet_service.cc:1505] Processing CreateTablet for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 (DEFAULT_TABLE table=default.Table_0593d9b93de9400ba29718af1b328262 [id=50a94314f5ba46e3a75b5a15e7362299]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.017627 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 26876cdffd7e4664bc8f7efb74885776 (DEFAULT_TABLE table=default.Table_4a6a8f85c67347de8eb61c8ffd16abf1 [id=f7ff7105e6354208854c3cb99d0885c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.017764 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.017926 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26876cdffd7e4664bc8f7efb74885776. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.018373 9291 tablet_service.cc:1505] Processing CreateTablet for tablet ae8a49b9a3bf4845943b1ad8e318ccbb (DEFAULT_TABLE table=default.Table_fb8fb745144644eea96b20d598f52fa2 [id=02a2b4848c874afe8f9860eee9bc6ce7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.018839 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae8a49b9a3bf4845943b1ad8e318ccbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.019688 9287 tablet_service.cc:1505] Processing CreateTablet for tablet 7f38c44dbc884d74a61c7ed98deaf6aa (DEFAULT_TABLE table=default.Table_78b33227a8994e23ad7f3be637d971c5 [id=bec2dd63f0aa4a05961adb6a70fbfd94]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.020072 9287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f38c44dbc884d74a61c7ed98deaf6aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.021512 9285 tablet_service.cc:1505] Processing CreateTablet for tablet b9b39c879d444172871f43349978dc86 (DEFAULT_TABLE table=default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b [id=472c67fefad54383b4ebac7e3c77d325]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.021962 9282 tablet_service.cc:1505] Processing CreateTablet for tablet 3cdfcddd91fe47de8fd14dc718f421a6 (DEFAULT_TABLE table=default.Table_8c028f23aaf4428fab6a375c292e49b3 [id=2bd880b71b174f528054fbc22143c01f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.023510 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 9425749d471f4f95bbae030977e278e4 (DEFAULT_TABLE table=default.Table_cf4fb411bb6e4356b431fac7a99ea842 [id=854a4abf12494d508d8aaf1a794d3dfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.023973 9288 tablet_service.cc:1505] Processing CreateTablet for tablet 0a597fd6c7c044228ffb2a5a5f924e70 (DEFAULT_TABLE table=default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.026352 9156 tablet_service.cc:1505] Processing CreateTablet for tablet ce0154b24522401b9cc0e37fa502532f (DEFAULT_TABLE table=default.Table_306b2bfc23214c618f695c55cca31974 [id=aadcdc13fe3e4d66aade3a7d8ec2afc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.026784 9156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0154b24522401b9cc0e37fa502532f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.027340 9158 tablet_service.cc:1552] Processing DeleteTablet for tablet 062a482917794ae5a67ec685a2491ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.027413 8854 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_ee51c1b494fe43d4b541ca7bd142bb26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:03.022272 9283 tablet_service.cc:1505] Processing CreateTablet for tablet 32432afc6e8d458bb7ed7abc42fb3dde (DEFAULT_TABLE table=default.Table_f416fea67a974ab084b7b48a60426131 [id=0e3677e1f3d048ecad508d50304ee56a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.027794 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 95583eee8a5041b1ade97e8f8f0db271 (DEFAULT_TABLE table=default.Table_0c66ce7473b248f58f74dd76a8c48045 [id=f735b0a748bf4b35bd47e7b1431994b1]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:03.027925 8854 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ee51c1b494fe43d4b541ca7bd142bb26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.028162 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95583eee8a5041b1ade97e8f8f0db271. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.029102 9286 tablet_service.cc:1505] Processing CreateTablet for tablet ce0154b24522401b9cc0e37fa502532f (DEFAULT_TABLE table=default.Table_306b2bfc23214c618f695c55cca31974 [id=aadcdc13fe3e4d66aade3a7d8ec2afc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.029502 9286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0154b24522401b9cc0e37fa502532f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.031083 9155 tablet_service.cc:1552] Processing DeleteTablet for tablet 42ee36f017f44890aa7419e642abdc9b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.032307 9285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b39c879d444172871f43349978dc86. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.032841 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32432afc6e8d458bb7ed7abc42fb3dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.033243 9427 tablet_bootstrap.cc:654] T 4a6846144c8c409cad340e99374a38c6 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.022682 9280 tablet_service.cc:1505] Processing CreateTablet for tablet 1141b9a4cf3e4aa78529bed7f0375ff8 (DEFAULT_TABLE table=default.Table_385109da45d14eacb743f9b6540d33c1 [id=066e8ae14004436cb8b4f3f740b45b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.022922 9281 tablet_service.cc:1505] Processing CreateTablet for tablet df70bebdc8ad4f8186ba427e840799cf (DEFAULT_TABLE table=default.Table_d36b592f1eda4d99b3112955a84c390e [id=409ba53d42214908857200301c1b5ce6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.035622 9435 ts_tablet_manager.cc:1434] T 11a5a6a0895c49648c910fa2ea3ca373 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.040s user 0.000s sys 0.002s
I20251215 14:55:03.035967 9435 tablet_bootstrap.cc:492] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:03.036095 9282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cdfcddd91fe47de8fd14dc718f421a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.037688 9430 tablet_replica.cc:333] T 42ee36f017f44890aa7419e642abdc9b P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:03.037904 9430 raft_consensus.cc:2243] T 42ee36f017f44890aa7419e642abdc9b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:03.038079 9430 raft_consensus.cc:2272] T 42ee36f017f44890aa7419e642abdc9b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:03.031487 9157 tablet_service.cc:1505] Processing CreateTablet for tablet ae8a49b9a3bf4845943b1ad8e318ccbb (DEFAULT_TABLE table=default.Table_fb8fb745144644eea96b20d598f52fa2 [id=02a2b4848c874afe8f9860eee9bc6ce7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.038643 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae8a49b9a3bf4845943b1ad8e318ccbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.039898 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 062a482917794ae5a67ec685a2491ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:03.040397 8844 catalog_manager.cc:4952] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 062a482917794ae5a67ec685a2491ba2 because the tablet was not found. No further retry: Not found: Tablet not found: 062a482917794ae5a67ec685a2491ba2
I20251215 14:55:03.040305 8855 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_7231bb3c534046a98fc17c3557841d6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:03.040597 9435 tablet_bootstrap.cc:654] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:03.040853 8855 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7231bb3c534046a98fc17c3557841d6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.041532 9431 ts_tablet_manager.cc:1916] T 3670e4f699894059a3f09a33a744e9f9 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:03.043673 9288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a597fd6c7c044228ffb2a5a5f924e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.044059 9426 tablet_bootstrap.cc:492] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:03.031533 9153 tablet_service.cc:1505] Processing CreateTablet for tablet 7f38c44dbc884d74a61c7ed98deaf6aa (DEFAULT_TABLE table=default.Table_78b33227a8994e23ad7f3be637d971c5 [id=bec2dd63f0aa4a05961adb6a70fbfd94]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.031867 9160 tablet_service.cc:1505] Processing CreateTablet for tablet 0db6246dee2643d98094408410618259 (DEFAULT_TABLE table=default.Table_7fc4f71e01fa474594d5f0520e59e3f9 [id=8b906a02cb6b4a38b32c281a9693b9fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.044220 9426 ts_tablet_manager.cc:1403] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.075s user 0.003s sys 0.000s
I20251215 14:55:03.032079 9151 tablet_service.cc:1505] Processing CreateTablet for tablet 9425749d471f4f95bbae030977e278e4 (DEFAULT_TABLE table=default.Table_cf4fb411bb6e4356b431fac7a99ea842 [id=854a4abf12494d508d8aaf1a794d3dfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.032212 9154 tablet_service.cc:1505] Processing CreateTablet for tablet 26876cdffd7e4664bc8f7efb74885776 (DEFAULT_TABLE table=default.Table_4a6a8f85c67347de8eb61c8ffd16abf1 [id=f7ff7105e6354208854c3cb99d0885c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.032586 9149 tablet_service.cc:1505] Processing CreateTablet for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 (DEFAULT_TABLE table=default.Table_0593d9b93de9400ba29718af1b328262 [id=50a94314f5ba46e3a75b5a15e7362299]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.032642 9152 tablet_service.cc:1505] Processing CreateTablet for tablet 0a597fd6c7c044228ffb2a5a5f924e70 (DEFAULT_TABLE table=default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.044443 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9425749d471f4f95bbae030977e278e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.033082 9150 tablet_service.cc:1505] Processing CreateTablet for tablet b9b39c879d444172871f43349978dc86 (DEFAULT_TABLE table=default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b [id=472c67fefad54383b4ebac7e3c77d325]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.033555 9148 tablet_service.cc:1505] Processing CreateTablet for tablet 32432afc6e8d458bb7ed7abc42fb3dde (DEFAULT_TABLE table=default.Table_f416fea67a974ab084b7b48a60426131 [id=0e3677e1f3d048ecad508d50304ee56a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.033620 9145 tablet_service.cc:1505] Processing CreateTablet for tablet 1141b9a4cf3e4aa78529bed7f0375ff8 (DEFAULT_TABLE table=default.Table_385109da45d14eacb743f9b6540d33c1 [id=066e8ae14004436cb8b4f3f740b45b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.034021 9146 tablet_service.cc:1505] Processing CreateTablet for tablet df70bebdc8ad4f8186ba427e840799cf (DEFAULT_TABLE table=default.Table_d36b592f1eda4d99b3112955a84c390e [id=409ba53d42214908857200301c1b5ce6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.034471 9144 tablet_service.cc:1505] Processing CreateTablet for tablet f080b56cff244a46bfb73d05d3127f31 (DEFAULT_TABLE table=default.Table_cdef28a9eb234425846582441c49d740 [id=a81a53d1daa84a799510d1f4224eb1e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.036769 9147 tablet_service.cc:1505] Processing CreateTablet for tablet 3cdfcddd91fe47de8fd14dc718f421a6 (DEFAULT_TABLE table=default.Table_8c028f23aaf4428fab6a375c292e49b3 [id=2bd880b71b174f528054fbc22143c01f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.045030 9426 raft_consensus.cc:359] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.045243 9426 raft_consensus.cc:385] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.045315 9426 raft_consensus.cc:740] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.045608 9426 consensus_queue.cc:260] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.046121 9426 ts_tablet_manager.cc:1434] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:03.046418 9426 tablet_bootstrap.cc:492] T c0d0022e48f04b83ac1c998a83fe3f55 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:03.045032 9153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f38c44dbc884d74a61c7ed98deaf6aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.047814 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0db6246dee2643d98094408410618259. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.050696 8851 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 0db6246dee2643d98094408410618259
I20251215 14:55:03.051496 9148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32432afc6e8d458bb7ed7abc42fb3dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.052618 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26876cdffd7e4664bc8f7efb74885776. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:03.053660 8851 catalog_manager.cc:5487] Ignoring report from unknown tablet 26648bf286c94b2495e565969f945858
W20251215 14:55:03.053740 8851 catalog_manager.cc:5487] Ignoring report from unknown tablet 4816503e4fa1459dbb311997be85f64a
W20251215 14:55:03.054495 8851 catalog_manager.cc:5487] Ignoring report from unknown tablet 26648bf286c94b2495e565969f945858
I20251215 14:55:03.054924 8851 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_be16a6867c2746f89c6ea32a12291354" } new_table_name: "default.Table_08e092a0a75f48e89a6d074a91911704" modify_external_catalogs: true
I20251215 14:55:03.055398 9150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b39c879d444172871f43349978dc86. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.055428 8857 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet ce0154b24522401b9cc0e37fa502532f
I20251215 14:55:03.055898 9147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cdfcddd91fe47de8fd14dc718f421a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.059856 9152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a597fd6c7c044228ffb2a5a5f924e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.060169 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.060987 9151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9425749d471f4f95bbae030977e278e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.063725 9145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1141b9a4cf3e4aa78529bed7f0375ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.066735 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f080b56cff244a46bfb73d05d3127f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.070021 8853 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet f233746b84a94c589eb96d6ef3a8281d
I20251215 14:55:03.070272 9146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df70bebdc8ad4f8186ba427e840799cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.070899 8858 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 26876cdffd7e4664bc8f7efb74885776
I20251215 14:55:03.071538 8853 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_a469ba7678054925965fe69d826f1c16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.072099 8853 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a469ba7678054925965fe69d826f1c16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.075461 9279 tablet_service.cc:1552] Processing DeleteTablet for tablet 26876cdffd7e4664bc8f7efb74885776 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.075742 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet 11a5a6a0895c49648c910fa2ea3ca373 with delete_type TABLET_DATA_DELETED (replaced by tablet b03c5e1f44d34798b4d0dce88f951581) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.076174 9289 tablet_service.cc:1552] Processing DeleteTablet for tablet f233746b84a94c589eb96d6ef3a8281d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.076282 9432 tablet_replica.cc:333] T 11a5a6a0895c49648c910fa2ea3ca373 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:03.076375 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet ce0154b24522401b9cc0e37fa502532f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.076300 8858 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_94cdbda94a9242b388ffa89052d55f05" } new_table_name: "default.Table_fa4a417edbd04446b7cff43ff66d683b" modify_external_catalogs: true
I20251215 14:55:03.076463 9432 raft_consensus.cc:2243] T 11a5a6a0895c49648c910fa2ea3ca373 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:03.076639 9432 raft_consensus.cc:2272] T 11a5a6a0895c49648c910fa2ea3ca373 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:03.077491 9432 ts_tablet_manager.cc:1916] T 11a5a6a0895c49648c910fa2ea3ca373 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251215 14:55:03.078294 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 26876cdffd7e4664bc8f7efb74885776 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26876cdffd7e4664bc8f7efb74885776 already in progress: creating tablet
I20251215 14:55:03.079596 9155 tablet_service.cc:1552] Processing DeleteTablet for tablet ce0154b24522401b9cc0e37fa502532f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.079780 9158 tablet_service.cc:1552] Processing DeleteTablet for tablet f233746b84a94c589eb96d6ef3a8281d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.079968 9143 tablet_service.cc:1552] Processing DeleteTablet for tablet 26876cdffd7e4664bc8f7efb74885776 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.082823 9005 tablet_service.cc:1552] Processing DeleteTablet for tablet ce0154b24522401b9cc0e37fa502532f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:03.082895 9004 tablet_service.cc:1552] Processing DeleteTablet for tablet f233746b84a94c589eb96d6ef3a8281d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:03.083356 9004 tablet_service.cc:1552] Processing DeleteTablet for tablet 26876cdffd7e4664bc8f7efb74885776 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:03.083674 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 0db6246dee2643d98094408410618259 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:03.084442 9432 ts_tablet_manager.cc:1929] T 11a5a6a0895c49648c910fa2ea3ca373 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:03.084558 9432 log.cc:1199] T 11a5a6a0895c49648c910fa2ea3ca373 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/11a5a6a0895c49648c910fa2ea3ca373
I20251215 14:55:03.084919 9432 ts_tablet_manager.cc:1950] T 11a5a6a0895c49648c910fa2ea3ca373 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:03.086488 9441 raft_consensus.cc:493] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:03.086652 9441 raft_consensus.cc:515] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.087363 9441 leader_election.cc:290] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:03.087810 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_ada3150d10a34cb4aaf8a16a487fa543"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:03.088001 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c276eb6ad0414bb8ae5d553ae623edac" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:03.088250 9178 raft_consensus.cc:2468] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
W20251215 14:55:03.088363 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ada3150d10a34cb4aaf8a16a487fa543 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.088701 9249 leader_election.cc:304] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:03.089011 9441 raft_consensus.cc:2804] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:03.089119 9441 raft_consensus.cc:493] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:03.089206 9441 raft_consensus.cc:3060] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.091681 9441 raft_consensus.cc:515] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.092934 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c276eb6ad0414bb8ae5d553ae623edac" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:03.093148 9178 raft_consensus.cc:3060] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.095881 9441 leader_election.cc:290] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:03.096899 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet 4a6846144c8c409cad340e99374a38c6
I20251215 14:55:03.097993 9178 raft_consensus.cc:2468] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:03.098408 9249 leader_election.cc:304] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:03.100828 9426 tablet_bootstrap.cc:654] T c0d0022e48f04b83ac1c998a83fe3f55 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.103667 9294 tablet_service.cc:1505] Processing CreateTablet for tablet f080b56cff244a46bfb73d05d3127f31 (DEFAULT_TABLE table=default.Table_cdef28a9eb234425846582441c49d740 [id=a81a53d1daa84a799510d1f4224eb1e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.103842 9152 tablet_service.cc:1505] Processing CreateTablet for tablet 0215ff355fce46b5a4cf1bf4bd7164f3 (DEFAULT_TABLE table=default.Table_28c03048db094b5093cd88eb3dc6f7fe [id=cf0e40d55af1486db1df4e85048a070b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.104094 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f080b56cff244a46bfb73d05d3127f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.104168 9152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0215ff355fce46b5a4cf1bf4bd7164f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.107492 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 0215ff355fce46b5a4cf1bf4bd7164f3 (DEFAULT_TABLE table=default.Table_28c03048db094b5093cd88eb3dc6f7fe [id=cf0e40d55af1486db1df4e85048a070b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.107904 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0215ff355fce46b5a4cf1bf4bd7164f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.107985 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_e726b47802404f3aaccb61d6aaaa72a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.108531 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e726b47802404f3aaccb61d6aaaa72a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.113740 9489 raft_consensus.cc:2804] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:03.113891 9489 raft_consensus.cc:697] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:03.114118 9489 consensus_queue.cc:237] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.114365 9149 tablet_service.cc:1505] Processing CreateTablet for tablet 16edd0bfd67848e688fa12d9c679fdac (DEFAULT_TABLE table=default.Table_c1335c74e0f740b08e701ac0246125f0 [id=a4fa8fe05f924de6b14bcc04e80479ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.114769 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16edd0bfd67848e688fa12d9c679fdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.115109 9488 raft_consensus.cc:493] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:03.115300 9488 raft_consensus.cc:515] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.115845 9488 leader_election.cc:290] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:03.116591 9281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df70bebdc8ad4f8186ba427e840799cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.117254 9280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1141b9a4cf3e4aa78529bed7f0375ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.125348 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 16edd0bfd67848e688fa12d9c679fdac (DEFAULT_TABLE table=default.Table_c1335c74e0f740b08e701ac0246125f0 [id=a4fa8fe05f924de6b14bcc04e80479ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.125777 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16edd0bfd67848e688fa12d9c679fdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.129689 9426 tablet_bootstrap.cc:492] T c0d0022e48f04b83ac1c998a83fe3f55 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:03.129828 9426 ts_tablet_manager.cc:1403] T c0d0022e48f04b83ac1c998a83fe3f55 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.084s user 0.000s sys 0.003s
I20251215 14:55:03.130635 9426 raft_consensus.cc:359] T c0d0022e48f04b83ac1c998a83fe3f55 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.130811 9426 raft_consensus.cc:385] T c0d0022e48f04b83ac1c998a83fe3f55 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.130884 9426 raft_consensus.cc:740] T c0d0022e48f04b83ac1c998a83fe3f55 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.131078 9426 consensus_queue.cc:260] T c0d0022e48f04b83ac1c998a83fe3f55 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.131582 9426 ts_tablet_manager.cc:1434] T c0d0022e48f04b83ac1c998a83fe3f55 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:03.131862 9426 tablet_bootstrap.cc:492] T 018bd6ac8a534a6abc461b57b89b93eb P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:03.131979 9279 tablet_service.cc:1505] Processing CreateTablet for tablet 37181f50142f4d8bb88713221a755d50 (DEFAULT_TABLE table=default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e [id=6b4b04bb03f04a8a9cd7bc893acf612c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.132545 9279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37181f50142f4d8bb88713221a755d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.133414 9426 tablet_bootstrap.cc:654] T 018bd6ac8a534a6abc461b57b89b93eb P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.135540 9278 tablet_service.cc:1505] Processing CreateTablet for tablet 062a482917794ae5a67ec685a2491ba2 (DEFAULT_TABLE table=default.Table_55ea1e683a2d497caae977ff05d734d9 [id=4a706da6e5324264b591d6bd08911f8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.136055 9278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062a482917794ae5a67ec685a2491ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.137620 9152 tablet_service.cc:1505] Processing CreateTablet for tablet 37181f50142f4d8bb88713221a755d50 (DEFAULT_TABLE table=default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e [id=6b4b04bb03f04a8a9cd7bc893acf612c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.137991 9159 tablet_service.cc:1505] Processing CreateTablet for tablet c00aecc23c6541cbae4abd7cb1b3077b (DEFAULT_TABLE table=default.Table_4372b5372fdf4a0d991207a20dcbca19 [id=640d70bd78554e92823dc104e06227d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.138326 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c00aecc23c6541cbae4abd7cb1b3077b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.139439 9148 tablet_service.cc:1505] Processing CreateTablet for tablet bcd7d00fa01f4a9cbdf0d505684dab0e (DEFAULT_TABLE table=default.Table_f9cf4c41c7b846e88bae24711ee3421a [id=c427c258b3b443eea28d804f57a2bb30]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.139546 9277 tablet_service.cc:1505] Processing CreateTablet for tablet bcd7d00fa01f4a9cbdf0d505684dab0e (DEFAULT_TABLE table=default.Table_f9cf4c41c7b846e88bae24711ee3421a [id=c427c258b3b443eea28d804f57a2bb30]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.139776 9148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcd7d00fa01f4a9cbdf0d505684dab0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.140043 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcd7d00fa01f4a9cbdf0d505684dab0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.143512 9149 tablet_service.cc:1505] Processing CreateTablet for tablet 062a482917794ae5a67ec685a2491ba2 (DEFAULT_TABLE table=default.Table_55ea1e683a2d497caae977ff05d734d9 [id=4a706da6e5324264b591d6bd08911f8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.145453 9146 tablet_service.cc:1552] Processing DeleteTablet for tablet 0db6246dee2643d98094408410618259 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.145502 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062a482917794ae5a67ec685a2491ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.146449 9152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37181f50142f4d8bb88713221a755d50. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.147764 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb2f4fc179744458bc7db2f6c7197ec5" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:03.150825 9249 leader_election.cc:343] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:03.152454 9022 tablet_service.cc:1505] Processing CreateTablet for tablet 16edd0bfd67848e688fa12d9c679fdac (DEFAULT_TABLE table=default.Table_c1335c74e0f740b08e701ac0246125f0 [id=a4fa8fe05f924de6b14bcc04e80479ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.152848 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16edd0bfd67848e688fa12d9c679fdac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.154824 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c276eb6ad0414bb8ae5d553ae623edac" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:03.155494 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c276eb6ad0414bb8ae5d553ae623edac" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:03.156531 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb2f4fc179744458bc7db2f6c7197ec5" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:03.161849 9157 tablet_service.cc:1505] Processing CreateTablet for tablet 15a974e3265a4c88aa6d5005ffa04dc8 (DEFAULT_TABLE table=default.Table_ece44e44ff964192893318b9b02f5b95 [id=d3f4f5d7775b4973b6c2d07ee0952906]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.162266 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a974e3265a4c88aa6d5005ffa04dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.023905 9013 tablet_service.cc:1505] Processing CreateTablet for tablet 9425749d471f4f95bbae030977e278e4 (DEFAULT_TABLE table=default.Table_cf4fb411bb6e4356b431fac7a99ea842 [id=854a4abf12494d508d8aaf1a794d3dfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.024499 9009 tablet_service.cc:1505] Processing CreateTablet for tablet 3cdfcddd91fe47de8fd14dc718f421a6 (DEFAULT_TABLE table=default.Table_8c028f23aaf4428fab6a375c292e49b3 [id=2bd880b71b174f528054fbc22143c01f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.024816 9006 tablet_service.cc:1505] Processing CreateTablet for tablet f080b56cff244a46bfb73d05d3127f31 (DEFAULT_TABLE table=default.Table_cdef28a9eb234425846582441c49d740 [id=a81a53d1daa84a799510d1f4224eb1e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.024919 9008 tablet_service.cc:1505] Processing CreateTablet for tablet df70bebdc8ad4f8186ba427e840799cf (DEFAULT_TABLE table=default.Table_d36b592f1eda4d99b3112955a84c390e [id=409ba53d42214908857200301c1b5ce6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.025003 9007 tablet_service.cc:1505] Processing CreateTablet for tablet 1141b9a4cf3e4aa78529bed7f0375ff8 (DEFAULT_TABLE table=default.Table_385109da45d14eacb743f9b6540d33c1 [id=066e8ae14004436cb8b4f3f740b45b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.025347 9011 tablet_service.cc:1505] Processing CreateTablet for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 (DEFAULT_TABLE table=default.Table_0593d9b93de9400ba29718af1b328262 [id=50a94314f5ba46e3a75b5a15e7362299]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.024400 9010 tablet_service.cc:1505] Processing CreateTablet for tablet 32432afc6e8d458bb7ed7abc42fb3dde (DEFAULT_TABLE table=default.Table_f416fea67a974ab084b7b48a60426131 [id=0e3677e1f3d048ecad508d50304ee56a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.165285 9149 tablet_service.cc:1505] Processing CreateTablet for tablet f9411030d08d40aabbdee6670ba95821 (DEFAULT_TABLE table=default.Table_2e94c716d0fd4f4688b6bcbe468f8c5a [id=f8964b6550d0494684b46e09cf8731ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.165701 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9411030d08d40aabbdee6670ba95821. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.165782 9426 tablet_bootstrap.cc:492] T 018bd6ac8a534a6abc461b57b89b93eb P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:03.165946 9426 ts_tablet_manager.cc:1403] T 018bd6ac8a534a6abc461b57b89b93eb P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.012s
I20251215 14:55:03.154512 9005 tablet_service.cc:1505] Processing CreateTablet for tablet 062a482917794ae5a67ec685a2491ba2 (DEFAULT_TABLE table=default.Table_55ea1e683a2d497caae977ff05d734d9 [id=4a706da6e5324264b591d6bd08911f8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.154893 9003 tablet_service.cc:1505] Processing CreateTablet for tablet bcd7d00fa01f4a9cbdf0d505684dab0e (DEFAULT_TABLE table=default.Table_f9cf4c41c7b846e88bae24711ee3421a [id=c427c258b3b443eea28d804f57a2bb30]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.166752 9426 raft_consensus.cc:359] T 018bd6ac8a534a6abc461b57b89b93eb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.166960 9426 raft_consensus.cc:385] T 018bd6ac8a534a6abc461b57b89b93eb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.167039 9426 raft_consensus.cc:740] T 018bd6ac8a534a6abc461b57b89b93eb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.167330 9426 consensus_queue.cc:260] T 018bd6ac8a534a6abc461b57b89b93eb P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.162886 9012 tablet_service.cc:1505] Processing CreateTablet for tablet b9b39c879d444172871f43349978dc86 (DEFAULT_TABLE table=default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b [id=472c67fefad54383b4ebac7e3c77d325]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.154485 9004 tablet_service.cc:1505] Processing CreateTablet for tablet 37181f50142f4d8bb88713221a755d50 (DEFAULT_TABLE table=default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e [id=6b4b04bb03f04a8a9cd7bc893acf612c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.169369 9020 tablet_service.cc:1505] Processing CreateTablet for tablet 26876cdffd7e4664bc8f7efb74885776 (DEFAULT_TABLE table=default.Table_4a6a8f85c67347de8eb61c8ffd16abf1 [id=f7ff7105e6354208854c3cb99d0885c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.169561 9426 ts_tablet_manager.cc:1434] T 018bd6ac8a534a6abc461b57b89b93eb P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:03.171208 9426 tablet_bootstrap.cc:492] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:03.171602 9021 tablet_service.cc:1505] Processing CreateTablet for tablet ce0154b24522401b9cc0e37fa502532f (DEFAULT_TABLE table=default.Table_306b2bfc23214c618f695c55cca31974 [id=aadcdc13fe3e4d66aade3a7d8ec2afc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.171783 9430 ts_tablet_manager.cc:1916] T 42ee36f017f44890aa7419e642abdc9b P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:03.172060 9009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cdfcddd91fe47de8fd14dc718f421a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.172883 9426 tablet_bootstrap.cc:654] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.172963 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9425749d471f4f95bbae030977e278e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.173784 9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.174674 9008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df70bebdc8ad4f8186ba427e840799cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.175585 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1141b9a4cf3e4aa78529bed7f0375ff8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.177381 9004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37181f50142f4d8bb88713221a755d50. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:03.180155 9487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251215 14:55:03.180575 9487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251215 14:55:03.180696 9487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20251215 14:55:03.180723 9426 tablet_bootstrap.cc:492] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:03.180852 9426 ts_tablet_manager.cc:1403] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.009s
I20251215 14:55:03.181694 9426 raft_consensus.cc:359] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.181865 9426 raft_consensus.cc:385] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.181946 9426 raft_consensus.cc:740] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.182163 9426 consensus_queue.cc:260] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.182952 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26876cdffd7e4664bc8f7efb74885776. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:03.183267 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet c0d0022e48f04b83ac1c998a83fe3f55
I20251215 14:55:03.183682 9426 ts_tablet_manager.cc:1434] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20251215 14:55:03.185078 9426 tablet_bootstrap.cc:492] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:03.185343 8852 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_325fc3ac5852480abe281caa59c90f80" } new_table_name: "default.Table_1bb39cbc0ffc44e0bb931ca61a9ae0f6" modify_external_catalogs: true
I20251215 14:55:03.186779 9426 tablet_bootstrap.cc:654] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.190018 8856 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet c276eb6ad0414bb8ae5d553ae623edac
I20251215 14:55:03.190007 9014 tablet_service.cc:1505] Processing CreateTablet for tablet c00aecc23c6541cbae4abd7cb1b3077b (DEFAULT_TABLE table=default.Table_4372b5372fdf4a0d991207a20dcbca19 [id=640d70bd78554e92823dc104e06227d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.190498 8856 catalog_manager.cc:6724] ReplaceTablet: tablet c276eb6ad0414bb8ae5d553ae623edac deleted and replaced by tablet bb3b95d32c7044bd8a4451381c19aeba
I20251215 14:55:03.191706 8859 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_4e8289ad9bc747669339100d67364d2e" } new_table_name: "default.Table_20d2c5b358444df59324e21800508f8d" modify_external_catalogs: true
I20251215 14:55:03.192516 9430 ts_tablet_manager.cc:1929] T 42ee36f017f44890aa7419e642abdc9b P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:03.192790 9006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f080b56cff244a46bfb73d05d3127f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.193174 8856 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_78b33227a8994e23ad7f3be637d971c5" } new_table_name: "default.Table_74cef17050464ec6968b0d9dce366720" modify_external_catalogs: true
I20251215 14:55:03.193091 9018 tablet_service.cc:1505] Processing CreateTablet for tablet 0215ff355fce46b5a4cf1bf4bd7164f3 (DEFAULT_TABLE table=default.Table_28c03048db094b5093cd88eb3dc6f7fe [id=cf0e40d55af1486db1df4e85048a070b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.194442 9430 log.cc:1199] T 42ee36f017f44890aa7419e642abdc9b P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/42ee36f017f44890aa7419e642abdc9b
I20251215 14:55:03.195732 9430 ts_tablet_manager.cc:1950] T 42ee36f017f44890aa7419e642abdc9b P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:03.197670 9430 tablet_replica.cc:333] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
W20251215 14:55:03.198783 9248 leader_election.cc:343] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:03.198076 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 42ee36f017f44890aa7419e642abdc9b (table default.Table_b5df39fee38d439b9ba457db54ec272b [id=474a03e23b9c4389bb07035b37e59612]) successfully deleted
W20251215 14:55:03.199707 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet ce0154b24522401b9cc0e37fa502532f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce0154b24522401b9cc0e37fa502532f already in progress: creating tablet
I20251215 14:55:03.199723 9156 tablet_service.cc:1552] Processing DeleteTablet for tablet c276eb6ad0414bb8ae5d553ae623edac with delete_type TABLET_DATA_DELETED (replaced by tablet bb3b95d32c7044bd8a4451381c19aeba) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.200037 9430 raft_consensus.cc:2243] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:03.200485 9003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcd7d00fa01f4a9cbdf0d505684dab0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.200811 9430 raft_consensus.cc:2272] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:03.202790 9017 tablet_service.cc:1505] Processing CreateTablet for tablet f9411030d08d40aabbdee6670ba95821 (DEFAULT_TABLE table=default.Table_2e94c716d0fd4f4688b6bcbe468f8c5a [id=f8964b6550d0494684b46e09cf8731ff]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:03.203414 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet 4f1f902cbcb643b9b98fa3d72babba79
I20251215 14:55:03.203425 9430 ts_tablet_manager.cc:1916] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251215 14:55:03.203512 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet 018bd6ac8a534a6abc461b57b89b93eb
I20251215 14:55:03.205150 9016 tablet_service.cc:1505] Processing CreateTablet for tablet 15a974e3265a4c88aa6d5005ffa04dc8 (DEFAULT_TABLE table=default.Table_ece44e44ff964192893318b9b02f5b95 [id=d3f4f5d7775b4973b6c2d07ee0952906]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.205178 8854 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_a56faaf463d84718bfd9c88b0825220c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.205739 8854 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a56faaf463d84718bfd9c88b0825220c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.213495 9430 ts_tablet_manager.cc:1929] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:03.213634 9430 log.cc:1199] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/f233746b84a94c589eb96d6ef3a8281d
I20251215 14:55:03.213961 9430 ts_tablet_manager.cc:1950] T f233746b84a94c589eb96d6ef3a8281d P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:03.217772 9430 tablet_replica.cc:333] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:03.218001 9430 raft_consensus.cc:2243] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:03.218159 9430 raft_consensus.cc:2272] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:03.221140 8855 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_cf4fb411bb6e4356b431fac7a99ea842" } modify_external_catalogs: true
I20251215 14:55:03.221359 8855 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_cf4fb411bb6e4356b431fac7a99ea842" } modify_external_catalogs: true
W20251215 14:55:03.228853 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet a28289e1e5334512b2240c3b571d9424 (table default.Table_28c03048db094b5093cd88eb3dc6f7fe [id=cf0e40d55af1486db1df4e85048a070b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a28289e1e5334512b2240c3b571d9424 consensus state has no leader
I20251215 14:55:03.235656 9015 tablet_service.cc:1552] Processing DeleteTablet for tablet c276eb6ad0414bb8ae5d553ae623edac with delete_type TABLET_DATA_DELETED (replaced by tablet bb3b95d32c7044bd8a4451381c19aeba) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:03.236464 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0215ff355fce46b5a4cf1bf4bd7164f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.238046 9017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9411030d08d40aabbdee6670ba95821. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.238472 9010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32432afc6e8d458bb7ed7abc42fb3dde. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.239377 9005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 062a482917794ae5a67ec685a2491ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.239846 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c00aecc23c6541cbae4abd7cb1b3077b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.240825 9021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce0154b24522401b9cc0e37fa502532f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.241597 9012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9b39c879d444172871f43349978dc86. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.242367 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a974e3265a4c88aa6d5005ffa04dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.244419 9430 ts_tablet_manager.cc:1916] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:03.255337 9507 raft_consensus.cc:493] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:03.255532 9507 raft_consensus.cc:515] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.256119 9507 leader_election.cc:290] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:03.257524 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet f233746b84a94c589eb96d6ef3a8281d (table default.Table_f6179b6a903946ac9b6a982c9ff87304 [id=a3674eb3a67e4505a0db527d556d5e93]) successfully deleted
I20251215 14:55:03.257777 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1f902cbcb643b9b98fa3d72babba79" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:03.258481 9112 leader_election.cc:343] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:03.260900 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet 0db6246dee2643d98094408410618259 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:02 UTC) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:03.260972 9487 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20251215 14:55:03.261063 9487 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
I20251215 14:55:03.261106 9432 tablet_replica.cc:333] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4: stopping tablet replica
W20251215 14:55:03.261134 9487 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251215 14:55:03.261193 9487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
I20251215 14:55:03.261833 9441 raft_consensus.cc:493] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:03.262223 9487 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251215 14:55:03.262494 9487 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20251215 14:55:03.268070 9248 leader_election.cc:343] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:03.268379 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 69047.1us
W20251215 14:55:03.268771 9248 leader_election.cc:343] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:03.268894 9248 leader_election.cc:304] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:03.275730 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 15a974e3265a4c88aa6d5005ffa04dc8 (DEFAULT_TABLE table=default.Table_ece44e44ff964192893318b9b02f5b95 [id=d3f4f5d7775b4973b6c2d07ee0952906]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.276928 9441 raft_consensus.cc:515] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.277573 9276 tablet_service.cc:1505] Processing CreateTablet for tablet c00aecc23c6541cbae4abd7cb1b3077b (DEFAULT_TABLE table=default.Table_4372b5372fdf4a0d991207a20dcbca19 [id=640d70bd78554e92823dc104e06227d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.283082 9432 raft_consensus.cc:2243] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:03.283583 9432 pending_rounds.cc:70] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4: Trying to abort 1 pending ops.
I20251215 14:55:03.284502 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1f902cbcb643b9b98fa3d72babba79" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:03.286459 9314 raft_consensus.cc:2468] T 4f1f902cbcb643b9b98fa3d72babba79 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:03.287741 9115 leader_election.cc:304] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:03.288193 9507 raft_consensus.cc:2804] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:03.288282 9507 raft_consensus.cc:493] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:03.288385 9507 raft_consensus.cc:3060] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.289332 9430 ts_tablet_manager.cc:1929] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:03.289489 9430 log.cc:1199] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/c276eb6ad0414bb8ae5d553ae623edac
I20251215 14:55:03.289902 9430 ts_tablet_manager.cc:1950] T c276eb6ad0414bb8ae5d553ae623edac P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:03.293334 9441 leader_election.cc:290] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:03.293999 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15a974e3265a4c88aa6d5005ffa04dc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.295187 9432 pending_rounds.cc:77] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232759818164621312 op_type: NO_OP noop_request { }
I20251215 14:55:03.295552 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "018bd6ac8a534a6abc461b57b89b93eb" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:03.295770 9178 raft_consensus.cc:2468] T 018bd6ac8a534a6abc461b57b89b93eb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:03.299263 9489 raft_consensus.cc:2749] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:03.299690 9276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c00aecc23c6541cbae4abd7cb1b3077b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.301160 9487 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.121.148:35915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.121.190:44279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.121.190
--webserver_port=40239
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type FASTDEBUG
built by None at 15 Dec 2025 14:43:20 UTC on 24a791456cd2
build id 9528
ASAN enabled
I20251215 14:55:03.291043 9507 raft_consensus.cc:515] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.305502 9507 leader_election.cc:290] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:03.304395 9249 leader_election.cc:304] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:03.306161 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1f902cbcb643b9b98fa3d72babba79" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:03.307971 9487 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251215 14:55:03.304482 9432 raft_consensus.cc:2889] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 14:55:03.309072 9431 ts_tablet_manager.cc:1929] T 3670e4f699894059a3f09a33a744e9f9 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:03.309559 9431 log.cc:1199] T 3670e4f699894059a3f09a33a744e9f9 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/3670e4f699894059a3f09a33a744e9f9
I20251215 14:55:03.309769 9286 tablet_service.cc:1552] Processing DeleteTablet for tablet c276eb6ad0414bb8ae5d553ae623edac with delete_type TABLET_DATA_DELETED (replaced by tablet bb3b95d32c7044bd8a4451381c19aeba) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.310328 9431 ts_tablet_manager.cc:1950] T 3670e4f699894059a3f09a33a744e9f9 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
W20251215 14:55:03.310570 9112 leader_election.cc:343] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:03.311947 9489 raft_consensus.cc:2804] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:03.312817 9487 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251215 14:55:03.312970 9432 raft_consensus.cc:2272] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:03.313189 9489 raft_consensus.cc:493] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:03.313304 9489 raft_consensus.cc:3060] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.313989 9432 ts_tablet_manager.cc:1916] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:03.314122 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1f902cbcb643b9b98fa3d72babba79" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:03.314311 9314 raft_consensus.cc:3060] T 4f1f902cbcb643b9b98fa3d72babba79 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.318279 9489 raft_consensus.cc:515] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.318902 9489 leader_election.cc:290] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:03.319706 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "018bd6ac8a534a6abc461b57b89b93eb" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:03.319922 9178 raft_consensus.cc:3060] T 018bd6ac8a534a6abc461b57b89b93eb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.322455 9178 raft_consensus.cc:2468] T 018bd6ac8a534a6abc461b57b89b93eb P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:03.322885 9249 leader_election.cc:304] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:03.259771 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 11a5a6a0895c49648c910fa2ea3ca373 (table default.Table_1eea41fb41014a0e88ffd907fa069d19 [id=143242e2febc41f7bc9ba1ed9f832886]) successfully deleted
W20251215 14:55:03.326558 8846 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 66792.5us
I20251215 14:55:03.327188 8855 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 9425749d471f4f95bbae030977e278e4
I20251215 14:55:03.327523 8854 master_service.cc:954] ReplaceTablet: received request to replace tablet c4f47c22111c427a8ab9c4ae1e105375 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:03.327770 8855 master_service.cc:954] ReplaceTablet: received request to replace tablet 1141b9a4cf3e4aa78529bed7f0375ff8 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:03.270457 8853 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_988b525ae25a4226b20a0caf2630d61f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.328465 8853 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_988b525ae25a4226b20a0caf2630d61f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.329210 9314 raft_consensus.cc:2468] T 4f1f902cbcb643b9b98fa3d72babba79 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
W20251215 14:55:03.274516 8858 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f7af1f66c4f04f649379758ff1b3e387 has no consensus state
I20251215 14:55:03.329732 9115 leader_election.cc:304] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:03.329789 8858 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_ee51c1b494fe43d4b541ca7bd142bb26" } modify_external_catalogs: true
I20251215 14:55:03.329959 8858 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_ee51c1b494fe43d4b541ca7bd142bb26" } modify_external_catalogs: true
I20251215 14:55:03.330435 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 9425749d471f4f95bbae030977e278e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.330670 9507 raft_consensus.cc:2804] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:03.296554 8857 master_service.cc:954] ReplaceTablet: received request to replace tablet 37181f50142f4d8bb88713221a755d50 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:03.331579 9507 raft_consensus.cc:697] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
W20251215 14:55:03.307422 8851 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 194bb745ecb849cb9092fee1afb7dbe6 has no consensus state
I20251215 14:55:03.307562 8850 master_service.cc:954] ReplaceTablet: received request to replace tablet 32432afc6e8d458bb7ed7abc42fb3dde from {username='slave'} at 127.0.0.1:34038
W20251215 14:55:03.315316 8852 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f32a6e8df31d482fa9b9686e002d81ff consensus state has no leader
I20251215 14:55:03.331874 9507 consensus_queue.cc:237] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:03.315575 8859 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 429c0b2d7cb2428c8de6b02acde36044 consensus state has no leader
W20251215 14:55:03.323261 8856 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f38c44dbc884d74a61c7ed98deaf6aa consensus state has no leader
W20251215 14:55:03.333348 8844 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 75794.3us
W20251215 14:55:03.333580 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 26876cdffd7e4664bc8f7efb74885776 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26876cdffd7e4664bc8f7efb74885776 already in progress: creating tablet
W20251215 14:55:03.333892 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 0db6246dee2643d98094408410618259 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0db6246dee2643d98094408410618259 already in progress: creating tablet
I20251215 14:55:03.334008 9489 raft_consensus.cc:2804] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:03.334087 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet c276eb6ad0414bb8ae5d553ae623edac (table default.Table_d884e36a60cf4a109778a5bfa32afaa8 [id=7ec65d77d89d4e40a60b716f721e2940]) successfully deleted
I20251215 14:55:03.334595 9157 tablet_service.cc:1552] Processing DeleteTablet for tablet 9425749d471f4f95bbae030977e278e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.334846 9489 raft_consensus.cc:697] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:03.335208 9489 consensus_queue.cc:237] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.339375 8852 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_c4412f55395440a585a59f6946511436" } modify_external_catalogs: true
I20251215 14:55:03.339442 9292 tablet_service.cc:1505] Processing CreateTablet for tablet f9411030d08d40aabbdee6670ba95821 (DEFAULT_TABLE table=default.Table_2e94c716d0fd4f4688b6bcbe468f8c5a [id=f8964b6550d0494684b46e09cf8731ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.339566 8852 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_c4412f55395440a585a59f6946511436" } modify_external_catalogs: true
I20251215 14:55:03.339849 9292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9411030d08d40aabbdee6670ba95821. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.344163 8851 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_23c657126ccf46fabe10f93f2e991891" } modify_external_catalogs: true
I20251215 14:55:03.344353 8851 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_23c657126ccf46fabe10f93f2e991891" } modify_external_catalogs: true
I20251215 14:55:03.345232 8859 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_dfe31a947f834d55a5f909708df6ff9d" } modify_external_catalogs: true
I20251215 14:55:03.345377 8859 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_dfe31a947f834d55a5f909708df6ff9d" } modify_external_catalogs: true
I20251215 14:55:03.349375 9433 raft_consensus.cc:493] T 26648bf286c94b2495e565969f945858 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:03.349529 9433 raft_consensus.cc:515] T 26648bf286c94b2495e565969f945858 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.350425 9433 leader_election.cc:290] T 26648bf286c94b2495e565969f945858 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:03.350543 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26648bf286c94b2495e565969f945858" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:03.350555 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "018bd6ac8a534a6abc461b57b89b93eb" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:03.350736 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26648bf286c94b2495e565969f945858" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:03.351140 9314 raft_consensus.cc:2393] T 26648bf286c94b2495e565969f945858 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:03.351207 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "018bd6ac8a534a6abc461b57b89b93eb" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:03.351264 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 9425749d471f4f95bbae030977e278e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9425749d471f4f95bbae030977e278e4 already in progress: creating tablet
I20251215 14:55:03.352123 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 3670e4f699894059a3f09a33a744e9f9 (table default.Table_37b271542ee44db68c2370937f9daa7a [id=ebef5a7cb50445b9a84f9d458c3c7129]) successfully deleted
I20251215 14:55:03.352973 8856 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_77da0b679b494783bb486ac3e8887892"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.353171 9248 leader_election.cc:343] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:03.353497 9248 leader_election.cc:343] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:03.353564 8856 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77da0b679b494783bb486ac3e8887892 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.357512 8855 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 1141b9a4cf3e4aa78529bed7f0375ff8
I20251215 14:55:03.357841 8854 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:03.357993 8855 catalog_manager.cc:6724] ReplaceTablet: tablet 1141b9a4cf3e4aa78529bed7f0375ff8 deleted and replaced by tablet bafc5063058a469bb9c9b3e5345eb1be
I20251215 14:55:03.358438 8854 catalog_manager.cc:6724] ReplaceTablet: tablet c4f47c22111c427a8ab9c4ae1e105375 deleted and replaced by tablet 5c5e45c102ea4ff899fbc286f30700fc
W20251215 14:55:03.358716 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet 4f1f902cbcb643b9b98fa3d72babba79
W20251215 14:55:03.359248 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet 018bd6ac8a534a6abc461b57b89b93eb
I20251215 14:55:03.359117 9432 ts_tablet_manager.cc:1929] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:03.361086 9157 tablet_service.cc:1552] Processing DeleteTablet for tablet 1141b9a4cf3e4aa78529bed7f0375ff8 with delete_type TABLET_DATA_DELETED (replaced by tablet bafc5063058a469bb9c9b3e5345eb1be) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.361346 9149 tablet_service.cc:1552] Processing DeleteTablet for tablet c4f47c22111c427a8ab9c4ae1e105375 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c5e45c102ea4ff899fbc286f30700fc) from {username='slave'} at 127.0.0.1:54874
W20251215 14:55:03.362658 9557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 14:55:03.362890 9289 tablet_service.cc:1552] Processing DeleteTablet for tablet 1141b9a4cf3e4aa78529bed7f0375ff8 with delete_type TABLET_DATA_DELETED (replaced by tablet bafc5063058a469bb9c9b3e5345eb1be) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.363092 9432 log.cc:1199] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/f233746b84a94c589eb96d6ef3a8281d
I20251215 14:55:03.363538 9432 ts_tablet_manager.cc:1950] T f233746b84a94c589eb96d6ef3a8281d P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
W20251215 14:55:03.363914 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 1141b9a4cf3e4aa78529bed7f0375ff8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1141b9a4cf3e4aa78529bed7f0375ff8 already in progress: creating tablet
W20251215 14:55:03.364161 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet c4f47c22111c427a8ab9c4ae1e105375 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4f47c22111c427a8ab9c4ae1e105375 already in progress: creating tablet
I20251215 14:55:03.364496 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet f233746b84a94c589eb96d6ef3a8281d (table default.Table_f6179b6a903946ac9b6a982c9ff87304 [id=a3674eb3a67e4505a0db527d556d5e93]) successfully deleted
W20251215 14:55:03.366446 8843 catalog_manager.cc:4952] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 062a482917794ae5a67ec685a2491ba2 because the tablet was not found. No further retry: Not found: Tablet not found: 062a482917794ae5a67ec685a2491ba2
I20251215 14:55:03.366497 9426 tablet_bootstrap.cc:492] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:03.366644 9426 ts_tablet_manager.cc:1403] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.182s user 0.019s sys 0.031s
I20251215 14:55:03.366762 8858 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 1815a14b6ec54a2e96dabee744fb9fb6
W20251215 14:55:03.368033 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet ce0154b24522401b9cc0e37fa502532f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce0154b24522401b9cc0e37fa502532f already in progress: creating tablet
W20251215 14:55:03.368587 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 0db6246dee2643d98094408410618259 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0db6246dee2643d98094408410618259 already in progress: creating tablet
I20251215 14:55:03.368810 9435 tablet_bootstrap.cc:492] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:03.368875 9432 tablet_replica.cc:333] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:03.368971 9435 ts_tablet_manager.cc:1403] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.333s user 0.013s sys 0.050s
I20251215 14:55:03.369088 9432 raft_consensus.cc:2243] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:03.369323 9432 pending_rounds.cc:70] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4: Trying to abort 1 pending ops.
I20251215 14:55:03.369419 9432 pending_rounds.cc:77] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232759820757946368 op_type: NO_OP noop_request { }
I20251215 14:55:03.369546 9432 raft_consensus.cc:2889] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 14:55:03.369671 9432 raft_consensus.cc:2272] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:03.369673 9016 tablet_service.cc:1552] Processing DeleteTablet for tablet 9425749d471f4f95bbae030977e278e4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:03.370486 9432 ts_tablet_manager.cc:1916] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:03.370397 9426 raft_consensus.cc:359] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.370576 9426 raft_consensus.cc:385] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.370151 9435 raft_consensus.cc:359] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.371460 9435 raft_consensus.cc:385] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.371555 9435 raft_consensus.cc:740] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.371675 9292 tablet_service.cc:1552] Processing DeleteTablet for tablet c4f47c22111c427a8ab9c4ae1e105375 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c5e45c102ea4ff899fbc286f30700fc) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.371805 9435 consensus_queue.cc:260] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.371914 9426 raft_consensus.cc:740] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.372278 9435 ts_tablet_manager.cc:1434] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:03.372617 9435 tablet_bootstrap.cc:492] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:03.372861 9016 tablet_service.cc:1552] Processing DeleteTablet for tablet 1141b9a4cf3e4aa78529bed7f0375ff8 with delete_type TABLET_DATA_DELETED (replaced by tablet bafc5063058a469bb9c9b3e5345eb1be) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:03.374706 9016 tablet_service.cc:1552] Processing DeleteTablet for tablet c4f47c22111c427a8ab9c4ae1e105375 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c5e45c102ea4ff899fbc286f30700fc) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:03.377164 8843 catalog_manager.cc:4952] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet ce0154b24522401b9cc0e37fa502532f because the tablet was not found. No further retry: Not found: Tablet not found: ce0154b24522401b9cc0e37fa502532f
I20251215 14:55:03.379899 8858 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 429c0b2d7cb2428c8de6b02acde36044 (table default.Table_20d2c5b358444df59324e21800508f8d [id=c421ca23de494f4ba674e4cc86bac3da]). Expected version 1 got 0
I20251215 14:55:03.380293 8978 leader_election.cc:304] T 26648bf286c94b2495e565969f945858 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:03.380755 9433 raft_consensus.cc:3060] T 26648bf286c94b2495e565969f945858 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.382422 9432 ts_tablet_manager.cc:1929] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:03.382719 9432 log.cc:1199] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/c276eb6ad0414bb8ae5d553ae623edac
I20251215 14:55:03.384275 8857 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 37181f50142f4d8bb88713221a755d50
I20251215 14:55:03.384692 8858 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 429c0b2d7cb2428c8de6b02acde36044 (table default.Table_20d2c5b358444df59324e21800508f8d [id=c421ca23de494f4ba674e4cc86bac3da]). Expected version 1 got 0
I20251215 14:55:03.385581 8857 catalog_manager.cc:6724] ReplaceTablet: tablet 37181f50142f4d8bb88713221a755d50 deleted and replaced by tablet 4af4cf6ec825467383349098eda661c6
I20251215 14:55:03.386735 9292 tablet_service.cc:1552] Processing DeleteTablet for tablet 37181f50142f4d8bb88713221a755d50 with delete_type TABLET_DATA_DELETED (replaced by tablet 4af4cf6ec825467383349098eda661c6) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.389181 9019 tablet_service.cc:1552] Processing DeleteTablet for tablet 37181f50142f4d8bb88713221a755d50 with delete_type TABLET_DATA_DELETED (replaced by tablet 4af4cf6ec825467383349098eda661c6) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:03.390865 9433 raft_consensus.cc:2749] T 26648bf286c94b2495e565969f945858 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:03.385905 9149 tablet_service.cc:1552] Processing DeleteTablet for tablet 37181f50142f4d8bb88713221a755d50 with delete_type TABLET_DATA_DELETED (replaced by tablet 4af4cf6ec825467383349098eda661c6) from {username='slave'} at 127.0.0.1:54874
W20251215 14:55:03.392822 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 37181f50142f4d8bb88713221a755d50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37181f50142f4d8bb88713221a755d50 already in progress: creating tablet
I20251215 14:55:03.379232 9426 consensus_queue.cc:260] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.397424 9427 tablet_bootstrap.cc:492] T 4a6846144c8c409cad340e99374a38c6 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:03.398494 9426 ts_tablet_manager.cc:1434] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.032s user 0.000s sys 0.002s
I20251215 14:55:03.398561 9427 ts_tablet_manager.cc:1403] T 4a6846144c8c409cad340e99374a38c6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.394s user 0.036s sys 0.061s
I20251215 14:55:03.398727 9432 ts_tablet_manager.cc:1950] T c276eb6ad0414bb8ae5d553ae623edac P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:03.398838 9431 tablet_replica.cc:333] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:03.399889 9427 raft_consensus.cc:359] T 4a6846144c8c409cad340e99374a38c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.399964 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet c276eb6ad0414bb8ae5d553ae623edac (table default.Table_d884e36a60cf4a109778a5bfa32afaa8 [id=7ec65d77d89d4e40a60b716f721e2940]) successfully deleted
W20251215 14:55:03.400869 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 9425749d471f4f95bbae030977e278e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9425749d471f4f95bbae030977e278e4 already in progress: creating tablet
W20251215 14:55:03.401058 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 1141b9a4cf3e4aa78529bed7f0375ff8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1141b9a4cf3e4aa78529bed7f0375ff8 already in progress: creating tablet
W20251215 14:55:03.401224 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet c4f47c22111c427a8ab9c4ae1e105375 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4f47c22111c427a8ab9c4ae1e105375 already in progress: creating tablet
W20251215 14:55:03.401394 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 37181f50142f4d8bb88713221a755d50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37181f50142f4d8bb88713221a755d50 already in progress: creating tablet
I20251215 14:55:03.402208 9426 tablet_bootstrap.cc:492] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:03.402604 8854 master_service.cc:954] ReplaceTablet: received request to replace tablet 80d4c9b533ac4facb4205aff84903134 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:03.402848 9435 tablet_bootstrap.cc:654] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.403797 9426 tablet_bootstrap.cc:654] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:03.403820 9558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 14:55:03.403937 9427 raft_consensus.cc:385] T 4a6846144c8c409cad340e99374a38c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.404031 9427 raft_consensus.cc:740] T 4a6846144c8c409cad340e99374a38c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.404577 8855 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_c9cd184036e942449e5f5a3d806a1000"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:03.405000 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_07084f618f754b739e18f98bf0a3b7b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.405176 8855 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9cd184036e942449e5f5a3d806a1000 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:03.405499 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07084f618f754b739e18f98bf0a3b7b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.406740 9427 consensus_queue.cc:260] T 4a6846144c8c409cad340e99374a38c6 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.407194 9427 ts_tablet_manager.cc:1434] T 4a6846144c8c409cad340e99374a38c6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20251215 14:55:03.407444 8853 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 429c0b2d7cb2428c8de6b02acde36044 (table default.Table_20d2c5b358444df59324e21800508f8d [id=c421ca23de494f4ba674e4cc86bac3da]). Expected version 1 got 0
I20251215 14:55:03.408541 8852 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 813cfeea5399457e91623fb3abf9fd32
I20251215 14:55:03.409818 9149 tablet_service.cc:1552] Processing DeleteTablet for tablet 813cfeea5399457e91623fb3abf9fd32 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.408550 8858 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_2920b8dba9704f489af552aa0ce58b64"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.410580 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 813cfeea5399457e91623fb3abf9fd32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 813cfeea5399457e91623fb3abf9fd32 already in progress: creating tablet
W20251215 14:55:03.410626 8858 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2920b8dba9704f489af552aa0ce58b64 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.410681 9431 raft_consensus.cc:2243] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:03.411366 9292 tablet_service.cc:1552] Processing DeleteTablet for tablet 813cfeea5399457e91623fb3abf9fd32 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.411710 9427 tablet_bootstrap.cc:492] T c276eb6ad0414bb8ae5d553ae623edac P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:03.411782 8852 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 429c0b2d7cb2428c8de6b02acde36044 (table default.Table_20d2c5b358444df59324e21800508f8d [id=c421ca23de494f4ba674e4cc86bac3da]). Expected version 1 got 0
W20251215 14:55:03.412036 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 813cfeea5399457e91623fb3abf9fd32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 813cfeea5399457e91623fb3abf9fd32 already in progress: creating tablet
I20251215 14:55:03.413415 9427 tablet_bootstrap.cc:654] T c276eb6ad0414bb8ae5d553ae623edac P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.415395 9426 tablet_bootstrap.cc:492] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:03.415546 9426 ts_tablet_manager.cc:1403] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20251215 14:55:03.415908 8850 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 32432afc6e8d458bb7ed7abc42fb3dde
I20251215 14:55:03.416440 8850 catalog_manager.cc:6724] ReplaceTablet: tablet 32432afc6e8d458bb7ed7abc42fb3dde deleted and replaced by tablet f121a14828e6443695960c0e540ae573
I20251215 14:55:03.416373 9426 raft_consensus.cc:359] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.416548 9426 raft_consensus.cc:385] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.416622 9426 raft_consensus.cc:740] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.416705 9149 tablet_service.cc:1552] Processing DeleteTablet for tablet 32432afc6e8d458bb7ed7abc42fb3dde with delete_type TABLET_DATA_DELETED (replaced by tablet f121a14828e6443695960c0e540ae573) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.416843 9426 consensus_queue.cc:260] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:03.417404 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 32432afc6e8d458bb7ed7abc42fb3dde because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32432afc6e8d458bb7ed7abc42fb3dde already in progress: creating tablet
I20251215 14:55:03.418699 9021 tablet_service.cc:1552] Processing DeleteTablet for tablet 32432afc6e8d458bb7ed7abc42fb3dde with delete_type TABLET_DATA_DELETED (replaced by tablet f121a14828e6443695960c0e540ae573) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:03.419669 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet 4a6846144c8c409cad340e99374a38c6
I20251215 14:55:03.420837 9426 ts_tablet_manager.cc:1434] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
W20251215 14:55:03.421255 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet 11a5a6a0895c49648c910fa2ea3ca373
I20251215 14:55:03.422257 8859 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet a44e87a7bec24de2a9cb259b219f178c
I20251215 14:55:03.423341 9426 tablet_bootstrap.cc:492] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:03.423558 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet 4a6846144c8c409cad340e99374a38c6
W20251215 14:55:03.424341 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet 11a5a6a0895c49648c910fa2ea3ca373
I20251215 14:55:03.424310 9431 raft_consensus.cc:2272] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:03.424865 9431 ts_tablet_manager.cc:1916] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:03.425261 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_38b1c1a82dd441dfa8131162ac117124"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.425833 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_38b1c1a82dd441dfa8131162ac117124 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.425936 9426 tablet_bootstrap.cc:654] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.426693 9292 tablet_service.cc:1552] Processing DeleteTablet for tablet 32432afc6e8d458bb7ed7abc42fb3dde with delete_type TABLET_DATA_DELETED (replaced by tablet f121a14828e6443695960c0e540ae573) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:03.427450 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 32432afc6e8d458bb7ed7abc42fb3dde because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32432afc6e8d458bb7ed7abc42fb3dde already in progress: creating tablet
W20251215 14:55:03.430670 9560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 14:55:03.432286 9431 ts_tablet_manager.cc:1929] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:03.432493 9431 log.cc:1199] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/f233746b84a94c589eb96d6ef3a8281d
I20251215 14:55:03.432868 9431 ts_tablet_manager.cc:1950] T f233746b84a94c589eb96d6ef3a8281d P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:03.433844 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet f233746b84a94c589eb96d6ef3a8281d (table default.Table_f6179b6a903946ac9b6a982c9ff87304 [id=a3674eb3a67e4505a0db527d556d5e93]) successfully deleted
I20251215 14:55:03.434394 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet 813cfeea5399457e91623fb3abf9fd32 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:03.434624 9435 tablet_bootstrap.cc:492] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:03.434803 9435 ts_tablet_manager.cc:1403] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.062s user 0.000s sys 0.003s
W20251215 14:55:03.435259 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 26876cdffd7e4664bc8f7efb74885776 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 26876cdffd7e4664bc8f7efb74885776 already in progress: creating tablet
I20251215 14:55:03.435735 9435 raft_consensus.cc:359] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.435941 9435 raft_consensus.cc:385] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.436043 9435 raft_consensus.cc:740] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.436362 9435 consensus_queue.cc:260] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:03.437023 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 0db6246dee2643d98094408410618259 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0db6246dee2643d98094408410618259 already in progress: creating tablet
W20251215 14:55:03.437916 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet c276eb6ad0414bb8ae5d553ae623edac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c276eb6ad0414bb8ae5d553ae623edac already in progress: creating tablet
W20251215 14:55:03.438588 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet 80d4c9b533ac4facb4205aff84903134
W20251215 14:55:03.438920 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 9425749d471f4f95bbae030977e278e4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9425749d471f4f95bbae030977e278e4 already in progress: creating tablet
W20251215 14:55:03.439891 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 1141b9a4cf3e4aa78529bed7f0375ff8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1141b9a4cf3e4aa78529bed7f0375ff8 already in progress: creating tablet
I20251215 14:55:03.440855 8851 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 5c5e45c102ea4ff899fbc286f30700fc
I20251215 14:55:03.441258 9426 tablet_bootstrap.cc:492] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:03.441449 9426 ts_tablet_manager.cc:1403] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20251215 14:55:03.442057 9487 server_base.cc:1047] running on GCE node
W20251215 14:55:03.442714 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 37181f50142f4d8bb88713221a755d50 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 37181f50142f4d8bb88713221a755d50 already in progress: creating tablet
I20251215 14:55:03.442631 9426 raft_consensus.cc:359] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.442854 9426 raft_consensus.cc:385] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.442931 9426 raft_consensus.cc:740] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.443495 9487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
W20251215 14:55:03.445331 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 32432afc6e8d458bb7ed7abc42fb3dde because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 32432afc6e8d458bb7ed7abc42fb3dde already in progress: creating tablet
I20251215 14:55:03.445873 9435 ts_tablet_manager.cc:1434] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s
W20251215 14:55:03.446239 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 813cfeea5399457e91623fb3abf9fd32 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 813cfeea5399457e91623fb3abf9fd32 already in progress: creating tablet
I20251215 14:55:03.446652 9435 tablet_bootstrap.cc:492] T 9bd8d964650a49b08093608abf3e31fa P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:03.448050 8851 catalog_manager.cc:5487] Ignoring report from unknown tablet 80d4c9b533ac4facb4205aff84903134
I20251215 14:55:03.445948 9426 consensus_queue.cc:260] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.450183 9435 tablet_bootstrap.cc:654] T 9bd8d964650a49b08093608abf3e31fa P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.450454 9426 ts_tablet_manager.cc:1434] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
W20251215 14:55:03.452886 8851 catalog_manager.cc:5487] Ignoring report from unknown tablet cb2f4fc179744458bc7db2f6c7197ec5
I20251215 14:55:03.454440 9427 tablet_bootstrap.cc:492] T c276eb6ad0414bb8ae5d553ae623edac P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:03.450829 9426 tablet_bootstrap.cc:492] T 80d4c9b533ac4facb4205aff84903134 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:03.454595 9427 ts_tablet_manager.cc:1403] T c276eb6ad0414bb8ae5d553ae623edac P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.047s user 0.007s sys 0.000s
I20251215 14:55:03.455564 9427 raft_consensus.cc:359] T c276eb6ad0414bb8ae5d553ae623edac P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.455760 9427 raft_consensus.cc:385] T c276eb6ad0414bb8ae5d553ae623edac P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.455843 9427 raft_consensus.cc:740] T c276eb6ad0414bb8ae5d553ae623edac P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.456102 9427 consensus_queue.cc:260] T c276eb6ad0414bb8ae5d553ae623edac P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.456857 9426 tablet_bootstrap.cc:654] T 80d4c9b533ac4facb4205aff84903134 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:03.458683 8851 catalog_manager.cc:5487] Ignoring report from unknown tablet cb2f4fc179744458bc7db2f6c7197ec5
I20251215 14:55:03.459880 9427 ts_tablet_manager.cc:1434] T c276eb6ad0414bb8ae5d553ae623edac P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:03.460750 9507 raft_consensus.cc:493] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:03.460919 9507 raft_consensus.cc:515] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.461669 9507 leader_election.cc:290] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:03.462296 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "429c0b2d7cb2428c8de6b02acde36044" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:03.462442 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet c276eb6ad0414bb8ae5d553ae623edac with delete_type TABLET_DATA_DELETED (replaced by tablet bb3b95d32c7044bd8a4451381c19aeba) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:03.462528 9314 raft_consensus.cc:2468] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:03.462673 9431 tablet_replica.cc:333] T c276eb6ad0414bb8ae5d553ae623edac P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:03.462857 9431 raft_consensus.cc:2243] T c276eb6ad0414bb8ae5d553ae623edac P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:03.463037 9431 raft_consensus.cc:2272] T c276eb6ad0414bb8ae5d553ae623edac P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:03.463378 9427 tablet_bootstrap.cc:492] T 4816503e4fa1459dbb311997be85f64a P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:03.463510 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "429c0b2d7cb2428c8de6b02acde36044" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:03.464140 9115 leader_election.cc:304] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:03.464865 9431 ts_tablet_manager.cc:1916] T c276eb6ad0414bb8ae5d553ae623edac P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251215 14:55:03.465212 9112 leader_election.cc:343] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:03.465567 9507 raft_consensus.cc:2804] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:03.465687 9507 raft_consensus.cc:493] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:03.465791 9507 raft_consensus.cc:3060] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.467602 8855 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_5f2900bf03754d4dba690c3a15bcac61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.468261 8855 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f2900bf03754d4dba690c3a15bcac61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.468547 9507 raft_consensus.cc:515] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.469646 9487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251215 14:55:03.470062 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "429c0b2d7cb2428c8de6b02acde36044" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
W20251215 14:55:03.470819 9112 leader_election.cc:343] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:03.471792 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "429c0b2d7cb2428c8de6b02acde36044" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:03.472023 9314 raft_consensus.cc:3060] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.472028 9435 tablet_bootstrap.cc:492] T 9bd8d964650a49b08093608abf3e31fa P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:03.472296 9431 ts_tablet_manager.cc:1929] T c276eb6ad0414bb8ae5d553ae623edac P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:03.472422 9431 log.cc:1199] T c276eb6ad0414bb8ae5d553ae623edac P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/c276eb6ad0414bb8ae5d553ae623edac
I20251215 14:55:03.472456 9435 ts_tablet_manager.cc:1403] T 9bd8d964650a49b08093608abf3e31fa P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.004s
I20251215 14:55:03.472760 9431 ts_tablet_manager.cc:1950] T c276eb6ad0414bb8ae5d553ae623edac P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:03.473727 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet c276eb6ad0414bb8ae5d553ae623edac (table default.Table_d884e36a60cf4a109778a5bfa32afaa8 [id=7ec65d77d89d4e40a60b716f721e2940]) successfully deleted
I20251215 14:55:03.474916 9314 raft_consensus.cc:2468] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:03.475221 9435 raft_consensus.cc:359] T 9bd8d964650a49b08093608abf3e31fa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.475346 9427 tablet_bootstrap.cc:654] T 4816503e4fa1459dbb311997be85f64a P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.475432 9435 raft_consensus.cc:385] T 9bd8d964650a49b08093608abf3e31fa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.475510 9435 raft_consensus.cc:740] T 9bd8d964650a49b08093608abf3e31fa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.475678 9115 leader_election.cc:304] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:03.475775 9435 consensus_queue.cc:260] T 9bd8d964650a49b08093608abf3e31fa P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.476014 9440 raft_consensus.cc:2804] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:03.476184 9440 raft_consensus.cc:697] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:03.476455 9440 consensus_queue.cc:237] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.478456 9435 ts_tablet_manager.cc:1434] T 9bd8d964650a49b08093608abf3e31fa P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20251215 14:55:03.478796 9435 tablet_bootstrap.cc:492] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:03.479357 8851 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bd8d964650a49b08093608abf3e31fa
I20251215 14:55:03.480278 9507 leader_election.cc:290] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:03.482611 8851 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bd8d964650a49b08093608abf3e31fa
I20251215 14:55:03.483065 9435 tablet_bootstrap.cc:654] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.484238 9427 tablet_bootstrap.cc:492] T 4816503e4fa1459dbb311997be85f64a P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:03.484411 9427 ts_tablet_manager.cc:1403] T 4816503e4fa1459dbb311997be85f64a P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.002s
I20251215 14:55:03.485147 9427 raft_consensus.cc:359] T 4816503e4fa1459dbb311997be85f64a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.485484 9427 raft_consensus.cc:385] T 4816503e4fa1459dbb311997be85f64a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.485565 9427 raft_consensus.cc:740] T 4816503e4fa1459dbb311997be85f64a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.486243 9487 hybrid_clock.cc:648] HybridClock initialized: now 1765810503486103 us; error 113 us; skew 500 ppm
I20251215 14:55:03.486771 9487 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 14:55:03.486964 9427 consensus_queue.cc:260] T 4816503e4fa1459dbb311997be85f64a P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:03.489360 8851 catalog_manager.cc:5487] Ignoring report from unknown tablet 4816503e4fa1459dbb311997be85f64a
I20251215 14:55:03.491837 9427 ts_tablet_manager.cc:1434] T 4816503e4fa1459dbb311997be85f64a P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20251215 14:55:03.493310 9427 tablet_bootstrap.cc:492] T c0d0022e48f04b83ac1c998a83fe3f55 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:03.504945 9427 tablet_bootstrap.cc:654] T c0d0022e48f04b83ac1c998a83fe3f55 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.508332 8855 catalog_manager.cc:5654] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130). New cstate: current_term: 1 leader_uuid: "3ea5306c36594ef4a62211f2bd6669a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:03.508934 8855 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 429c0b2d7cb2428c8de6b02acde36044 (table default.Table_20d2c5b358444df59324e21800508f8d [id=c421ca23de494f4ba674e4cc86bac3da]). Expected version 1 got 0
W20251215 14:55:03.510509 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet 4816503e4fa1459dbb311997be85f64a
I20251215 14:55:03.511371 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_f4bcd659a798415291f5287986f48ed8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.512135 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4bcd659a798415291f5287986f48ed8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.513337 9427 tablet_bootstrap.cc:492] T c0d0022e48f04b83ac1c998a83fe3f55 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:03.513494 9427 ts_tablet_manager.cc:1403] T c0d0022e48f04b83ac1c998a83fe3f55 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.002s
I20251215 14:55:03.514326 9427 raft_consensus.cc:359] T c0d0022e48f04b83ac1c998a83fe3f55 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.514503 9427 raft_consensus.cc:385] T c0d0022e48f04b83ac1c998a83fe3f55 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.514580 9427 raft_consensus.cc:740] T c0d0022e48f04b83ac1c998a83fe3f55 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.514622 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_f1d62eb0033c45999a3caccdf7c64f34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:03.514900 9427 consensus_queue.cc:260] T c0d0022e48f04b83ac1c998a83fe3f55 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:03.515614 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1d62eb0033c45999a3caccdf7c64f34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:03.516968 8858 catalog_manager.cc:5487] Ignoring report from unknown tablet c0d0022e48f04b83ac1c998a83fe3f55
I20251215 14:55:03.519095 9427 ts_tablet_manager.cc:1434] T c0d0022e48f04b83ac1c998a83fe3f55 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
W20251215 14:55:03.523204 8858 catalog_manager.cc:5487] Ignoring report from unknown tablet c0d0022e48f04b83ac1c998a83fe3f55
I20251215 14:55:03.527266 9427 tablet_bootstrap.cc:492] T 018bd6ac8a534a6abc461b57b89b93eb P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:03.528891 9427 tablet_bootstrap.cc:654] T 018bd6ac8a534a6abc461b57b89b93eb P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.529872 9487 webserver.cc:492] Webserver started at http://127.8.121.190:40239/ using document root <none> and password file <none>
I20251215 14:55:03.531033 9487 fs_manager.cc:362] Metadata directory not provided
I20251215 14:55:03.531275 9487 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 14:55:03.534298 8857 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_e30dfd7361ed4e4981bc438c89e644c3" } modify_external_catalogs: true
I20251215 14:55:03.534634 9426 tablet_bootstrap.cc:492] T 80d4c9b533ac4facb4205aff84903134 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:03.534790 9426 ts_tablet_manager.cc:1403] T 80d4c9b533ac4facb4205aff84903134 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.084s user 0.011s sys 0.010s
I20251215 14:55:03.534651 8858 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_385109da45d14eacb743f9b6540d33c1" } new_table_name: "default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d" modify_external_catalogs: true
I20251215 14:55:03.535225 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_72f52de38f25438fbfe0a6a0f8bdc5f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:03.535630 9426 raft_consensus.cc:359] T 80d4c9b533ac4facb4205aff84903134 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:03.535722 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72f52de38f25438fbfe0a6a0f8bdc5f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.535804 9426 raft_consensus.cc:385] T 80d4c9b533ac4facb4205aff84903134 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.535877 9426 raft_consensus.cc:740] T 80d4c9b533ac4facb4205aff84903134 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.536115 9426 consensus_queue.cc:260] T 80d4c9b533ac4facb4205aff84903134 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.534757 8859 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_988b525ae25a4226b20a0caf2630d61f" } new_table_name: "default.Table_8fb8fb2dc67546129936776128fd0d0e" modify_external_catalogs: true
I20251215 14:55:03.534863 8851 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_cdef28a9eb234425846582441c49d740" } new_table_name: "default.Table_c61eb6855f1c4bc5b0149813fa98c2e9" modify_external_catalogs: true
I20251215 14:55:03.534965 8856 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_1bb39cbc0ffc44e0bb931ca61a9ae0f6" } new_table_name: "default.Table_badbeb9a71ed466fb0241e6fb1e8d118" modify_external_catalogs: true
I20251215 14:55:03.538508 8857 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_e30dfd7361ed4e4981bc438c89e644c3" } modify_external_catalogs: true
I20251215 14:55:03.540128 9426 ts_tablet_manager.cc:1434] T 80d4c9b533ac4facb4205aff84903134 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:03.535137 8855 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_8c028f23aaf4428fab6a375c292e49b3" } new_table_name: "default.Table_fea0083caa2641288057608f9681e3cf" modify_external_catalogs: true
W20251215 14:55:03.540400 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet 80d4c9b533ac4facb4205aff84903134
I20251215 14:55:03.540452 9426 tablet_bootstrap.cc:492] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:03.542613 9427 tablet_bootstrap.cc:492] T 018bd6ac8a534a6abc461b57b89b93eb P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:03.542778 9427 ts_tablet_manager.cc:1403] T 018bd6ac8a534a6abc461b57b89b93eb P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.001s
W20251215 14:55:03.543125 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet 80d4c9b533ac4facb4205aff84903134
I20251215 14:55:03.543586 9427 raft_consensus.cc:359] T 018bd6ac8a534a6abc461b57b89b93eb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.543778 9427 raft_consensus.cc:385] T 018bd6ac8a534a6abc461b57b89b93eb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.543848 9427 raft_consensus.cc:740] T 018bd6ac8a534a6abc461b57b89b93eb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.544060 9427 consensus_queue.cc:260] T 018bd6ac8a534a6abc461b57b89b93eb P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.544528 9427 ts_tablet_manager.cc:1434] T 018bd6ac8a534a6abc461b57b89b93eb P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:03.544839 9427 tablet_bootstrap.cc:492] T cb2f4fc179744458bc7db2f6c7197ec5 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:03.546424 9427 tablet_bootstrap.cc:654] T cb2f4fc179744458bc7db2f6c7197ec5 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:03.547421 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet 018bd6ac8a534a6abc461b57b89b93eb
I20251215 14:55:03.547458 9435 tablet_bootstrap.cc:492] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:03.547597 9435 ts_tablet_manager.cc:1403] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.006s
I20251215 14:55:03.547857 9426 tablet_bootstrap.cc:654] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.548374 9435 raft_consensus.cc:359] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.548552 9435 raft_consensus.cc:385] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.548640 9435 raft_consensus.cc:740] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.548887 9435 consensus_queue.cc:260] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:03.550559 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet 018bd6ac8a534a6abc461b57b89b93eb
I20251215 14:55:03.552865 9435 ts_tablet_manager.cc:1434] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:03.554847 9427 tablet_bootstrap.cc:492] T cb2f4fc179744458bc7db2f6c7197ec5 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:03.555030 9427 ts_tablet_manager.cc:1403] T cb2f4fc179744458bc7db2f6c7197ec5 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.005s
I20251215 14:55:03.555245 9440 raft_consensus.cc:493] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:03.555408 9440 raft_consensus.cc:515] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.555711 9435 tablet_bootstrap.cc:492] T 44bd51f9bf77492b8890fc7c8411c887 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:03.556027 9440 leader_election.cc:290] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
W20251215 14:55:03.556699 8858 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bafc5063058a469bb9c9b3e5345eb1be has no consensus state
I20251215 14:55:03.556639 9427 raft_consensus.cc:359] T cb2f4fc179744458bc7db2f6c7197ec5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.556835 9427 raft_consensus.cc:385] T cb2f4fc179744458bc7db2f6c7197ec5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.556803 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4816503e4fa1459dbb311997be85f64a" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:03.556950 9427 raft_consensus.cc:740] T cb2f4fc179744458bc7db2f6c7197ec5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.557040 9042 raft_consensus.cc:2468] T 4816503e4fa1459dbb311997be85f64a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:03.557179 9427 consensus_queue.cc:260] T cb2f4fc179744458bc7db2f6c7197ec5 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.557657 9112 leader_election.cc:304] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:03.557760 9435 tablet_bootstrap.cc:654] T 44bd51f9bf77492b8890fc7c8411c887 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.557775 9427 ts_tablet_manager.cc:1434] T cb2f4fc179744458bc7db2f6c7197ec5 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20251215 14:55:03.558409 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4816503e4fa1459dbb311997be85f64a" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:03.558583 9314 raft_consensus.cc:2468] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:03.561050 9440 raft_consensus.cc:2804] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:03.561162 9440 raft_consensus.cc:493] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:03.561250 9440 raft_consensus.cc:3060] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:03.561714 8859 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4e5a0419b6b48f0a3038e0fb77bcfe4 has no consensus state
W20251215 14:55:03.562914 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet f9695d47e35448fdad95ff3f24bafd03
W20251215 14:55:03.562951 8856 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f32a6e8df31d482fa9b9686e002d81ff consensus state has no leader
W20251215 14:55:03.563375 8855 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3cdfcddd91fe47de8fd14dc718f421a6 consensus state has no leader
I20251215 14:55:03.563426 8857 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet fc9bda52c73e4aa6b7e2eb008c63391b
I20251215 14:55:03.563838 9440 raft_consensus.cc:515] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.564317 9149 tablet_service.cc:1552] Processing DeleteTablet for tablet fc9bda52c73e4aa6b7e2eb008c63391b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:54874
W20251215 14:55:03.564911 8851 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f080b56cff244a46bfb73d05d3127f31 consensus state has no leader
I20251215 14:55:03.564842 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4816503e4fa1459dbb311997be85f64a" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:03.565042 9314 raft_consensus.cc:3060] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.565089 9292 tablet_service.cc:1552] Processing DeleteTablet for tablet fc9bda52c73e4aa6b7e2eb008c63391b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:03.565367 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet fc9bda52c73e4aa6b7e2eb008c63391b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc9bda52c73e4aa6b7e2eb008c63391b already in progress: creating tablet
W20251215 14:55:03.566978 8851 catalog_manager.cc:5487] Ignoring report from unknown tablet f9695d47e35448fdad95ff3f24bafd03
I20251215 14:55:03.567142 9427 tablet_bootstrap.cc:492] T 4f1f902cbcb643b9b98fa3d72babba79 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:03.568506 8851 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_ba58101b52714972a7867936bda32bf3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:03.568951 9427 tablet_bootstrap.cc:654] T 4f1f902cbcb643b9b98fa3d72babba79 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:03.569025 8851 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba58101b52714972a7867936bda32bf3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.571456 8857 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_d36b592f1eda4d99b3112955a84c390e" } modify_external_catalogs: true
I20251215 14:55:03.571640 8857 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_d36b592f1eda4d99b3112955a84c390e" } modify_external_catalogs: true
W20251215 14:55:03.573813 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet cb2f4fc179744458bc7db2f6c7197ec5
I20251215 14:55:03.578965 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet fc9bda52c73e4aa6b7e2eb008c63391b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:03.579131 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet fc9bda52c73e4aa6b7e2eb008c63391b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc9bda52c73e4aa6b7e2eb008c63391b already in progress: creating tablet
I20251215 14:55:03.579825 8855 master_service.cc:954] ReplaceTablet: received request to replace tablet 37181f50142f4d8bb88713221a755d50 from {username='slave'} at 127.0.0.1:34038
W20251215 14:55:03.581653 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet fc9bda52c73e4aa6b7e2eb008c63391b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc9bda52c73e4aa6b7e2eb008c63391b already in progress: creating tablet
I20251215 14:55:03.585525 9314 raft_consensus.cc:2468] T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:03.585999 9115 leader_election.cc:304] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:03.586318 9507 raft_consensus.cc:2804] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:03.586465 9507 raft_consensus.cc:697] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:03.586500 8855 master_service.cc:954] ReplaceTablet: received request to replace tablet bdfc164128a6413a83d83d05b69fb74a from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:03.586730 9507 consensus_queue.cc:237] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.587742 8857 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet df70bebdc8ad4f8186ba427e840799cf
I20251215 14:55:03.588725 9149 tablet_service.cc:1552] Processing DeleteTablet for tablet df70bebdc8ad4f8186ba427e840799cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:54874
W20251215 14:55:03.589346 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet df70bebdc8ad4f8186ba427e840799cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df70bebdc8ad4f8186ba427e840799cf already in progress: creating tablet
I20251215 14:55:03.590703 9292 tablet_service.cc:1552] Processing DeleteTablet for tablet df70bebdc8ad4f8186ba427e840799cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:03.591971 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet df70bebdc8ad4f8186ba427e840799cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df70bebdc8ad4f8186ba427e840799cf already in progress: creating tablet
I20251215 14:55:03.593890 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet df70bebdc8ad4f8186ba427e840799cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:03.594586 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet df70bebdc8ad4f8186ba427e840799cf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df70bebdc8ad4f8186ba427e840799cf already in progress: creating tablet
I20251215 14:55:03.595470 9440 leader_election.cc:290] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:03.599614 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4816503e4fa1459dbb311997be85f64a" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:03.599851 9042 raft_consensus.cc:3060] T 4816503e4fa1459dbb311997be85f64a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.601758 9426 tablet_bootstrap.cc:492] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:03.601919 9426 ts_tablet_manager.cc:1403] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.005s
I20251215 14:55:03.602695 9042 raft_consensus.cc:2468] T 4816503e4fa1459dbb311997be85f64a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:03.602713 9426 raft_consensus.cc:359] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.602896 9426 raft_consensus.cc:385] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.602957 9426 raft_consensus.cc:740] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.605213 9426 consensus_queue.cc:260] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.607458 9426 ts_tablet_manager.cc:1434] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20251215 14:55:03.607796 9426 tablet_bootstrap.cc:492] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:03.609918 9426 tablet_bootstrap.cc:654] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.611182 8857 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_8a5fba89ed254208aebb339a847af804" } modify_external_catalogs: true
I20251215 14:55:03.611389 8857 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_8a5fba89ed254208aebb339a847af804" } modify_external_catalogs: true
W20251215 14:55:03.611465 8851 catalog_manager.cc:5487] Ignoring report from unknown tablet 4816503e4fa1459dbb311997be85f64a
I20251215 14:55:03.614463 9427 tablet_bootstrap.cc:492] T 4f1f902cbcb643b9b98fa3d72babba79 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:03.614632 9427 ts_tablet_manager.cc:1403] T 4f1f902cbcb643b9b98fa3d72babba79 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.048s user 0.005s sys 0.011s
I20251215 14:55:03.615480 9427 raft_consensus.cc:359] T 4f1f902cbcb643b9b98fa3d72babba79 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.615680 9427 raft_consensus.cc:385] T 4f1f902cbcb643b9b98fa3d72babba79 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.615749 9435 tablet_bootstrap.cc:492] T 44bd51f9bf77492b8890fc7c8411c887 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:03.615747 9427 raft_consensus.cc:740] T 4f1f902cbcb643b9b98fa3d72babba79 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.615897 9435 ts_tablet_manager.cc:1403] T 44bd51f9bf77492b8890fc7c8411c887 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.014s
I20251215 14:55:03.615979 9427 consensus_queue.cc:260] T 4f1f902cbcb643b9b98fa3d72babba79 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.618994 9427 ts_tablet_manager.cc:1434] T 4f1f902cbcb643b9b98fa3d72babba79 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:03.619374 9427 tablet_bootstrap.cc:492] T 11a5a6a0895c49648c910fa2ea3ca373 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:03.620072 8851 catalog_manager.cc:5487] Ignoring report from unknown tablet 4f1f902cbcb643b9b98fa3d72babba79
W20251215 14:55:03.622148 8851 catalog_manager.cc:5487] Ignoring report from unknown tablet 2df2138e41844e9f897e57264b62cc9d
I20251215 14:55:03.622952 9427 tablet_bootstrap.cc:654] T 11a5a6a0895c49648c910fa2ea3ca373 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:03.622967 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet 4f1f902cbcb643b9b98fa3d72babba79
I20251215 14:55:03.624248 8855 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_badbeb9a71ed466fb0241e6fb1e8d118" } modify_external_catalogs: true
I20251215 14:55:03.624450 8855 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_badbeb9a71ed466fb0241e6fb1e8d118" } modify_external_catalogs: true
I20251215 14:55:03.628113 8857 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 8612ebb3fc3c4554be4b881a60ad6fd4
I20251215 14:55:03.628561 9487 fs_manager.cc:714] Time spent opening directory manager: real 0.093s user 0.016s sys 0.003s
I20251215 14:55:03.629871 9292 tablet_service.cc:1552] Processing DeleteTablet for tablet 8612ebb3fc3c4554be4b881a60ad6fd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.630276 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet 8612ebb3fc3c4554be4b881a60ad6fd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:03.630620 9431 tablet_replica.cc:333] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:03.630829 9431 raft_consensus.cc:2243] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:03.631048 9432 tablet_replica.cc:333] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:03.631093 9431 raft_consensus.cc:2272] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:03.631300 9432 raft_consensus.cc:2243] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:03.631727 9432 raft_consensus.cc:2272] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:03.632304 9435 raft_consensus.cc:359] T 44bd51f9bf77492b8890fc7c8411c887 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.632503 9435 raft_consensus.cc:385] T 44bd51f9bf77492b8890fc7c8411c887 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.632566 9435 raft_consensus.cc:740] T 44bd51f9bf77492b8890fc7c8411c887 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.633859 9435 consensus_queue.cc:260] T 44bd51f9bf77492b8890fc7c8411c887 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.635495 9431 ts_tablet_manager.cc:1916] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:03.636502 9435 ts_tablet_manager.cc:1434] T 44bd51f9bf77492b8890fc7c8411c887 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20251215 14:55:03.636839 9435 tablet_bootstrap.cc:492] T 2df2138e41844e9f897e57264b62cc9d P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:03.637917 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet 44bd51f9bf77492b8890fc7c8411c887
I20251215 14:55:03.638751 9435 tablet_bootstrap.cc:654] T 2df2138e41844e9f897e57264b62cc9d P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.641243 9432 ts_tablet_manager.cc:1916] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:03.643484 8851 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_f1ad091bc41747ffba1fca75bcf619b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.644096 8851 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1ad091bc41747ffba1fca75bcf619b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.645105 9431 ts_tablet_manager.cc:1929] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:03.645855 9431 log.cc:1199] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/8612ebb3fc3c4554be4b881a60ad6fd4
I20251215 14:55:03.646303 9431 ts_tablet_manager.cc:1950] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:03.647473 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 8612ebb3fc3c4554be4b881a60ad6fd4 (table default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6]) successfully deleted
I20251215 14:55:03.647996 8855 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet f32a6e8df31d482fa9b9686e002d81ff
I20251215 14:55:03.648479 9427 tablet_bootstrap.cc:492] T 11a5a6a0895c49648c910fa2ea3ca373 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:03.648532 9149 tablet_service.cc:1552] Processing DeleteTablet for tablet 8612ebb3fc3c4554be4b881a60ad6fd4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.648622 9427 ts_tablet_manager.cc:1403] T 11a5a6a0895c49648c910fa2ea3ca373 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.000s
I20251215 14:55:03.649080 9149 tablet_service.cc:1552] Processing DeleteTablet for tablet f32a6e8df31d482fa9b9686e002d81ff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.649420 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet f32a6e8df31d482fa9b9686e002d81ff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:03.649421 9427 raft_consensus.cc:359] T 11a5a6a0895c49648c910fa2ea3ca373 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.649681 9427 raft_consensus.cc:385] T 11a5a6a0895c49648c910fa2ea3ca373 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.649766 9427 raft_consensus.cc:740] T 11a5a6a0895c49648c910fa2ea3ca373 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.649973 9427 consensus_queue.cc:260] T 11a5a6a0895c49648c910fa2ea3ca373 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.650467 9427 ts_tablet_manager.cc:1434] T 11a5a6a0895c49648c910fa2ea3ca373 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:03.650755 9427 tablet_bootstrap.cc:492] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:03.652853 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet f32a6e8df31d482fa9b9686e002d81ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f32a6e8df31d482fa9b9686e002d81ff already in progress: creating tablet
W20251215 14:55:03.653707 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet 11a5a6a0895c49648c910fa2ea3ca373
I20251215 14:55:03.654245 9427 tablet_bootstrap.cc:654] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.655145 9586 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 14:55:03.655403 8857 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_2e94c716d0fd4f4688b6bcbe468f8c5a" } modify_external_catalogs: true
I20251215 14:55:03.655606 8857 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_2e94c716d0fd4f4688b6bcbe468f8c5a" } modify_external_catalogs: true
I20251215 14:55:03.657323 9487 fs_manager.cc:730] Time spent opening block manager: real 0.027s user 0.006s sys 0.001s
W20251215 14:55:03.657580 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet 44bd51f9bf77492b8890fc7c8411c887
I20251215 14:55:03.660347 9292 tablet_service.cc:1552] Processing DeleteTablet for tablet f32a6e8df31d482fa9b9686e002d81ff with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.661034 8855 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_cd8c7355c25f412eb97abafa172e6f6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.661576 8855 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd8c7355c25f412eb97abafa172e6f6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.657536 9487 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data,/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
uuid: "cad1fca07ac7419cb608c21541f672f3"
format_stamp: "Formatted at 2025-12-15 14:54:58 on dist-test-slave-z089"
I20251215 14:55:03.663790 9487 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 14:55:03.664973 9432 ts_tablet_manager.cc:1929] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:03.665145 9432 log.cc:1199] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/8612ebb3fc3c4554be4b881a60ad6fd4
I20251215 14:55:03.665871 9432 ts_tablet_manager.cc:1950] T 8612ebb3fc3c4554be4b881a60ad6fd4 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:03.667028 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 8612ebb3fc3c4554be4b881a60ad6fd4 (table default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6]) successfully deleted
I20251215 14:55:03.670171 9430 tablet_replica.cc:333] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:03.670423 9430 raft_consensus.cc:2243] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:03.670722 9430 raft_consensus.cc:2272] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:03.672235 9435 tablet_bootstrap.cc:492] T 2df2138e41844e9f897e57264b62cc9d P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:03.672386 9435 ts_tablet_manager.cc:1403] T 2df2138e41844e9f897e57264b62cc9d P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.004s
I20251215 14:55:03.672952 9427 tablet_bootstrap.cc:492] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:03.673177 9427 ts_tablet_manager.cc:1403] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.003s
I20251215 14:55:03.673465 9435 raft_consensus.cc:359] T 2df2138e41844e9f897e57264b62cc9d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.673627 9435 raft_consensus.cc:385] T 2df2138e41844e9f897e57264b62cc9d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.673705 9435 raft_consensus.cc:740] T 2df2138e41844e9f897e57264b62cc9d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.673934 9435 consensus_queue.cc:260] T 2df2138e41844e9f897e57264b62cc9d P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.674850 9427 raft_consensus.cc:359] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.675086 9427 raft_consensus.cc:385] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.675242 9427 raft_consensus.cc:740] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.675565 9427 consensus_queue.cc:260] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.676339 9435 ts_tablet_manager.cc:1434] T 2df2138e41844e9f897e57264b62cc9d P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20251215 14:55:03.676631 9435 tablet_bootstrap.cc:492] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:03.677801 9427 ts_tablet_manager.cc:1434] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:03.678162 9427 tablet_bootstrap.cc:492] T 80d4c9b533ac4facb4205aff84903134 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:03.678620 9435 tablet_bootstrap.cc:654] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:03.679193 8851 catalog_manager.cc:5487] Ignoring report from unknown tablet 2df2138e41844e9f897e57264b62cc9d
I20251215 14:55:03.679553 8852 master_service.cc:954] ReplaceTablet: received request to replace tablet 8612ebb3fc3c4554be4b881a60ad6fd4 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:03.680560 9427 tablet_bootstrap.cc:654] T 80d4c9b533ac4facb4205aff84903134 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.680557 8856 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 429c0b2d7cb2428c8de6b02acde36044 (table default.Table_20d2c5b358444df59324e21800508f8d [id=c421ca23de494f4ba674e4cc86bac3da]). Expected version 1 got 0
I20251215 14:55:03.682992 9489 consensus_queue.cc:1048] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:03.686230 8857 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet f9411030d08d40aabbdee6670ba95821
I20251215 14:55:03.686378 9430 ts_tablet_manager.cc:1916] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:03.687812 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet f9411030d08d40aabbdee6670ba95821 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:03.688158 8856 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 429c0b2d7cb2428c8de6b02acde36044 (table default.Table_20d2c5b358444df59324e21800508f8d [id=c421ca23de494f4ba674e4cc86bac3da]). Expected version 1 got 0
W20251215 14:55:03.688606 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet f9411030d08d40aabbdee6670ba95821 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9411030d08d40aabbdee6670ba95821 already in progress: creating tablet
I20251215 14:55:03.689931 9292 tablet_service.cc:1552] Processing DeleteTablet for tablet f9411030d08d40aabbdee6670ba95821 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:03.691525 8856 catalog_manager.cc:5487] Ignoring report from unknown tablet 2df2138e41844e9f897e57264b62cc9d
I20251215 14:55:03.691996 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_c042437915b141518837aa551d8500d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:03.692700 9435 tablet_bootstrap.cc:492] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:03.692871 9435 ts_tablet_manager.cc:1403] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.003s
W20251215 14:55:03.693518 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c042437915b141518837aa551d8500d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.693634 9435 raft_consensus.cc:359] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.694142 9435 raft_consensus.cc:385] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.694229 9435 raft_consensus.cc:740] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.694471 9435 consensus_queue.cc:260] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.695070 9157 tablet_service.cc:1552] Processing DeleteTablet for tablet f9411030d08d40aabbdee6670ba95821 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.696521 9435 ts_tablet_manager.cc:1434] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:03.696823 9435 tablet_bootstrap.cc:492] T c4f47c22111c427a8ab9c4ae1e105375 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:03.698484 9427 tablet_bootstrap.cc:492] T 80d4c9b533ac4facb4205aff84903134 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:03.698995 8852 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_7fbfc1dd536247d4b9f3472efe93ca60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.699579 8852 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fbfc1dd536247d4b9f3472efe93ca60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.699911 9440 raft_consensus.cc:493] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:03.700078 9440 raft_consensus.cc:515] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.701181 8855 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_cd7ad6b69a804b79b66fe88feb54d697"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:03.701399 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a6846144c8c409cad340e99374a38c6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:03.701640 9314 raft_consensus.cc:2468] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:03.702452 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a6846144c8c409cad340e99374a38c6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:03.702685 9041 raft_consensus.cc:2468] T 4a6846144c8c409cad340e99374a38c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:03.703037 9435 tablet_bootstrap.cc:654] T c4f47c22111c427a8ab9c4ae1e105375 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:03.703038 8855 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd7ad6b69a804b79b66fe88feb54d697 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.703510 9440 leader_election.cc:290] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:03.703655 9427 ts_tablet_manager.cc:1403] T 80d4c9b533ac4facb4205aff84903134 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.002s
I20251215 14:55:03.704303 8851 master_service.cc:954] ReplaceTablet: received request to replace tablet 95583eee8a5041b1ade97e8f8f0db271 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:03.704419 9427 raft_consensus.cc:359] T 80d4c9b533ac4facb4205aff84903134 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.704578 9427 raft_consensus.cc:385] T 80d4c9b533ac4facb4205aff84903134 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251215 14:55:03.704578 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:03.704655 9427 raft_consensus.cc:740] T 80d4c9b533ac4facb4205aff84903134 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.705814 9115 leader_election.cc:304] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:03.706434 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
I20251215 14:55:03.706630 9440 raft_consensus.cc:2804] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:03.706790 9440 raft_consensus.cc:493] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:03.706748 9427 consensus_queue.cc:260] T 80d4c9b533ac4facb4205aff84903134 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.706893 9440 raft_consensus.cc:3060] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.707338 9427 ts_tablet_manager.cc:1434] T 80d4c9b533ac4facb4205aff84903134 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:03.708474 9427 tablet_bootstrap.cc:492] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:03.710040 9440 raft_consensus.cc:515] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.711331 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a6846144c8c409cad340e99374a38c6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:03.711575 9314 raft_consensus.cc:3060] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.712886 9440 leader_election.cc:290] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:03.713368 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a6846144c8c409cad340e99374a38c6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:03.713572 9042 raft_consensus.cc:3060] T 4a6846144c8c409cad340e99374a38c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.713992 9314 raft_consensus.cc:2468] T 4a6846144c8c409cad340e99374a38c6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
W20251215 14:55:03.714265 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet 80d4c9b533ac4facb4205aff84903134
I20251215 14:55:03.715128 9435 tablet_bootstrap.cc:492] T c4f47c22111c427a8ab9c4ae1e105375 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:03.715294 9435 ts_tablet_manager.cc:1403] T c4f47c22111c427a8ab9c4ae1e105375 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.001s
I20251215 14:55:03.716128 9435 raft_consensus.cc:359] T c4f47c22111c427a8ab9c4ae1e105375 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.716192 9042 raft_consensus.cc:2468] T 4a6846144c8c409cad340e99374a38c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:03.716288 9435 raft_consensus.cc:385] T c4f47c22111c427a8ab9c4ae1e105375 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.716367 9435 raft_consensus.cc:740] T c4f47c22111c427a8ab9c4ae1e105375 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.716632 9435 consensus_queue.cc:260] T c4f47c22111c427a8ab9c4ae1e105375 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.717711 9427 tablet_bootstrap.cc:654] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.720359 9435 ts_tablet_manager.cc:1434] T c4f47c22111c427a8ab9c4ae1e105375 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:03.721412 9435 tablet_bootstrap.cc:492] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:03.722654 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet 924c9dd0cd9d40189bfe1457040f3d37
I20251215 14:55:03.723707 8856 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_9ae28ea04dcf4d038b4467a5f0788a69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.724491 8856 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ae28ea04dcf4d038b4467a5f0788a69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.714465 9115 leader_election.cc:304] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:03.727051 9440 raft_consensus.cc:2804] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:03.727293 9440 raft_consensus.cc:697] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:03.727728 9427 tablet_bootstrap.cc:492] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:03.727627 9440 consensus_queue.cc:237] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.727897 9427 ts_tablet_manager.cc:1403] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.003s
I20251215 14:55:03.728742 9427 raft_consensus.cc:359] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.728945 9427 raft_consensus.cc:385] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.729025 9427 raft_consensus.cc:740] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.731247 9427 consensus_queue.cc:260] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.733580 8858 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_862e5241fcc042d8bf376e55c3c86fa0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.734129 8858 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_862e5241fcc042d8bf376e55c3c86fa0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.736014 9433 raft_consensus.cc:493] T 4f1f902cbcb643b9b98fa3d72babba79 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:03.736183 9433 raft_consensus.cc:515] T 4f1f902cbcb643b9b98fa3d72babba79 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.736795 9433 leader_election.cc:290] T 4f1f902cbcb643b9b98fa3d72babba79 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:03.737347 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1f902cbcb643b9b98fa3d72babba79" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:03.737452 9427 ts_tablet_manager.cc:1434] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.009s user 0.002s sys 0.001s
I20251215 14:55:03.737802 9427 tablet_bootstrap.cc:492] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:03.738873 9435 tablet_bootstrap.cc:654] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.739022 9430 ts_tablet_manager.cc:1929] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:03.739208 9430 log.cc:1199] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/8612ebb3fc3c4554be4b881a60ad6fd4
I20251215 14:55:03.740495 9427 tablet_bootstrap.cc:654] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.740640 9426 tablet_bootstrap.cc:492] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:03.740809 9426 ts_tablet_manager.cc:1403] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.133s user 0.017s sys 0.025s
I20251215 14:55:03.741681 9426 raft_consensus.cc:359] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.741886 9426 raft_consensus.cc:385] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.741984 9426 raft_consensus.cc:740] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.742228 9426 consensus_queue.cc:260] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.744962 8853 master_service.cc:954] ReplaceTablet: received request to replace tablet 11a5a6a0895c49648c910fa2ea3ca373 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:03.746392 9426 ts_tablet_manager.cc:1434] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
W20251215 14:55:03.748196 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet 4a6846144c8c409cad340e99374a38c6
I20251215 14:55:03.748848 9507 consensus_queue.cc:1048] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:03.750139 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bd8d964650a49b08093608abf3e31fa
W20251215 14:55:03.751756 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet 44bd51f9bf77492b8890fc7c8411c887
I20251215 14:55:03.753351 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_83de3588e27e48f2a722e2104b267467"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:03.753775 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f1f902cbcb643b9b98fa3d72babba79" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:03.754032 9314 raft_consensus.cc:2393] T 4f1f902cbcb643b9b98fa3d72babba79 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
W20251215 14:55:03.754253 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83de3588e27e48f2a722e2104b267467 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.754520 8978 leader_election.cc:304] T 4f1f902cbcb643b9b98fa3d72babba79 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:03.754990 9433 raft_consensus.cc:3060] T 4f1f902cbcb643b9b98fa3d72babba79 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.756456 9426 tablet_bootstrap.cc:492] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:03.757737 9433 raft_consensus.cc:2749] T 4f1f902cbcb643b9b98fa3d72babba79 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:03.759641 8854 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_1ea29a2534e24318a5604a9a1c93fbe0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.760702 8854 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ea29a2534e24318a5604a9a1c93fbe0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.761999 9292 tablet_service.cc:1552] Processing DeleteTablet for tablet c4f47c22111c427a8ab9c4ae1e105375 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:03.764501 8853 catalog_manager.cc:5487] Ignoring report from unknown tablet 26648bf286c94b2495e565969f945858
W20251215 14:55:03.764606 8853 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bd8d964650a49b08093608abf3e31fa
I20251215 14:55:03.765933 8857 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_fea0083caa2641288057608f9681e3cf" } new_table_name: "default.Table_3a992edcd1f14784877bb2cface4de61" modify_external_catalogs: true
I20251215 14:55:03.766284 9435 tablet_bootstrap.cc:492] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:03.766467 9435 ts_tablet_manager.cc:1403] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.000s
I20251215 14:55:03.767355 9435 raft_consensus.cc:359] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.767552 9435 raft_consensus.cc:385] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.767630 9435 raft_consensus.cc:740] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.767886 9435 consensus_queue.cc:260] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.768734 8852 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_a53d9a69b3164c078e1fb963af1bd2a6" } new_table_name: "default.Table_ad8e8a5df4ec4b53a051977d42d10a17" modify_external_catalogs: true
I20251215 14:55:03.768908 8855 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_ae55a511c46246048211ece920992e00" } new_table_name: "default.Table_42e5c1011ba64c0b9602eed064c8ecbd" modify_external_catalogs: true
I20251215 14:55:03.770038 9430 ts_tablet_manager.cc:1950] T 8612ebb3fc3c4554be4b881a60ad6fd4 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:03.770443 8850 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_8fb8fb2dc67546129936776128fd0d0e" } modify_external_catalogs: true
I20251215 14:55:03.770625 8850 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_8fb8fb2dc67546129936776128fd0d0e" } modify_external_catalogs: true
I20251215 14:55:03.772807 8853 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_5f2900bf03754d4dba690c3a15bcac61" } new_table_name: "default.Table_3c445d0ed5f446aebb1ccb87ceac7222" modify_external_catalogs: true
I20251215 14:55:03.774019 8851 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 95583eee8a5041b1ade97e8f8f0db271
I20251215 14:55:03.774489 8851 catalog_manager.cc:6724] ReplaceTablet: tablet 95583eee8a5041b1ade97e8f8f0db271 deleted and replaced by tablet 6ae72a1ded6e4faba1ad309d9a0e4a95
I20251215 14:55:03.774814 9426 tablet_bootstrap.cc:654] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.775292 9292 tablet_service.cc:1552] Processing DeleteTablet for tablet 95583eee8a5041b1ade97e8f8f0db271 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ae72a1ded6e4faba1ad309d9a0e4a95) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.776082 9489 raft_consensus.cc:493] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:03.776163 9157 tablet_service.cc:1552] Processing DeleteTablet for tablet 95583eee8a5041b1ade97e8f8f0db271 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ae72a1ded6e4faba1ad309d9a0e4a95) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.776221 9489 raft_consensus.cc:515] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.776322 8851 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_f4bcd659a798415291f5287986f48ed8" } new_table_name: "default.Table_6bd7eee6a17d43f4baf1db824203acab" modify_external_catalogs: true
I20251215 14:55:03.776867 9489 leader_election.cc:290] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:03.777009 9432 tablet_replica.cc:333] T c4f47c22111c427a8ab9c4ae1e105375 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:03.777170 9432 raft_consensus.cc:2243] T c4f47c22111c427a8ab9c4ae1e105375 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:03.777371 9432 raft_consensus.cc:2272] T c4f47c22111c427a8ab9c4ae1e105375 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
W20251215 14:55:03.777403 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet f32a6e8df31d482fa9b9686e002d81ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f32a6e8df31d482fa9b9686e002d81ff already in progress: creating tablet
W20251215 14:55:03.777675 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet f9411030d08d40aabbdee6670ba95821 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9411030d08d40aabbdee6670ba95821 already in progress: creating tablet
I20251215 14:55:03.778100 9432 ts_tablet_manager.cc:1916] T c4f47c22111c427a8ab9c4ae1e105375 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:03.778244 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "924c9dd0cd9d40189bfe1457040f3d37" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:03.779072 9249 leader_election.cc:343] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:03.779548 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 8612ebb3fc3c4554be4b881a60ad6fd4 (table default.Table_8a5fba89ed254208aebb339a847af804 [id=654a552b658648808b442355e8e960e6]) successfully deleted
I20251215 14:55:03.779973 9435 ts_tablet_manager.cc:1434] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
W20251215 14:55:03.781478 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet f32a6e8df31d482fa9b9686e002d81ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f32a6e8df31d482fa9b9686e002d81ff already in progress: creating tablet
W20251215 14:55:03.782117 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet f9411030d08d40aabbdee6670ba95821 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9411030d08d40aabbdee6670ba95821 already in progress: creating tablet
I20251215 14:55:03.782367 9435 tablet_bootstrap.cc:492] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:03.782729 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 95583eee8a5041b1ade97e8f8f0db271 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95583eee8a5041b1ade97e8f8f0db271 already in progress: creating tablet
W20251215 14:55:03.784904 8858 catalog_manager.cc:5487] Ignoring report from unknown tablet bdfc164128a6413a83d83d05b69fb74a
W20251215 14:55:03.788321 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet bdfc164128a6413a83d83d05b69fb74a
I20251215 14:55:03.786005 9435 tablet_bootstrap.cc:654] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:03.791934 8852 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9bf4a899338f4bcfac099b5099a22f05 has no consensus state
I20251215 14:55:03.793325 9540 consensus_queue.cc:1048] T 26648bf286c94b2495e565969f945858 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:03.794934 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "924c9dd0cd9d40189bfe1457040f3d37" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:03.795727 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet 95583eee8a5041b1ade97e8f8f0db271 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ae72a1ded6e4faba1ad309d9a0e4a95) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:03.796384 9248 leader_election.cc:343] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:03.796522 9248 leader_election.cc:304] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
W20251215 14:55:03.796535 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 95583eee8a5041b1ade97e8f8f0db271 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95583eee8a5041b1ade97e8f8f0db271 already in progress: creating tablet
I20251215 14:55:03.796923 9489 raft_consensus.cc:2749] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:03.797032 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet 26648bf286c94b2495e565969f945858
I20251215 14:55:03.797360 8859 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_a56faaf463d84718bfd9c88b0825220c" } modify_external_catalogs: true
I20251215 14:55:03.797539 8859 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_a56faaf463d84718bfd9c88b0825220c" } modify_external_catalogs: true
I20251215 14:55:03.798146 9315 raft_consensus.cc:1275] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Refusing update from remote peer 3ea5306c36594ef4a62211f2bd6669a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 14:55:03.798061 8856 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_9fff09bdf4114198810006599bcf1f3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.798602 8856 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9fff09bdf4114198810006599bcf1f3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:03.800987 8852 master_service.cc:954] ReplaceTablet: received request to replace tablet b329b0abcad742ff94c1a62a72d1b673 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:03.803659 9540 consensus_queue.cc:1048] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:03.808348 9435 tablet_bootstrap.cc:492] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:03.808502 9435 ts_tablet_manager.cc:1403] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.003s
I20251215 14:55:03.809293 9435 raft_consensus.cc:359] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.809474 9435 raft_consensus.cc:385] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.809552 9435 raft_consensus.cc:740] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.810333 8852 master_service.cc:954] ReplaceTablet: received request to replace tablet 88c8499633f4417e9f6d2d6372f157c4 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:03.810750 9489 raft_consensus.cc:493] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:03.810889 9489 raft_consensus.cc:515] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.811880 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0d0022e48f04b83ac1c998a83fe3f55" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:03.812075 9178 raft_consensus.cc:2468] T c0d0022e48f04b83ac1c998a83fe3f55 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
W20251215 14:55:03.812299 8855 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96b2d20fd2304e7a9995206a043b7944 has no consensus state
I20251215 14:55:03.812443 9249 leader_election.cc:304] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:03.812891 9489 leader_election.cc:290] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:03.813040 9489 raft_consensus.cc:2804] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:03.813125 9489 raft_consensus.cc:493] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:03.813197 9489 raft_consensus.cc:3060] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.813359 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0d0022e48f04b83ac1c998a83fe3f55" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:03.813585 9040 raft_consensus.cc:2468] T c0d0022e48f04b83ac1c998a83fe3f55 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:03.814635 9433 consensus_queue.cc:1048] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:03.818004 9489 raft_consensus.cc:515] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.819693 9426 tablet_bootstrap.cc:492] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:03.819890 9426 ts_tablet_manager.cc:1403] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.063s user 0.003s sys 0.000s
I20251215 14:55:03.820833 9426 raft_consensus.cc:359] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.821025 9426 raft_consensus.cc:385] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.821130 9426 raft_consensus.cc:740] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.821453 9426 consensus_queue.cc:260] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.821945 9426 ts_tablet_manager.cc:1434] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:03.822088 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0d0022e48f04b83ac1c998a83fe3f55" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:03.822422 9040 raft_consensus.cc:3060] T c0d0022e48f04b83ac1c998a83fe3f55 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.823458 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c0d0022e48f04b83ac1c998a83fe3f55" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:03.823639 9180 raft_consensus.cc:3060] T c0d0022e48f04b83ac1c998a83fe3f55 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.823743 9489 leader_election.cc:290] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:03.825207 9040 raft_consensus.cc:2468] T c0d0022e48f04b83ac1c998a83fe3f55 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:03.825713 9248 leader_election.cc:304] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:03.826275 9180 raft_consensus.cc:2468] T c0d0022e48f04b83ac1c998a83fe3f55 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:03.827183 9489 raft_consensus.cc:2804] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:03.827349 9489 raft_consensus.cc:697] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:03.827661 9489 consensus_queue.cc:237] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.827791 8850 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet f4e5a0419b6b48f0a3038e0fb77bcfe4
W20251215 14:55:03.829533 8857 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3cdfcddd91fe47de8fd14dc718f421a6 consensus state has no leader
I20251215 14:55:03.830750 9435 consensus_queue.cc:260] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:03.834518 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet 26648bf286c94b2495e565969f945858
I20251215 14:55:03.835974 9040 raft_consensus.cc:3060] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.837884 8857 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_cd7ad6b69a804b79b66fe88feb54d697" } modify_external_catalogs: true
I20251215 14:55:03.838052 8857 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_cd7ad6b69a804b79b66fe88feb54d697" } modify_external_catalogs: true
I20251215 14:55:03.839497 9040 raft_consensus.cc:1275] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Refusing update from remote peer 3ea5306c36594ef4a62211f2bd6669a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 14:55:03.823438 9426 tablet_bootstrap.cc:492] T 9bd8d964650a49b08093608abf3e31fa P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:03.840121 9440 consensus_queue.cc:1048] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:03.842425 9435 ts_tablet_manager.cc:1434] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.034s user 0.001s sys 0.003s
W20251215 14:55:03.842463 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
I20251215 14:55:03.842667 9427 tablet_bootstrap.cc:492] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:03.842864 9427 ts_tablet_manager.cc:1403] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.105s user 0.006s sys 0.006s
I20251215 14:55:03.843533 9440 raft_consensus.cc:493] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:03.843679 9440 raft_consensus.cc:515] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.844939 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb2f4fc179744458bc7db2f6c7197ec5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:03.845216 9313 raft_consensus.cc:2468] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:03.845676 9115 leader_election.cc:304] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:03.845965 9540 raft_consensus.cc:2804] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:03.846042 9540 raft_consensus.cc:493] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:03.846132 9540 raft_consensus.cc:3060] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.847059 9427 raft_consensus.cc:359] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.847261 9427 raft_consensus.cc:385] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:03.847429 9427 raft_consensus.cc:740] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:03.847747 9427 consensus_queue.cc:260] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.848351 9427 ts_tablet_manager.cc:1434] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251215 14:55:03.848613 9427 tablet_bootstrap.cc:492] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:03.848843 9540 raft_consensus.cc:515] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.850206 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb2f4fc179744458bc7db2f6c7197ec5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:03.850401 9313 raft_consensus.cc:3060] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.850348 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb2f4fc179744458bc7db2f6c7197ec5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:03.850524 9040 raft_consensus.cc:3060] T cb2f4fc179744458bc7db2f6c7197ec5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:03.852332 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb2f4fc179744458bc7db2f6c7197ec5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:03.853075 8853 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 188eb879e7c3479ea71c5b1864400243 has no consensus state
I20251215 14:55:03.853304 9040 raft_consensus.cc:2468] T cb2f4fc179744458bc7db2f6c7197ec5 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:03.853312 9313 raft_consensus.cc:2468] T cb2f4fc179744458bc7db2f6c7197ec5 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
W20251215 14:55:03.856758 8851 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2104a3530264fa982b20aed20afb0b4 has no consensus state
I20251215 14:55:03.856851 9112 leader_election.cc:304] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:03.857321 9507 raft_consensus.cc:2804] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:03.858680 8850 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_c6d082c899204c5280db8f13e837c0de" } modify_external_catalogs: true
I20251215 14:55:03.858856 8850 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_c6d082c899204c5280db8f13e837c0de" } modify_external_catalogs: true
I20251215 14:55:03.861110 9440 leader_election.cc:290] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:03.862454 9540 leader_election.cc:290] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:03.865025 9426 tablet_bootstrap.cc:654] T 9bd8d964650a49b08093608abf3e31fa P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.867514 8856 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_da5c57895b1547848d875ca7761f7943"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:03.868225 8856 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_da5c57895b1547848d875ca7761f7943 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:03.872306 8851 catalog_manager.cc:5487] Ignoring report from unknown tablet 924c9dd0cd9d40189bfe1457040f3d37
W20251215 14:55:03.872414 8851 catalog_manager.cc:5487] Ignoring report from unknown tablet f2aae2798eee4775afaa3afc59e98a6c
I20251215 14:55:03.856715 9435 tablet_bootstrap.cc:492] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:03.867904 9609 raft_consensus.cc:493] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:03.873752 9609 raft_consensus.cc:515] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:03.874539 9609 leader_election.cc:290] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:03.868620 9432 ts_tablet_manager.cc:1929] T c4f47c22111c427a8ab9c4ae1e105375 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:03.874876 9432 log.cc:1199] T c4f47c22111c427a8ab9c4ae1e105375 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:03.875443 9432 ts_tablet_manager.cc:1950] T c4f47c22111c427a8ab9c4ae1e105375 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:03.875841 9435 tablet_bootstrap.cc:654] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.875792 9433 raft_consensus.cc:493] T 018bd6ac8a534a6abc461b57b89b93eb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:03.875982 9433 raft_consensus.cc:515] T 018bd6ac8a534a6abc461b57b89b93eb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.876644 9433 leader_election.cc:290] T 018bd6ac8a534a6abc461b57b89b93eb P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:03.877548 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9695d47e35448fdad95ff3f24bafd03" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:03.878898 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet c4f47c22111c427a8ab9c4ae1e105375 (table default.Table_23c657126ccf46fabe10f93f2e991891 [id=b76c4f587a0d4acc8e7d2a27dae1fc7a]) successfully deleted
W20251215 14:55:03.879300 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 95583eee8a5041b1ade97e8f8f0db271 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 95583eee8a5041b1ade97e8f8f0db271 already in progress: creating tablet
I20251215 14:55:03.880604 9507 raft_consensus.cc:697] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
W20251215 14:55:03.880936 9248 leader_election.cc:343] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:03.881305 9507 consensus_queue.cc:237] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:03.884016 9426 tablet_bootstrap.cc:492] T 9bd8d964650a49b08093608abf3e31fa P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:03.885090 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "018bd6ac8a534a6abc461b57b89b93eb" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:03.885190 9426 ts_tablet_manager.cc:1403] T 9bd8d964650a49b08093608abf3e31fa P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.001s
I20251215 14:55:03.886525 8851 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 429c0b2d7cb2428c8de6b02acde36044 (table default.Table_20d2c5b358444df59324e21800508f8d [id=c421ca23de494f4ba674e4cc86bac3da]). Expected version 1 got 0
I20251215 14:55:03.889117 9427 tablet_bootstrap.cc:654] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:03.889655 8852 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 88c8499633f4417e9f6d2d6372f157c4
I20251215 14:55:03.890096 8852 catalog_manager.cc:6724] ReplaceTablet: tablet 88c8499633f4417e9f6d2d6372f157c4 deleted and replaced by tablet 90c0254840b442a3817171b06f2726c8
I20251215 14:55:03.890448 9292 tablet_service.cc:1552] Processing DeleteTablet for tablet 88c8499633f4417e9f6d2d6372f157c4 with delete_type TABLET_DATA_DELETED (replaced by tablet 90c0254840b442a3817171b06f2726c8) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.890700 9432 tablet_replica.cc:333] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:03.890730 9149 tablet_service.cc:1552] Processing DeleteTablet for tablet 88c8499633f4417e9f6d2d6372f157c4 with delete_type TABLET_DATA_DELETED (replaced by tablet 90c0254840b442a3817171b06f2726c8) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.890908 9432 raft_consensus.cc:2243] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:03.891115 9430 tablet_replica.cc:333] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:03.891121 9432 raft_consensus.cc:2272] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:03.891428 8857 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet ccf007574c3345489a425b29336a7998
I20251215 14:55:03.891418 9430 raft_consensus.cc:2243] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:03.891708 9432 ts_tablet_manager.cc:1916] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:03.891700 9430 raft_consensus.cc:2272] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:03.892357 9430 ts_tablet_manager.cc:1916] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:03.895633 9603 mvcc.cc:204] Tried to move back new op lower bound from 7232759823519924224 to 7232759822241992704. Current Snapshot: MvccSnapshot[applied={T|T < 7232759823519924224}]
I20251215 14:55:03.902603 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "018bd6ac8a534a6abc461b57b89b93eb" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:03.902889 9180 raft_consensus.cc:2393] T 018bd6ac8a534a6abc461b57b89b93eb P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:03.903384 8976 leader_election.cc:304] T 018bd6ac8a534a6abc461b57b89b93eb P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:03.908963 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9695d47e35448fdad95ff3f24bafd03" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:03.912659 9292 tablet_service.cc:1505] Processing CreateTablet for tablet 5f03dfdd546c492185c6c31866a090a5 (DEFAULT_TABLE table=default.Table_cd8c7355c25f412eb97abafa172e6f6c [id=94967e41626c4b04b922dee0d21b4f5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.912863 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 16309efc14e747d09ce6e5de4f3c2784 (DEFAULT_TABLE table=default.Table_ba58101b52714972a7867936bda32bf3 [id=7b5572148ff74a40b3f24d295fae6e07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.913103 9292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f03dfdd546c492185c6c31866a090a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.913365 9276 tablet_service.cc:1505] Processing CreateTablet for tablet 05e70b4070b6437e9b934af4e6b93f6a (DEFAULT_TABLE table=default.Table_f1d62eb0033c45999a3caccdf7c64f34 [id=acc631af7be84511b009b9175eacd781]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.913671 9276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e70b4070b6437e9b934af4e6b93f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.917878 9157 tablet_service.cc:1505] Processing CreateTablet for tablet 16309efc14e747d09ce6e5de4f3c2784 (DEFAULT_TABLE table=default.Table_ba58101b52714972a7867936bda32bf3 [id=7b5572148ff74a40b3f24d295fae6e07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.918262 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16309efc14e747d09ce6e5de4f3c2784. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.919463 9156 tablet_service.cc:1505] Processing CreateTablet for tablet 05e70b4070b6437e9b934af4e6b93f6a (DEFAULT_TABLE table=default.Table_f1d62eb0033c45999a3caccdf7c64f34 [id=acc631af7be84511b009b9175eacd781]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.919809 9156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e70b4070b6437e9b934af4e6b93f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.923419 9148 tablet_service.cc:1505] Processing CreateTablet for tablet e2104a3530264fa982b20aed20afb0b4 (DEFAULT_TABLE table=default.Table_6bd7eee6a17d43f4baf1db824203acab [id=d916193804f94519b84d259c0420e1a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.923728 9148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2104a3530264fa982b20aed20afb0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.925467 8859 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 5e80ac7bd98a46119a30bd5d2f3de2f9
I20251215 14:55:03.927487 9152 tablet_service.cc:1505] Processing CreateTablet for tablet 61aef86a30e842f2a90f9f1c88c84f4d (DEFAULT_TABLE table=default.Table_38b1c1a82dd441dfa8131162ac117124 [id=c50e99dfae684c81a80bfce95ff35672]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.927842 9152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61aef86a30e842f2a90f9f1c88c84f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.931012 8850 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 30c5c795ea4a4fe591cdf63320ec2521
I20251215 14:55:03.931699 9149 tablet_service.cc:1505] Processing CreateTablet for tablet 5f03dfdd546c492185c6c31866a090a5 (DEFAULT_TABLE table=default.Table_cd8c7355c25f412eb97abafa172e6f6c [id=94967e41626c4b04b922dee0d21b4f5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.932029 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f03dfdd546c492185c6c31866a090a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.935490 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16309efc14e747d09ce6e5de4f3c2784. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.941890 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 61aef86a30e842f2a90f9f1c88c84f4d (DEFAULT_TABLE table=default.Table_38b1c1a82dd441dfa8131162ac117124 [id=c50e99dfae684c81a80bfce95ff35672]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.942374 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61aef86a30e842f2a90f9f1c88c84f4d. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:03.942847 9249 leader_election.cc:343] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:03.942976 9249 leader_election.cc:304] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:03.943979 9292 tablet_service.cc:1505] Processing CreateTablet for tablet e2104a3530264fa982b20aed20afb0b4 (DEFAULT_TABLE table=default.Table_6bd7eee6a17d43f4baf1db824203acab [id=d916193804f94519b84d259c0420e1a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.944337 9292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2104a3530264fa982b20aed20afb0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.944937 9279 tablet_service.cc:1505] Processing CreateTablet for tablet 188eb879e7c3479ea71c5b1864400243 (DEFAULT_TABLE table=default.Table_3c445d0ed5f446aebb1ccb87ceac7222 [id=c10e2250ff0f4d409fb79c1628f22671]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.945291 9279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 188eb879e7c3479ea71c5b1864400243. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.945839 9287 tablet_service.cc:1505] Processing CreateTablet for tablet c8af1d0b67424bec90b59863a975254e (DEFAULT_TABLE table=default.Table_2920b8dba9704f489af552aa0ce58b64 [id=53456f18769d4b1ebe4743594e412016]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.946136 9287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8af1d0b67424bec90b59863a975254e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.946684 9286 tablet_service.cc:1505] Processing CreateTablet for tablet 18cd1f63d51e4565bb8c55be13e3e099 (DEFAULT_TABLE table=default.Table_07084f618f754b739e18f98bf0a3b7b8 [id=ab537167c6d94d9d83ed06b734395be3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.946993 9286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18cd1f63d51e4565bb8c55be13e3e099. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.948158 9282 tablet_service.cc:1505] Processing CreateTablet for tablet 96b2d20fd2304e7a9995206a043b7944 (DEFAULT_TABLE table=default.Table_42e5c1011ba64c0b9602eed064c8ecbd [id=4343a6c3acc545d7be8d3b7ec617da90]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.948480 9282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96b2d20fd2304e7a9995206a043b7944. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.949151 9294 tablet_service.cc:1505] Processing CreateTablet for tablet f7af1f66c4f04f649379758ff1b3e387 (DEFAULT_TABLE table=default.Table_fa4a417edbd04446b7cff43ff66d683b [id=b1e213e4f94d4015916ab6935de4602a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.949469 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7af1f66c4f04f649379758ff1b3e387. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.950117 9278 tablet_service.cc:1552] Processing DeleteTablet for tablet 5e80ac7bd98a46119a30bd5d2f3de2f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.950382 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet 30c5c795ea4a4fe591cdf63320ec2521 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:03.950714 9285 tablet_service.cc:1505] Processing CreateTablet for tablet bfead52afe8040a88ba0d826f482b1bd (DEFAULT_TABLE table=default.Table_c9cd184036e942449e5f5a3d806a1000 [id=d8410eb19405483eafbfc5b83e088c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.951049 9285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfead52afe8040a88ba0d826f482b1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.951594 9283 tablet_service.cc:1505] Processing CreateTablet for tablet 5e80ac7bd98a46119a30bd5d2f3de2f9 (DEFAULT_TABLE table=default.Table_a56faaf463d84718bfd9c88b0825220c [id=77f7e171e47e491baf78237dd852be5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.951887 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e80ac7bd98a46119a30bd5d2f3de2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.952206 9277 tablet_service.cc:1505] Processing CreateTablet for tablet 9bf4a899338f4bcfac099b5099a22f05 (DEFAULT_TABLE table=default.Table_ad8e8a5df4ec4b53a051977d42d10a17 [id=f87a4d1335e64e9f9234807ded6cc7d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.952410 9281 tablet_service.cc:1505] Processing CreateTablet for tablet 95caeaf32d154c0ba4c88dd3f295876d (DEFAULT_TABLE table=default.Table_e726b47802404f3aaccb61d6aaaa72a5 [id=62dd6789e50a49ca96ec0db0ef20bb44]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.952528 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf4a899338f4bcfac099b5099a22f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.952678 9281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95caeaf32d154c0ba4c88dd3f295876d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.953121 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 38e50a7f2bdd4907ab41436b59397ea6 (DEFAULT_TABLE table=default.Table_ada3150d10a34cb4aaf8a16a487fa543 [id=d12dc623fa0a4a6cbd87ee8180c4c885]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.953457 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e50a7f2bdd4907ab41436b59397ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.953490 9284 tablet_service.cc:1505] Processing CreateTablet for tablet c7f760639a664cfb9f4af5578154b981 (DEFAULT_TABLE table=default.Table_bec53ce4c0c04be8bb0aabb4ce60974b [id=0ed94690124e4fd7a23a6ddf2291c6d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.953755 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f760639a664cfb9f4af5578154b981. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.953958 9280 tablet_service.cc:1505] Processing CreateTablet for tablet e0c88310853f47b0aa1af9a3d676bef6 (DEFAULT_TABLE table=default.Table_a469ba7678054925965fe69d826f1c16 [id=d0891c1ad38b48348b350482a3298f39]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.954360 9280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c88310853f47b0aa1af9a3d676bef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.954574 9288 tablet_service.cc:1505] Processing CreateTablet for tablet f121a14828e6443695960c0e540ae573 (DEFAULT_TABLE table=default.Table_f416fea67a974ab084b7b48a60426131 [id=0e3677e1f3d048ecad508d50304ee56a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.954879 9290 tablet_service.cc:1505] Processing CreateTablet for tablet 30c5c795ea4a4fe591cdf63320ec2521 (DEFAULT_TABLE table=default.Table_c6d082c899204c5280db8f13e837c0de [id=39d4b6289fd34b8181d025f48399ba62]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.955452 9291 tablet_service.cc:1505] Processing CreateTablet for tablet 4c96b655cf284326ae3fa2a165e2bf95 (DEFAULT_TABLE table=default.Table_77da0b679b494783bb486ac3e8887892 [id=b7ff2d02e55b4e839049b20b89227526]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.957463 9278 tablet_service.cc:1505] Processing CreateTablet for tablet 26754a74483c4c9580df93aae10e7de1 (DEFAULT_TABLE table=default.Table_72f52de38f25438fbfe0a6a0f8bdc5f6 [id=cbafb4499c90447d8f185928d3e58b20]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.954909 9288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f121a14828e6443695960c0e540ae573. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.958499 9147 tablet_service.cc:1505] Processing CreateTablet for tablet 188eb879e7c3479ea71c5b1864400243 (DEFAULT_TABLE table=default.Table_3c445d0ed5f446aebb1ccb87ceac7222 [id=c10e2250ff0f4d409fb79c1628f22671]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.958969 9147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 188eb879e7c3479ea71c5b1864400243. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.961998 9145 tablet_service.cc:1552] Processing DeleteTablet for tablet 5e80ac7bd98a46119a30bd5d2f3de2f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.962513 9145 tablet_service.cc:1505] Processing CreateTablet for tablet 4c96b655cf284326ae3fa2a165e2bf95 (DEFAULT_TABLE table=default.Table_77da0b679b494783bb486ac3e8887892 [id=b7ff2d02e55b4e839049b20b89227526]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.964339 9143 tablet_service.cc:1505] Processing CreateTablet for tablet 30c5c795ea4a4fe591cdf63320ec2521 (DEFAULT_TABLE table=default.Table_c6d082c899204c5280db8f13e837c0de [id=39d4b6289fd34b8181d025f48399ba62]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.964816 9154 tablet_service.cc:1552] Processing DeleteTablet for tablet 30c5c795ea4a4fe591cdf63320ec2521 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:03.966128 9146 tablet_service.cc:1505] Processing CreateTablet for tablet 18cd1f63d51e4565bb8c55be13e3e099 (DEFAULT_TABLE table=default.Table_07084f618f754b739e18f98bf0a3b7b8 [id=ab537167c6d94d9d83ed06b734395be3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.966773 9160 tablet_service.cc:1505] Processing CreateTablet for tablet e0c88310853f47b0aa1af9a3d676bef6 (DEFAULT_TABLE table=default.Table_a469ba7678054925965fe69d826f1c16 [id=d0891c1ad38b48348b350482a3298f39]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.967100 9153 tablet_service.cc:1505] Processing CreateTablet for tablet 5e80ac7bd98a46119a30bd5d2f3de2f9 (DEFAULT_TABLE table=default.Table_a56faaf463d84718bfd9c88b0825220c [id=77f7e171e47e491baf78237dd852be5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.969192 9151 tablet_service.cc:1505] Processing CreateTablet for tablet c8af1d0b67424bec90b59863a975254e (DEFAULT_TABLE table=default.Table_2920b8dba9704f489af552aa0ce58b64 [id=53456f18769d4b1ebe4743594e412016]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.969511 9144 tablet_service.cc:1505] Processing CreateTablet for tablet 38e50a7f2bdd4907ab41436b59397ea6 (DEFAULT_TABLE table=default.Table_ada3150d10a34cb4aaf8a16a487fa543 [id=d12dc623fa0a4a6cbd87ee8180c4c885]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.969777 9150 tablet_service.cc:1505] Processing CreateTablet for tablet 95caeaf32d154c0ba4c88dd3f295876d (DEFAULT_TABLE table=default.Table_e726b47802404f3aaccb61d6aaaa72a5 [id=62dd6789e50a49ca96ec0db0ef20bb44]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.970042 9159 tablet_service.cc:1505] Processing CreateTablet for tablet bfead52afe8040a88ba0d826f482b1bd (DEFAULT_TABLE table=default.Table_c9cd184036e942449e5f5a3d806a1000 [id=d8410eb19405483eafbfc5b83e088c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.970469 9155 tablet_service.cc:1505] Processing CreateTablet for tablet f7af1f66c4f04f649379758ff1b3e387 (DEFAULT_TABLE table=default.Table_fa4a417edbd04446b7cff43ff66d683b [id=b1e213e4f94d4015916ab6935de4602a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.967211 9158 tablet_service.cc:1505] Processing CreateTablet for tablet 96b2d20fd2304e7a9995206a043b7944 (DEFAULT_TABLE table=default.Table_42e5c1011ba64c0b9602eed064c8ecbd [id=4343a6c3acc545d7be8d3b7ec617da90]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.971117 9145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c96b655cf284326ae3fa2a165e2bf95. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.978873 9154 tablet_service.cc:1505] Processing CreateTablet for tablet c7f760639a664cfb9f4af5578154b981 (DEFAULT_TABLE table=default.Table_bec53ce4c0c04be8bb0aabb4ce60974b [id=0ed94690124e4fd7a23a6ddf2291c6d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.979306 9150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95caeaf32d154c0ba4c88dd3f295876d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.983489 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c96b655cf284326ae3fa2a165e2bf95. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.983738 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c5c795ea4a4fe591cdf63320ec2521. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:03.983779 9432 ts_tablet_manager.cc:1929] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251215 14:55:03.977313 9141 tablet_service.cc:1505] Processing CreateTablet for tablet 26754a74483c4c9580df93aae10e7de1 (DEFAULT_TABLE table=default.Table_72f52de38f25438fbfe0a6a0f8bdc5f6 [id=cbafb4499c90447d8f185928d3e58b20]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:03.989744 9609 raft_consensus.cc:493] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:03.984371 9142 tablet_service.cc:1505] Processing CreateTablet for tablet 9bf4a899338f4bcfac099b5099a22f05 (DEFAULT_TABLE table=default.Table_ad8e8a5df4ec4b53a051977d42d10a17 [id=f87a4d1335e64e9f9234807ded6cc7d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.013411 9630 raft_consensus.cc:3060] T 018bd6ac8a534a6abc461b57b89b93eb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:04.025471 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7af1f66c4f04f649379758ff1b3e387. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.028575 9631 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:04.028824 9631 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.030174 9631 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:04.030864 9631 raft_consensus.cc:493] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:04.042733 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96b2d20fd2304e7a9995206a043b7944. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.031062 9631 raft_consensus.cc:515] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.044263 9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf4a899338f4bcfac099b5099a22f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.044526 9631 leader_election.cc:290] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:04.046232 9630 raft_consensus.cc:2749] T 018bd6ac8a534a6abc461b57b89b93eb P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:04.073616 9278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26754a74483c4c9580df93aae10e7de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.079938 9432 log.cc:1199] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/88c8499633f4417e9f6d2d6372f157c4
I20251215 14:55:04.083207 9432 ts_tablet_manager.cc:1950] T 88c8499633f4417e9f6d2d6372f157c4 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
W20251215 14:55:04.086176 8978 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:04.086685 9630 consensus_queue.cc:1048] T f2aae2798eee4775afaa3afc59e98a6c P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:04.087714 8978 consensus_peers.cc:597] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88c8499633f4417e9f6d2d6372f157c4. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:04.092096 9489 raft_consensus.cc:2749] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:04.093906 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bd8d964650a49b08093608abf3e31fa" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:04.102144 9276 tablet_service.cc:1505] Processing CreateTablet for tablet bafc5063058a469bb9c9b3e5345eb1be (DEFAULT_TABLE table=default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d [id=066e8ae14004436cb8b4f3f740b45b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.102613 9276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bafc5063058a469bb9c9b3e5345eb1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.103688 9609 raft_consensus.cc:515] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:04.104844 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 88c8499633f4417e9f6d2d6372f157c4 (table default.Table_ae411cdd8f1740839d5490d643672e18 [id=b16ae3d8bb2a40eda9602301a2a2dc2e]) successfully deleted
I20251215 14:55:04.104861 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "80d4c9b533ac4facb4205aff84903134" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:04.105046 9609 leader_election.cc:290] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:04.105072 9040 raft_consensus.cc:2468] T 80d4c9b533ac4facb4205aff84903134 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
W20251215 14:55:04.105204 8846 catalog_manager.cc:4952] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 5e80ac7bd98a46119a30bd5d2f3de2f9 because the tablet was not found. No further retry: Not found: Tablet not found: 5e80ac7bd98a46119a30bd5d2f3de2f9
W20251215 14:55:04.105460 8846 catalog_manager.cc:4952] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 30c5c795ea4a4fe591cdf63320ec2521 because the tablet was not found. No further retry: Not found: Tablet not found: 30c5c795ea4a4fe591cdf63320ec2521
I20251215 14:55:04.105907 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "80d4c9b533ac4facb4205aff84903134" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:04.106149 9178 raft_consensus.cc:2468] T 80d4c9b533ac4facb4205aff84903134 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:04.106633 9248 leader_election.cc:304] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:04.108441 9609 raft_consensus.cc:2804] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:04.109606 9609 raft_consensus.cc:493] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:04.115957 9286 tablet_service.cc:1505] Processing CreateTablet for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (DEFAULT_TABLE table=default.Table_7231bb3c534046a98fc17c3557841d6f [id=9f4bc32583124d6e956b457792323ae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.119874 9286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.103600 9314 raft_consensus.cc:2468] T 9bd8d964650a49b08093608abf3e31fa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:04.123837 9609 raft_consensus.cc:3060] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:04.123859 8978 leader_election.cc:304] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:04.124176 9630 raft_consensus.cc:2804] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:04.124298 9630 raft_consensus.cc:493] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:04.124377 9630 raft_consensus.cc:3060] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:04.126886 9630 raft_consensus.cc:515] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.127702 9630 leader_election.cc:290] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:04.127867 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 4af4cf6ec825467383349098eda661c6 (DEFAULT_TABLE table=default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e [id=6b4b04bb03f04a8a9cd7bc893acf612c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.128366 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af4cf6ec825467383349098eda661c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.130563 9285 tablet_service.cc:1505] Processing CreateTablet for tablet bb3b95d32c7044bd8a4451381c19aeba (DEFAULT_TABLE table=default.Table_d884e36a60cf4a109778a5bfa32afaa8 [id=7ec65d77d89d4e40a60b716f721e2940]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.134174 9440 raft_consensus.cc:493] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:04.135545 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 194bb745ecb849cb9092fee1afb7dbe6 (DEFAULT_TABLE table=default.Table_08e092a0a75f48e89a6d074a91911704 [id=5f8b02d3f84e490dbf2cf00772e21eff]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.135985 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bd8d964650a49b08093608abf3e31fa" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:04.164673 9314 raft_consensus.cc:3060] T 9bd8d964650a49b08093608abf3e31fa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:04.164808 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 194bb745ecb849cb9092fee1afb7dbe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.167400 9285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3b95d32c7044bd8a4451381c19aeba. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.167730 9314 raft_consensus.cc:2468] T 9bd8d964650a49b08093608abf3e31fa P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:04.168372 8978 leader_election.cc:304] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:04.168767 9630 raft_consensus.cc:2804] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:04.168931 9630 raft_consensus.cc:697] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:04.169260 9630 consensus_queue.cc:237] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.138540 9279 tablet_service.cc:1505] Processing CreateTablet for tablet a639396098a941249afd9c3560073131 (DEFAULT_TABLE table=default.Table_f1ad091bc41747ffba1fca75bcf619b7 [id=5cc820ec2c8b427db1c89647b295363e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.171589 9279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a639396098a941249afd9c3560073131. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.144443 9286 tablet_service.cc:1505] Processing CreateTablet for tablet 5dc81eb40614463cb5017475b378eea6 (DEFAULT_TABLE table=default.Table_8545c01c50ce45489e3e219e52e98acd [id=94ddd629cb1e4f5eb0061100187f4202]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.177105 9286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc81eb40614463cb5017475b378eea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.150939 9283 tablet_service.cc:1505] Processing CreateTablet for tablet 605da10c8d3049e8b94caa9738576aab (DEFAULT_TABLE table=default.Table_9fff09bdf4114198810006599bcf1f3d [id=1a10676eee8b47098cf45bee49e3f502]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.146411 9291 tablet_service.cc:1505] Processing CreateTablet for tablet 2d75636265f14a428aae592438064ea2 (DEFAULT_TABLE table=default.Table_da5c57895b1547848d875ca7761f7943 [id=4094651ce99d4c47bc0fbfeb5ba33b04]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.155019 9288 tablet_service.cc:1505] Processing CreateTablet for tablet 5560a21e16bb43c7903c1fc66429ecdf (DEFAULT_TABLE table=default.Table_9ae28ea04dcf4d038b4467a5f0788a69 [id=5f7704a7da85406cb20243ca8c50962d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.180704 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfead52afe8040a88ba0d826f482b1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.181564 9440 raft_consensus.cc:515] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.177429 9289 tablet_service.cc:1505] Processing CreateTablet for tablet fda9eb99ccef4c16a0a947510566ecf4 (DEFAULT_TABLE table=default.Table_862e5241fcc042d8bf376e55c3c86fa0 [id=c1c5f6c604c24855a17e2dfb4174965b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.189817 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2df2138e41844e9f897e57264b62cc9d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:04.191798 9617 raft_consensus.cc:493] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:04.191998 9112 leader_election.cc:343] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:04.192026 9617 raft_consensus.cc:515] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:04.192750 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c88310853f47b0aa1af9a3d676bef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.163233 9284 tablet_service.cc:1505] Processing CreateTablet for tablet ff4508c5a110427eb4d9d2eaaadace0b (DEFAULT_TABLE table=default.Table_1ea29a2534e24318a5604a9a1c93fbe0 [id=cfc66f0ad54746d78dd5ad5a6054f3f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.202838 9617 leader_election.cc:290] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:04.202867 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "924c9dd0cd9d40189bfe1457040f3d37" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:04.203049 9617 consensus_queue.cc:1048] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:04.197302 9145 tablet_service.cc:1505] Processing CreateTablet for tablet f121a14828e6443695960c0e540ae573 (DEFAULT_TABLE table=default.Table_f416fea67a974ab084b7b48a60426131 [id=0e3677e1f3d048ecad508d50304ee56a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.210278 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fda9eb99ccef4c16a0a947510566ecf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.215462 9440 leader_election.cc:290] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:04.215780 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e50a7f2bdd4907ab41436b59397ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.216590 9288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5560a21e16bb43c7903c1fc66429ecdf. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:04.218685 9112 leader_election.cc:343] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:04.219132 9489 raft_consensus.cc:493] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:04.219305 9489 raft_consensus.cc:515] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.219923 9489 leader_election.cc:290] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:04.220039 9489 raft_consensus.cc:493] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:04.220161 9489 raft_consensus.cc:515] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.220702 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2df2138e41844e9f897e57264b62cc9d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:04.220738 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6aad8bed15a416a925ae8c8870d4e51" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:04.220920 9314 raft_consensus.cc:2468] T 2df2138e41844e9f897e57264b62cc9d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:04.221312 9115 leader_election.cc:304] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
W20251215 14:55:04.221452 9248 leader_election.cc:343] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:04.227526 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bdfc164128a6413a83d83d05b69fb74a" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:04.264317 9141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26754a74483c4c9580df93aae10e7de1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.265393 9617 raft_consensus.cc:2804] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:04.265537 9617 raft_consensus.cc:493] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:04.265576 9147 tablet_service.cc:1505] Processing CreateTablet for tablet bafc5063058a469bb9c9b3e5345eb1be (DEFAULT_TABLE table=default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d [id=066e8ae14004436cb8b4f3f740b45b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.265928 9617 raft_consensus.cc:3060] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:04.270762 9617 raft_consensus.cc:515] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.272218 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2df2138e41844e9f897e57264b62cc9d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
W20251215 14:55:04.272791 9112 leader_election.cc:343] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:04.273478 9617 leader_election.cc:290] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:04.275857 9158 tablet_service.cc:1505] Processing CreateTablet for tablet a639396098a941249afd9c3560073131 (DEFAULT_TABLE table=default.Table_f1ad091bc41747ffba1fca75bcf619b7 [id=5cc820ec2c8b427db1c89647b295363e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.276307 9617 raft_consensus.cc:493] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:04.276510 9617 raft_consensus.cc:515] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.277561 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "11a5a6a0895c49648c910fa2ea3ca373" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:04.277781 9040 raft_consensus.cc:2468] T 11a5a6a0895c49648c910fa2ea3ca373 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:04.278182 9112 leader_election.cc:304] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:04.278815 9617 leader_election.cc:290] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:04.279031 9617 raft_consensus.cc:2804] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:04.279150 9617 raft_consensus.cc:493] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:04.279325 9617 raft_consensus.cc:3060] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:04.284843 9156 tablet_service.cc:1505] Processing CreateTablet for tablet 5dc81eb40614463cb5017475b378eea6 (DEFAULT_TABLE table=default.Table_8545c01c50ce45489e3e219e52e98acd [id=94ddd629cb1e4f5eb0061100187f4202]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.286679 9152 tablet_service.cc:1505] Processing CreateTablet for tablet 2d75636265f14a428aae592438064ea2 (DEFAULT_TABLE table=default.Table_da5c57895b1547848d875ca7761f7943 [id=4094651ce99d4c47bc0fbfeb5ba33b04]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.287530 9155 tablet_service.cc:1505] Processing CreateTablet for tablet 605da10c8d3049e8b94caa9738576aab (DEFAULT_TABLE table=default.Table_9fff09bdf4114198810006599bcf1f3d [id=1a10676eee8b47098cf45bee49e3f502]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.291072 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "924c9dd0cd9d40189bfe1457040f3d37" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:04.291522 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605da10c8d3049e8b94caa9738576aab. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:04.295446 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 9bf4a899338f4bcfac099b5099a22f05 (table default.Table_ad8e8a5df4ec4b53a051977d42d10a17 [id=f87a4d1335e64e9f9234807ded6cc7d9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9bf4a899338f4bcfac099b5099a22f05 consensus state has no leader
I20251215 14:55:04.296139 9622 tablet.cc:1722] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:04.296253 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet 88c8499633f4417e9f6d2d6372f157c4 with delete_type TABLET_DATA_DELETED (replaced by tablet 90c0254840b442a3817171b06f2726c8) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:04.296558 9431 tablet_replica.cc:333] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:04.296805 9431 raft_consensus.cc:2243] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:04.297461 9431 raft_consensus.cc:2272] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 14:55:04.297941 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet cb2f4fc179744458bc7db2f6c7197ec5
I20251215 14:55:04.298172 9431 ts_tablet_manager.cc:1916] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:04.299608 9021 tablet_service.cc:1505] Processing CreateTablet for tablet 5f03dfdd546c492185c6c31866a090a5 (DEFAULT_TABLE table=default.Table_cd8c7355c25f412eb97abafa172e6f6c [id=94967e41626c4b04b922dee0d21b4f5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.299067 9010 tablet_service.cc:1505] Processing CreateTablet for tablet 05e70b4070b6437e9b934af4e6b93f6a (DEFAULT_TABLE table=default.Table_f1d62eb0033c45999a3caccdf7c64f34 [id=acc631af7be84511b009b9175eacd781]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.299995 9021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f03dfdd546c492185c6c31866a090a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.300244 9010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e70b4070b6437e9b934af4e6b93f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.300534 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 16309efc14e747d09ce6e5de4f3c2784 (DEFAULT_TABLE table=default.Table_ba58101b52714972a7867936bda32bf3 [id=7b5572148ff74a40b3f24d295fae6e07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.300889 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16309efc14e747d09ce6e5de4f3c2784. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.303395 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet c4f47c22111c427a8ab9c4ae1e105375 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:04.303411 9430 ts_tablet_manager.cc:1929] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251215 14:55:04.303555 9430 log.cc:1199] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/88c8499633f4417e9f6d2d6372f157c4
I20251215 14:55:04.303901 9430 ts_tablet_manager.cc:1950] T 88c8499633f4417e9f6d2d6372f157c4 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:04.307925 9010 tablet_service.cc:1505] Processing CreateTablet for tablet e2104a3530264fa982b20aed20afb0b4 (DEFAULT_TABLE table=default.Table_6bd7eee6a17d43f4baf1db824203acab [id=d916193804f94519b84d259c0420e1a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.308040 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6aad8bed15a416a925ae8c8870d4e51" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:04.308322 9010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2104a3530264fa982b20aed20afb0b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.308493 9636 tablet.cc:1722] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:04.308573 9426 raft_consensus.cc:359] T 9bd8d964650a49b08093608abf3e31fa P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.308745 9426 raft_consensus.cc:385] T 9bd8d964650a49b08093608abf3e31fa P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:04.308825 9426 raft_consensus.cc:740] T 9bd8d964650a49b08093608abf3e31fa P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:04.309206 9426 consensus_queue.cc:260] T 9bd8d964650a49b08093608abf3e31fa P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.310222 9148 tablet_service.cc:1505] Processing CreateTablet for tablet 4af4cf6ec825467383349098eda661c6 (DEFAULT_TABLE table=default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e [id=6b4b04bb03f04a8a9cd7bc893acf612c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.310523 9157 tablet_service.cc:1505] Processing CreateTablet for tablet bb3b95d32c7044bd8a4451381c19aeba (DEFAULT_TABLE table=default.Table_d884e36a60cf4a109778a5bfa32afaa8 [id=7ec65d77d89d4e40a60b716f721e2940]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.310801 9150 tablet_service.cc:1505] Processing CreateTablet for tablet 194bb745ecb849cb9092fee1afb7dbe6 (DEFAULT_TABLE table=default.Table_08e092a0a75f48e89a6d074a91911704 [id=5f8b02d3f84e490dbf2cf00772e21eff]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.313098 8850 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 429c0b2d7cb2428c8de6b02acde36044 (table default.Table_20d2c5b358444df59324e21800508f8d [id=c421ca23de494f4ba674e4cc86bac3da]). Expected version 1 got 0
I20251215 14:55:04.311147 9018 tablet_service.cc:1505] Processing CreateTablet for tablet 188eb879e7c3479ea71c5b1864400243 (DEFAULT_TABLE table=default.Table_3c445d0ed5f446aebb1ccb87ceac7222 [id=c10e2250ff0f4d409fb79c1628f22671]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.314432 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 188eb879e7c3479ea71c5b1864400243. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.316504 9617 raft_consensus.cc:515] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.317899 8825 master_runner.cc:186] Error getting master registration for 127.8.121.190:44279: Network error: Client connection negotiation failed: client connection to 127.8.121.190:44279: connect: Connection refused (error 111),
I20251215 14:55:04.318053 8825 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251215 14:55:04.311419 9014 tablet_service.cc:1505] Processing CreateTablet for tablet c8af1d0b67424bec90b59863a975254e (DEFAULT_TABLE table=default.Table_2920b8dba9704f489af552aa0ce58b64 [id=53456f18769d4b1ebe4743594e412016]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.311970 9016 tablet_service.cc:1505] Processing CreateTablet for tablet 18cd1f63d51e4565bb8c55be13e3e099 (DEFAULT_TABLE table=default.Table_07084f618f754b739e18f98bf0a3b7b8 [id=ab537167c6d94d9d83ed06b734395be3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.319054 9006 tablet_service.cc:1505] Processing CreateTablet for tablet 61aef86a30e842f2a90f9f1c88c84f4d (DEFAULT_TABLE table=default.Table_38b1c1a82dd441dfa8131162ac117124 [id=c50e99dfae684c81a80bfce95ff35672]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.320065 9008 tablet_service.cc:1505] Processing CreateTablet for tablet bfead52afe8040a88ba0d826f482b1bd (DEFAULT_TABLE table=default.Table_c9cd184036e942449e5f5a3d806a1000 [id=d8410eb19405483eafbfc5b83e088c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.320343 9005 tablet_service.cc:1552] Processing DeleteTablet for tablet 5e80ac7bd98a46119a30bd5d2f3de2f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:04.320554 9011 tablet_service.cc:1505] Processing CreateTablet for tablet 5e80ac7bd98a46119a30bd5d2f3de2f9 (DEFAULT_TABLE table=default.Table_a56faaf463d84718bfd9c88b0825220c [id=77f7e171e47e491baf78237dd852be5a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.320570 9012 tablet_service.cc:1552] Processing DeleteTablet for tablet 30c5c795ea4a4fe591cdf63320ec2521 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:03 UTC) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:04.320739 8976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 417326us
I20251215 14:55:04.321445 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4f47c22111c427a8ab9c4ae1e105375" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:04.322324 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bd8d964650a49b08093608abf3e31fa" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:04.322490 9178 raft_consensus.cc:2468] T 9bd8d964650a49b08093608abf3e31fa P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:04.323285 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bd8d964650a49b08093608abf3e31fa" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:04.323432 9178 raft_consensus.cc:3060] T 9bd8d964650a49b08093608abf3e31fa P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:04.323457 8859 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_3c445d0ed5f446aebb1ccb87ceac7222" } modify_external_catalogs: true
I20251215 14:55:04.323655 8859 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_3c445d0ed5f446aebb1ccb87ceac7222" } modify_external_catalogs: true
I20251215 14:55:04.325886 9178 raft_consensus.cc:2468] T 9bd8d964650a49b08093608abf3e31fa P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:04.326632 9146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18cd1f63d51e4565bb8c55be13e3e099. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.326601 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_41cfaeeb78b544a38b5c116552bbecfa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:04.327118 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41cfaeeb78b544a38b5c116552bbecfa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:04.335322 8859 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 188eb879e7c3479ea71c5b1864400243
I20251215 14:55:04.339119 9143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c5c795ea4a4fe591cdf63320ec2521. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.339717 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f760639a664cfb9f4af5578154b981. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.340197 9153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e80ac7bd98a46119a30bd5d2f3de2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.340624 9151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8af1d0b67424bec90b59863a975254e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.341790 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a639396098a941249afd9c3560073131. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.344834 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605da10c8d3049e8b94caa9738576aab. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.345165 8844 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 88c8499633f4417e9f6d2d6372f157c4 (table default.Table_ae411cdd8f1740839d5490d643672e18 [id=b16ae3d8bb2a40eda9602301a2a2dc2e]) successfully deleted
I20251215 14:55:04.345597 8857 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: default.Table_20d2c5b358444df59324e21800508f8d [id=c421ca23de494f4ba674e4cc86bac3da] alter complete (version 1)
W20251215 14:55:04.345708 8844 catalog_manager.cc:4952] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 30c5c795ea4a4fe591cdf63320ec2521 because the tablet was not found. No further retry: Not found: Tablet not found: 30c5c795ea4a4fe591cdf63320ec2521
I20251215 14:55:04.347018 9150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 194bb745ecb849cb9092fee1afb7dbe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.347519 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3b95d32c7044bd8a4451381c19aeba. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:04.347996 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet f2aae2798eee4775afaa3afc59e98a6c
W20251215 14:55:04.348084 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bd8d964650a49b08093608abf3e31fa
I20251215 14:55:04.348177 9148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af4cf6ec825467383349098eda661c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.348279 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8af1d0b67424bec90b59863a975254e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.349048 9005 tablet_service.cc:1505] Processing CreateTablet for tablet 38e50a7f2bdd4907ab41436b59397ea6 (DEFAULT_TABLE table=default.Table_ada3150d10a34cb4aaf8a16a487fa543 [id=d12dc623fa0a4a6cbd87ee8180c4c885]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.349481 9017 tablet_service.cc:1505] Processing CreateTablet for tablet e0c88310853f47b0aa1af9a3d676bef6 (DEFAULT_TABLE table=default.Table_a469ba7678054925965fe69d826f1c16 [id=d0891c1ad38b48348b350482a3298f39]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.349844 9004 tablet_service.cc:1505] Processing CreateTablet for tablet 30c5c795ea4a4fe591cdf63320ec2521 (DEFAULT_TABLE table=default.Table_c6d082c899204c5280db8f13e837c0de [id=39d4b6289fd34b8181d025f48399ba62]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.350237 9022 tablet_service.cc:1505] Processing CreateTablet for tablet 96b2d20fd2304e7a9995206a043b7944 (DEFAULT_TABLE table=default.Table_42e5c1011ba64c0b9602eed064c8ecbd [id=4343a6c3acc545d7be8d3b7ec617da90]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.350643 9003 tablet_service.cc:1505] Processing CreateTablet for tablet f7af1f66c4f04f649379758ff1b3e387 (DEFAULT_TABLE table=default.Table_fa4a417edbd04446b7cff43ff66d683b [id=b1e213e4f94d4015916ab6935de4602a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.351065 9020 tablet_service.cc:1505] Processing CreateTablet for tablet 9bf4a899338f4bcfac099b5099a22f05 (DEFAULT_TABLE table=default.Table_ad8e8a5df4ec4b53a051977d42d10a17 [id=f87a4d1335e64e9f9234807ded6cc7d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.351461 9012 tablet_service.cc:1505] Processing CreateTablet for tablet 95caeaf32d154c0ba4c88dd3f295876d (DEFAULT_TABLE table=default.Table_e726b47802404f3aaccb61d6aaaa72a5 [id=62dd6789e50a49ca96ec0db0ef20bb44]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.351498 9013 tablet_service.cc:1505] Processing CreateTablet for tablet 26754a74483c4c9580df93aae10e7de1 (DEFAULT_TABLE table=default.Table_72f52de38f25438fbfe0a6a0f8bdc5f6 [id=cbafb4499c90447d8f185928d3e58b20]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.351886 9007 tablet_service.cc:1505] Processing CreateTablet for tablet 4c96b655cf284326ae3fa2a165e2bf95 (DEFAULT_TABLE table=default.Table_77da0b679b494783bb486ac3e8887892 [id=b7ff2d02e55b4e839049b20b89227526]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.352263 9009 tablet_service.cc:1505] Processing CreateTablet for tablet c7f760639a664cfb9f4af5578154b981 (DEFAULT_TABLE table=default.Table_bec53ce4c0c04be8bb0aabb4ce60974b [id=0ed94690124e4fd7a23a6ddf2291c6d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.352638 9015 tablet_service.cc:1505] Processing CreateTablet for tablet f121a14828e6443695960c0e540ae573 (DEFAULT_TABLE table=default.Table_f416fea67a974ab084b7b48a60426131 [id=0e3677e1f3d048ecad508d50304ee56a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.355500 9008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfead52afe8040a88ba0d826f482b1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.357125 9014 tablet_service.cc:1505] Processing CreateTablet for tablet bafc5063058a469bb9c9b3e5345eb1be (DEFAULT_TABLE table=default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d [id=066e8ae14004436cb8b4f3f740b45b19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.357471 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bafc5063058a469bb9c9b3e5345eb1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.359193 9010 tablet_service.cc:1505] Processing CreateTablet for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (DEFAULT_TABLE table=default.Table_7231bb3c534046a98fc17c3557841d6f [id=9f4bc32583124d6e956b457792323ae1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.359553 9010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.361913 9008 tablet_service.cc:1505] Processing CreateTablet for tablet 4af4cf6ec825467383349098eda661c6 (DEFAULT_TABLE table=default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e [id=6b4b04bb03f04a8a9cd7bc893acf612c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.362289 9008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4af4cf6ec825467383349098eda661c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.364059 9019 tablet_service.cc:1505] Processing CreateTablet for tablet bb3b95d32c7044bd8a4451381c19aeba (DEFAULT_TABLE table=default.Table_d884e36a60cf4a109778a5bfa32afaa8 [id=7ec65d77d89d4e40a60b716f721e2940]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.365358 9005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e50a7f2bdd4907ab41436b59397ea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.365494 9018 tablet_service.cc:1505] Processing CreateTablet for tablet 194bb745ecb849cb9092fee1afb7dbe6 (DEFAULT_TABLE table=default.Table_08e092a0a75f48e89a6d074a91911704 [id=5f8b02d3f84e490dbf2cf00772e21eff]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.365828 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 194bb745ecb849cb9092fee1afb7dbe6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.366083 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_61ca8adc55ea4c149b8ddaf2b30ef360"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:04.366523 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_497589c332ff4e16ada3e5656acb5606"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:04.366683 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61ca8adc55ea4c149b8ddaf2b30ef360 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:04.367008 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_497589c332ff4e16ada3e5656acb5606 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:04.366087 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_b84b10eece664a31b983b31c90986bda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:04.368299 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b84b10eece664a31b983b31c90986bda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:04.371480 8856 catalog_manager.cc:5487] Ignoring report from unknown tablet f2aae2798eee4775afaa3afc59e98a6c
W20251215 14:55:04.371558 8856 catalog_manager.cc:5487] Ignoring report from unknown tablet 4f1f902cbcb643b9b98fa3d72babba79
W20251215 14:55:04.371619 8856 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bd8d964650a49b08093608abf3e31fa
I20251215 14:55:04.381385 9540 raft_consensus.cc:493] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:04.387452 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3b95d32c7044bd8a4451381c19aeba. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.387732 9006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61aef86a30e842f2a90f9f1c88c84f4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.388221 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18cd1f63d51e4565bb8c55be13e3e099. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.388495 9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e80ac7bd98a46119a30bd5d2f3de2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.393203 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c96b655cf284326ae3fa2a165e2bf95. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.393071 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_d582b0f606d1487287ac187149a256c1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:04.394174 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d582b0f606d1487287ac187149a256c1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:04.396100 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4508c5a110427eb4d9d2eaaadace0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.396462 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_f4e69462c1fa42df8f9776f053474a93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:04.396996 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4e69462c1fa42df8f9776f053474a93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:04.397639 9540 raft_consensus.cc:515] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.399897 9149 tablet_service.cc:1505] Processing CreateTablet for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (DEFAULT_TABLE table=default.Table_7231bb3c534046a98fc17c3557841d6f [id=9f4bc32583124d6e956b457792323ae1]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:04.402676 9248 leader_election.cc:343] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:04.403410 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bf4a899338f4bcfac099b5099a22f05. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.403976 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_ba8f8beb36af4b6ab3fc11419c5c3531"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:04.404597 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba8f8beb36af4b6ab3fc11419c5c3531 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:04.406383 9152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d75636265f14a428aae592438064ea2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.407609 9313 raft_consensus.cc:2468] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
W20251215 14:55:04.408021 9315 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s user 0.055s sys 0.059s
W20251215 14:55:04.408138 9315 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s user 0.055s sys 0.059s
I20251215 14:55:04.407896 9294 tablet_service.cc:1505] Processing CreateTablet for tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 (DEFAULT_TABLE table=default.Table_83de3588e27e48f2a722e2104b267467 [id=ee7a9352836f4e69bde65490731eae34]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.411715 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d75636265f14a428aae592438064ea2. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:04.416059 8856 catalog_manager.cc:5487] Ignoring report from unknown tablet 4f1f902cbcb643b9b98fa3d72babba79
I20251215 14:55:04.417721 9489 leader_election.cc:290] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:04.418506 9249 leader_election.cc:343] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:04.426720 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:04.417328 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 174405us
I20251215 14:55:04.428300 9004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30c5c795ea4a4fe591cdf63320ec2521. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.428622 9146 tablet_service.cc:1505] Processing CreateTablet for tablet 5560a21e16bb43c7903c1fc66429ecdf (DEFAULT_TABLE table=default.Table_9ae28ea04dcf4d038b4467a5f0788a69 [id=5f7704a7da85406cb20243ca8c50962d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.429296 9115 leader_election.cc:304] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:04.429525 9540 leader_election.cc:290] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:04.428882 9021 tablet_service.cc:1505] Processing CreateTablet for tablet a639396098a941249afd9c3560073131 (DEFAULT_TABLE table=default.Table_f1ad091bc41747ffba1fca75bcf619b7 [id=5cc820ec2c8b427db1c89647b295363e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.430692 9426 ts_tablet_manager.cc:1434] T 9bd8d964650a49b08093608abf3e31fa P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.544s user 0.001s sys 0.002s
W20251215 14:55:04.430794 9426 ts_tablet_manager.cc:1467] T 9bd8d964650a49b08093608abf3e31fa P 3ea5306c36594ef4a62211f2bd6669a3: Tablet startup took 545ms
I20251215 14:55:04.432132 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_a1ec14c414a94c868fbbfe74faf0872e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:04.431537 9426 ts_tablet_manager.cc:1469] T 9bd8d964650a49b08093608abf3e31fa P 3ea5306c36594ef4a62211f2bd6669a3: Trace:
1215 14:55:01.927251 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:01.927296 (+ 45us) service_pool.cc:225] Handling call
1215 14:55:01.927652 (+ 356us) ts_tablet_manager.cc:669] Acquired tablet manager lock
1215 14:55:01.927670 (+ 18us) ts_tablet_manager.cc:682] Creating new metadata...
1215 14:55:01.930497 (+ 2827us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:01.961642 (+ 31145us) tablet_replica.cc:206] Creating consensus instance
1215 14:55:01.961754 (+ 112us) inbound_call.cc:173] Queueing success response
1215 14:55:03.822245 (+1860491us) ts_tablet_manager.cc:1379] Bootstrapping tablet
1215 14:55:03.885745 (+ 63500us) ts_tablet_manager.cc:1435] Starting tablet replica
1215 14:55:03.885958 (+ 213us) tablet_replica.cc:261] Starting instrumentation
1215 14:55:03.886081 (+ 123us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":5534,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"tablet-open.queue_time_us":1860501}
I20251215 14:55:04.433198 9426 tablet_bootstrap.cc:492] T f9695d47e35448fdad95ff3f24bafd03 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:04.433264 8857 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_72f52de38f25438fbfe0a6a0f8bdc5f6" } new_table_name: "default.Table_3f190fdaff1446908955f4b5957a8084" modify_external_catalogs: true
I20251215 14:55:04.433808 8856 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_ba58101b52714972a7867936bda32bf3" } modify_external_catalogs: true
I20251215 14:55:04.433951 8856 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_ba58101b52714972a7867936bda32bf3" } modify_external_catalogs: true
W20251215 14:55:04.434373 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1ec14c414a94c868fbbfe74faf0872e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:04.437979 8852 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_fa4a417edbd04446b7cff43ff66d683b" } new_table_name: "default.Table_abc6bd10434344bd8243529d30fa1c86" modify_external_catalogs: true
I20251215 14:55:04.438160 9617 leader_election.cc:290] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:04.438463 9145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f121a14828e6443695960c0e540ae573. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.439410 9156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc81eb40614463cb5017475b378eea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.440591 9147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bafc5063058a469bb9c9b3e5345eb1be. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.441488 9426 tablet_bootstrap.cc:654] T f9695d47e35448fdad95ff3f24bafd03 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:04.442273 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.442520 9146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5560a21e16bb43c7903c1fc66429ecdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.447775 9487 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 14:55:04.449769 9487 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251215 14:55:04.450397 8851 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_c61eb6855f1c4bc5b0149813fa98c2e9" } new_table_name: "default.Table_e396d28d36714ff7bcad7efeb332c4c5" modify_external_catalogs: true
I20251215 14:55:04.451500 9487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 14:55:04.448169 8859 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_7231bb3c534046a98fc17c3557841d6f" } new_table_name: "default.Table_246abe888b0b4ab7b31cde9248c92e59" modify_external_catalogs: true
I20251215 14:55:04.457222 9609 raft_consensus.cc:515] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:04.462007 9290 tablet_service.cc:1505] Processing CreateTablet for tablet 77780f8cfe544db7baee2c761fe52ca2 (DEFAULT_TABLE table=default.Table_c042437915b141518837aa551d8500d0 [id=f2428abb656749d0907096c2df05ef64]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.453369 8853 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_07084f618f754b739e18f98bf0a3b7b8" } new_table_name: "default.Table_bf76d4a7a65242d5b022304a0722e09a" modify_external_catalogs: true
I20251215 14:55:04.454428 8855 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_802c7f03a650477cb59c4e574f25e862"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:04.465996 8855 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_802c7f03a650477cb59c4e574f25e862 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:04.455668 8854 master_service.cc:954] ReplaceTablet: received request to replace tablet fab39532fe6a403683952057c5ccabd9 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:04.456601 8858 master_service.cc:954] ReplaceTablet: received request to replace tablet 88c8499633f4417e9f6d2d6372f157c4 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:04.464238 8850 master_service.cc:954] ReplaceTablet: received request to replace tablet 15a974e3265a4c88aa6d5005ffa04dc8 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:04.464344 8856 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 16309efc14e747d09ce6e5de4f3c2784
W20251215 14:55:04.464661 8852 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f7af1f66c4f04f649379758ff1b3e387 consensus state has no leader
I20251215 14:55:04.470958 9003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7af1f66c4f04f649379758ff1b3e387. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:04.471572 8976 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:04.478440 9507 raft_consensus.cc:2804] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:04.478621 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44bd51f9bf77492b8890fc7c8411c887" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:04.479545 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26754a74483c4c9580df93aae10e7de1. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:04.478878 9115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 66087.5us
I20251215 14:55:04.481446 9507 raft_consensus.cc:493] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:04.481593 9507 raft_consensus.cc:3060] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:04.481755 9427 tablet_bootstrap.cc:492] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:04.484057 9012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95caeaf32d154c0ba4c88dd3f295876d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.483819 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "11a5a6a0895c49648c910fa2ea3ca373" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:04.485725 8976 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:04.486377 9427 ts_tablet_manager.cc:1403] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.633s user 0.027s sys 0.036s
I20251215 14:55:04.489457 9021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a639396098a941249afd9c3560073131. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:04.489598 9112 leader_election.cc:343] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:04.490363 9626 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:04.491532 9427 raft_consensus.cc:359] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.487639 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "80d4c9b533ac4facb4205aff84903134" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:04.492790 9427 raft_consensus.cc:385] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:04.492846 9009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7f760639a664cfb9f4af5578154b981. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.492898 9427 raft_consensus.cc:740] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:04.489264 9042 raft_consensus.cc:3060] T 11a5a6a0895c49648c910fa2ea3ca373 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:04.493728 9427 consensus_queue.cc:260] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.495096 9431 ts_tablet_manager.cc:1929] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251215 14:55:04.459719 9249 leader_election.cc:304] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:04.497219 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2df2138e41844e9f897e57264b62cc9d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:04.502022 9287 tablet_service.cc:1505] Processing CreateTablet for tablet 90c0254840b442a3817171b06f2726c8 (DEFAULT_TABLE table=default.Table_ae411cdd8f1740839d5490d643672e18 [id=b16ae3d8bb2a40eda9602301a2a2dc2e]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:04.503842 8857 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 26754a74483c4c9580df93aae10e7de1 consensus state has no leader
I20251215 14:55:04.508308 9609 leader_election.cc:290] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:04.508476 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77780f8cfe544db7baee2c761fe52ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.506908 9427 ts_tablet_manager.cc:1434] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20251215 14:55:04.508140 9040 raft_consensus.cc:3060] T 80d4c9b533ac4facb4205aff84903134 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:04.513919 8976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 93991.1us
I20251215 14:55:04.514607 9314 raft_consensus.cc:3060] T 2df2138e41844e9f897e57264b62cc9d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:04.515839 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 5bfe8cc0805247de9df4a59d461818f3 (DEFAULT_TABLE table=default.Table_7fbfc1dd536247d4b9f3472efe93ca60 [id=7413713b56f2433fa892caa112c9317a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.521061 9431 log.cc:1199] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/88c8499633f4417e9f6d2d6372f157c4
I20251215 14:55:04.521829 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f121a14828e6443695960c0e540ae573. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.522711 9427 tablet_bootstrap.cc:492] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:04.523130 9431 ts_tablet_manager.cc:1950] T 88c8499633f4417e9f6d2d6372f157c4 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
W20251215 14:55:04.523415 9115 leader_election.cc:343] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373
I20251215 14:55:04.524641 9018 tablet_service.cc:1505] Processing CreateTablet for tablet 5dc81eb40614463cb5017475b378eea6 (DEFAULT_TABLE table=default.Table_8545c01c50ce45489e3e219e52e98acd [id=94ddd629cb1e4f5eb0061100187f4202]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.526402 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96b2d20fd2304e7a9995206a043b7944. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.527705 9431 tablet_replica.cc:333] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:04.527943 9431 raft_consensus.cc:2243] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:04.528775 9431 raft_consensus.cc:2272] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:04.529326 9431 ts_tablet_manager.cc:1916] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251215 14:55:04.531916 9293 consensus_meta.cc:287] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4: Time spent flushing consensus metadata: real 0.547s user 0.003s sys 0.000s
I20251215 14:55:04.534544 9017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0c88310853f47b0aa1af9a3d676bef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.536248 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc81eb40614463cb5017475b378eea6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.537753 9287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c0254840b442a3817171b06f2726c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.538071 9489 raft_consensus.cc:2749] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:04.538411 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44bd51f9bf77492b8890fc7c8411c887" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:04.538586 9312 raft_consensus.cc:2468] T 44bd51f9bf77492b8890fc7c8411c887 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:04.540812 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 (DEFAULT_TABLE table=default.Table_0c66ce7473b248f58f74dd76a8c48045 [id=f735b0a748bf4b35bd47e7b1431994b1]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:04.541728 9249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 159366us
I20251215 14:55:04.542421 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bdfc164128a6413a83d83d05b69fb74a" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:04.544569 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "80d4c9b533ac4facb4205aff84903134" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:04.544770 9178 raft_consensus.cc:3060] T 80d4c9b533ac4facb4205aff84903134 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:04.548784 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bfe8cc0805247de9df4a59d461818f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.551363 9008 tablet_service.cc:1505] Processing CreateTablet for tablet 2d75636265f14a428aae592438064ea2 (DEFAULT_TABLE table=default.Table_da5c57895b1547848d875ca7761f7943 [id=4094651ce99d4c47bc0fbfeb5ba33b04]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.551807 9008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d75636265f14a428aae592438064ea2. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:04.552668 9292 consensus_meta.cc:287] T e2104a3530264fa982b20aed20afb0b4 P e89303a500544272b601d7c29be802b4: Time spent flushing consensus metadata: real 0.594s user 0.007s sys 0.000s
I20251215 14:55:04.550525 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 5560a21e16bb43c7903c1fc66429ecdf (DEFAULT_TABLE table=default.Table_9ae28ea04dcf4d038b4467a5f0788a69 [id=5f7704a7da85406cb20243ca8c50962d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.553401 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5560a21e16bb43c7903c1fc66429ecdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.559113 9040 raft_consensus.cc:2468] T 80d4c9b533ac4facb4205aff84903134 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:04.538272 9612 consensus_queue.cc:1048] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
I20251215 14:55:04.560251 9005 tablet_service.cc:1505] Processing CreateTablet for tablet ff4508c5a110427eb4d9d2eaaadace0b (DEFAULT_TABLE table=default.Table_1ea29a2534e24318a5604a9a1c93fbe0 [id=cfc66f0ad54746d78dd5ad5a6054f3f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.561534 9248 leader_election.cc:304] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:04.563185 9489 raft_consensus.cc:2804] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:04.565659 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.566766 9489 raft_consensus.cc:697] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:04.567221 9489 consensus_queue.cc:237] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:04.571381 9292 tablet_service.cc:1552] Processing DeleteTablet for tablet 188eb879e7c3479ea71c5b1864400243 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:04 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:04.571998 9292 tablet_service.cc:1552] Processing DeleteTablet for tablet 16309efc14e747d09ce6e5de4f3c2784 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:04 UTC) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:04.572847 9249 leader_election.cc:343] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:04.574069 9005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4508c5a110427eb4d9d2eaaadace0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.583557 9007 tablet_service.cc:1505] Processing CreateTablet for tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 (DEFAULT_TABLE table=default.Table_83de3588e27e48f2a722e2104b267467 [id=ee7a9352836f4e69bde65490731eae34]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.584090 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.586959 9042 raft_consensus.cc:2468] T 11a5a6a0895c49648c910fa2ea3ca373 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:04.590221 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 88c8499633f4417e9f6d2d6372f157c4 (table default.Table_ae411cdd8f1740839d5490d643672e18 [id=b16ae3d8bb2a40eda9602301a2a2dc2e]) successfully deleted
I20251215 14:55:04.572321 9016 tablet_service.cc:1505] Processing CreateTablet for tablet fda9eb99ccef4c16a0a947510566ecf4 (DEFAULT_TABLE table=default.Table_862e5241fcc042d8bf376e55c3c86fa0 [id=c1c5f6c604c24855a17e2dfb4174965b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.593791 9249 leader_election.cc:304] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
W20251215 14:55:04.595232 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 188eb879e7c3479ea71c5b1864400243 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 188eb879e7c3479ea71c5b1864400243 already in progress: creating tablet
I20251215 14:55:04.599476 9609 raft_consensus.cc:2749] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:04.600492 9612 consensus_queue.cc:1048] T 018bd6ac8a534a6abc461b57b89b93eb P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20251215 14:55:04.605657 9427 tablet_bootstrap.cc:654] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:04.631474 9012 tablet_service.cc:1505] Processing CreateTablet for tablet 90c0254840b442a3817171b06f2726c8 (DEFAULT_TABLE table=default.Table_ae411cdd8f1740839d5490d643672e18 [id=b16ae3d8bb2a40eda9602301a2a2dc2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.634564 9314 raft_consensus.cc:2468] T 2df2138e41844e9f897e57264b62cc9d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
W20251215 14:55:04.528470 9115 leader_election.cc:343] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373
W20251215 14:55:04.661708 9115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 137112us
I20251215 14:55:04.662128 9115 leader_election.cc:304] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:04.663354 9615 raft_consensus.cc:2804] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:04.664542 9615 raft_consensus.cc:493] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:04.667318 9615 raft_consensus.cc:3060] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:04.668524 9112 leader_election.cc:304] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters: e89303a500544272b601d7c29be802b4
W20251215 14:55:04.668934 9112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 81459.8us
I20251215 14:55:04.671829 9540 consensus_queue.cc:1048] T 4f1f902cbcb643b9b98fa3d72babba79 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20251215 14:55:04.673190 9115 leader_election.cc:304] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:04.673516 9440 raft_consensus.cc:2804] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:04.673732 9540 raft_consensus.cc:2804] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:04.673879 9540 raft_consensus.cc:697] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:04.674208 9540 consensus_queue.cc:237] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.675658 9440 raft_consensus.cc:697] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:04.675951 9440 consensus_queue.cc:237] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.680219 9144 tablet_service.cc:1505] Processing CreateTablet for tablet ff4508c5a110427eb4d9d2eaaadace0b (DEFAULT_TABLE table=default.Table_1ea29a2534e24318a5604a9a1c93fbe0 [id=cfc66f0ad54746d78dd5ad5a6054f3f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.680943 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff4508c5a110427eb4d9d2eaaadace0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.689162 9507 raft_consensus.cc:515] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:04.694563 9145 tablet_service.cc:1505] Processing CreateTablet for tablet fda9eb99ccef4c16a0a947510566ecf4 (DEFAULT_TABLE table=default.Table_862e5241fcc042d8bf376e55c3c86fa0 [id=c1c5f6c604c24855a17e2dfb4174965b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.695087 9145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fda9eb99ccef4c16a0a947510566ecf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.703253 9507 leader_election.cc:290] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:04.706403 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fda9eb99ccef4c16a0a947510566ecf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.708626 9009 tablet_service.cc:1505] Processing CreateTablet for tablet 77780f8cfe544db7baee2c761fe52ca2 (DEFAULT_TABLE table=default.Table_c042437915b141518837aa551d8500d0 [id=f2428abb656749d0907096c2df05ef64]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.709129 9009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77780f8cfe544db7baee2c761fe52ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.710503 9010 tablet_service.cc:1505] Processing CreateTablet for tablet 5bfe8cc0805247de9df4a59d461818f3 (DEFAULT_TABLE table=default.Table_7fbfc1dd536247d4b9f3472efe93ca60 [id=7413713b56f2433fa892caa112c9317a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.710592 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 (DEFAULT_TABLE table=default.Table_83de3588e27e48f2a722e2104b267467 [id=ee7a9352836f4e69bde65490731eae34]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.711004 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.711023 9010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bfe8cc0805247de9df4a59d461818f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.713299 9154 tablet_service.cc:1505] Processing CreateTablet for tablet 77780f8cfe544db7baee2c761fe52ca2 (DEFAULT_TABLE table=default.Table_c042437915b141518837aa551d8500d0 [id=f2428abb656749d0907096c2df05ef64]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.713848 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77780f8cfe544db7baee2c761fe52ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.714071 9011 tablet_service.cc:1505] Processing CreateTablet for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 (DEFAULT_TABLE table=default.Table_0c66ce7473b248f58f74dd76a8c48045 [id=f735b0a748bf4b35bd47e7b1431994b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.715783 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "924c9dd0cd9d40189bfe1457040f3d37" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:04.716552 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet 188eb879e7c3479ea71c5b1864400243 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:04 UTC) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:04.716665 9112 leader_election.cc:343] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:04.718953 9012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c0254840b442a3817171b06f2726c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.719923 9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.718714 9014 tablet_service.cc:1505] Processing CreateTablet for tablet 605da10c8d3049e8b94caa9738576aab (DEFAULT_TABLE table=default.Table_9fff09bdf4114198810006599bcf1f3d [id=1a10676eee8b47098cf45bee49e3f502]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.727347 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 605da10c8d3049e8b94caa9738576aab. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:04.729436 8843 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 138925us
I20251215 14:55:04.730263 9426 tablet_bootstrap.cc:492] T f9695d47e35448fdad95ff3f24bafd03 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:04.731137 9426 ts_tablet_manager.cc:1403] T f9695d47e35448fdad95ff3f24bafd03 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.298s user 0.078s sys 0.088s
W20251215 14:55:04.731184 8843 consensus_peers.cc:597] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e -> Peer cad1fca07ac7419cb608c21541f672f3 (127.8.121.190:44279): Couldn't send request to peer cad1fca07ac7419cb608c21541f672f3. Status: Network error: Client connection negotiation failed: client connection to 127.8.121.190:44279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 14:55:04.732409 8846 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 136907us
I20251215 14:55:04.732672 9426 raft_consensus.cc:359] T f9695d47e35448fdad95ff3f24bafd03 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.732905 9426 raft_consensus.cc:385] T f9695d47e35448fdad95ff3f24bafd03 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:04.732999 9426 raft_consensus.cc:740] T f9695d47e35448fdad95ff3f24bafd03 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
W20251215 14:55:04.733057 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 16309efc14e747d09ce6e5de4f3c2784 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16309efc14e747d09ce6e5de4f3c2784 already in progress: creating tablet
I20251215 14:55:04.733999 9426 consensus_queue.cc:260] T f9695d47e35448fdad95ff3f24bafd03 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.734566 9426 ts_tablet_manager.cc:1434] T f9695d47e35448fdad95ff3f24bafd03 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20251215 14:55:04.737259 9178 raft_consensus.cc:2468] T 80d4c9b533ac4facb4205aff84903134 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:04.743907 9015 tablet_service.cc:1552] Processing DeleteTablet for tablet 16309efc14e747d09ce6e5de4f3c2784 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:04 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:04.744415 9427 tablet_bootstrap.cc:492] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:04.744571 9427 ts_tablet_manager.cc:1403] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.232s user 0.001s sys 0.009s
I20251215 14:55:04.745422 9427 raft_consensus.cc:359] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.745625 9427 raft_consensus.cc:385] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:04.745707 9427 raft_consensus.cc:740] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:04.745975 9427 consensus_queue.cc:260] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:04.748085 8856 catalog_manager.cc:5487] Ignoring report from unknown tablet 26648bf286c94b2495e565969f945858
W20251215 14:55:04.748298 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bd8d964650a49b08093608abf3e31fa
I20251215 14:55:04.748492 8856 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 429c0b2d7cb2428c8de6b02acde36044 (table default.Table_20d2c5b358444df59324e21800508f8d [id=c421ca23de494f4ba674e4cc86bac3da]). Expected version 1 got 0
W20251215 14:55:04.754956 8853 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 18cd1f63d51e4565bb8c55be13e3e099 consensus state has no leader
I20251215 14:55:04.757880 9617 consensus_queue.cc:1048] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:04.764458 9622 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:54874 (request call id 125) took 1096 ms. Trace:
I20251215 14:55:04.764621 9622 rpcz_store.cc:276] 1215 14:55:03.668147 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:03.668221 (+ 74us) service_pool.cc:225] Handling call
1215 14:55:04.764413 (+1096192us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:03.788896 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
1215 14:55:03.789036 (+ 140us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
1215 14:55:03.789044 (+ 8us) alter_schema_op.cc:66] Acquired schema lock
1215 14:55:03.789051 (+ 7us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
1215 14:55:03.789111 (+ 60us) alter_schema_op.cc:128] START. Timestamp: 1765810503789044
1215 14:55:03.789117 (+ 6us) op_driver.cc:348] REPLICATION: starting
1215 14:55:03.789418 (+ 301us) log.cc:844] Serialized 173 byte log entry
1215 14:55:03.888540 (+ 99122us) op_driver.cc:464] REPLICATION: finished
1215 14:55:04.296082 (+407542us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
1215 14:55:04.327497 (+ 31415us) log.cc:844] Serialized 5 byte log entry
1215 14:55:04.763478 (+435981us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:04.764028 (+ 550us) log.cc:844] Serialized 14 byte log entry
1215 14:55:04.764291 (+ 263us) alter_schema_op.cc:73] Released schema lock
1215 14:55:04.764296 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":407466,"prepare.queue_time_us":118988,"prepare.run_cpu_time_us":712,"prepare.run_wall_time_us":45518,"raft.queue_time_us":632,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":486,"replication_time_us":99390,"thread_start_us":569185,"threads_started":2}]]}
I20251215 14:55:04.773520 9431 ts_tablet_manager.cc:1929] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:04.773789 9431 log.cc:1199] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:04.778694 9615 raft_consensus.cc:515] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.779481 9615 leader_election.cc:290] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:04.782850 9039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44bd51f9bf77492b8890fc7c8411c887" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
W20251215 14:55:04.784839 9112 leader_election.cc:343] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:04.785056 9615 consensus_queue.cc:1048] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:04.788508 8851 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f080b56cff244a46bfb73d05d3127f31 consensus state has no leader
I20251215 14:55:04.789047 9431 ts_tablet_manager.cc:1950] T c4f47c22111c427a8ab9c4ae1e105375 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:04.806557 9151 tablet_service.cc:1505] Processing CreateTablet for tablet 5bfe8cc0805247de9df4a59d461818f3 (DEFAULT_TABLE table=default.Table_7fbfc1dd536247d4b9f3472efe93ca60 [id=7413713b56f2433fa892caa112c9317a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.807154 9151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bfe8cc0805247de9df4a59d461818f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.811924 9145 tablet_service.cc:1505] Processing CreateTablet for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 (DEFAULT_TABLE table=default.Table_0c66ce7473b248f58f74dd76a8c48045 [id=f735b0a748bf4b35bd47e7b1431994b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.812492 9145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:04.812891 9427 ts_tablet_manager.cc:1434] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.054s user 0.001s sys 0.001s
I20251215 14:55:04.817497 9150 tablet_service.cc:1505] Processing CreateTablet for tablet 90c0254840b442a3817171b06f2726c8 (DEFAULT_TABLE table=default.Table_ae411cdd8f1740839d5490d643672e18 [id=b16ae3d8bb2a40eda9602301a2a2dc2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:04.819401 9150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c0254840b442a3817171b06f2726c8. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:04.831399 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet f9695d47e35448fdad95ff3f24bafd03
I20251215 14:55:04.837754 9158 tablet_service.cc:1552] Processing DeleteTablet for tablet 16309efc14e747d09ce6e5de4f3c2784 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:04 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:04.837863 9440 consensus_queue.cc:1048] T 4816503e4fa1459dbb311997be85f64a P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20251215 14:55:04.845410 9155 tablet_service.cc:1552] Processing DeleteTablet for tablet 188eb879e7c3479ea71c5b1864400243 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:04 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:04.849722 9426 tablet_bootstrap.cc:492] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:04.851017 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 16309efc14e747d09ce6e5de4f3c2784 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16309efc14e747d09ce6e5de4f3c2784 already in progress: creating tablet
W20251215 14:55:04.851744 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 188eb879e7c3479ea71c5b1864400243 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 188eb879e7c3479ea71c5b1864400243 already in progress: creating tablet
I20251215 14:55:04.853518 9612 consensus_queue.cc:1048] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20251215 14:55:04.858350 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "924c9dd0cd9d40189bfe1457040f3d37" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:04.864959 9435 tablet_bootstrap.cc:492] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:04.871852 9312 raft_consensus.cc:3060] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:04.872745 9435 ts_tablet_manager.cc:1403] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 1.009s user 0.027s sys 0.074s
I20251215 14:55:04.873184 9426 tablet_bootstrap.cc:654] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:04.876426 8859 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 consensus state has no leader
I20251215 14:55:04.855706 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44bd51f9bf77492b8890fc7c8411c887" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:04.884727 9312 raft_consensus.cc:2468] T 924c9dd0cd9d40189bfe1457040f3d37 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:04.885681 9115 leader_election.cc:304] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:04.889349 8857 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_da5c57895b1547848d875ca7761f7943" } modify_external_catalogs: true
I20251215 14:55:04.889511 8855 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_cd8c7355c25f412eb97abafa172e6f6c" } modify_external_catalogs: true
I20251215 14:55:04.889588 8857 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_da5c57895b1547848d875ca7761f7943" } modify_external_catalogs: true
I20251215 14:55:04.889469 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_152b267c68cb4172a6257b9978784879"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:04.889699 8852 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_e06edd0b78e6468ebf09728e684489da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:04.889910 8858 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_d88499634e6e47fd84ec1fdb6d93c314"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:04.890210 8852 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e06edd0b78e6468ebf09728e684489da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:04.890208 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_152b267c68cb4172a6257b9978784879 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:04.890497 8853 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_08e092a0a75f48e89a6d074a91911704" } modify_external_catalogs: true
I20251215 14:55:04.890661 8853 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_08e092a0a75f48e89a6d074a91911704" } modify_external_catalogs: true
I20251215 14:55:04.890976 8851 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_ece44e44ff964192893318b9b02f5b95" } modify_external_catalogs: true
I20251215 14:55:04.891134 8851 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_ece44e44ff964192893318b9b02f5b95" } modify_external_catalogs: true
I20251215 14:55:04.889463 8856 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_a1daf812c33d4105b1fe9ebca98fff4c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:04.889703 8855 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_cd8c7355c25f412eb97abafa172e6f6c" } modify_external_catalogs: true
W20251215 14:55:04.891835 8856 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1daf812c33d4105b1fe9ebca98fff4c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:04.890273 8858 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d88499634e6e47fd84ec1fdb6d93c314 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:04.892382 9311 raft_consensus.cc:3060] T 44bd51f9bf77492b8890fc7c8411c887 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:04.896595 9427 tablet_bootstrap.cc:492] T 44bd51f9bf77492b8890fc7c8411c887 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:04.898566 9507 raft_consensus.cc:2804] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:04.900750 9507 raft_consensus.cc:697] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:04.907948 9435 raft_consensus.cc:359] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:04.908466 9279 consensus_meta.cc:287] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4: Time spent flushing consensus metadata: real 0.711s user 0.004s sys 0.000s
I20251215 14:55:04.908947 9427 tablet_bootstrap.cc:654] T 44bd51f9bf77492b8890fc7c8411c887 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:04.909137 9435 raft_consensus.cc:385] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:04.909240 9435 raft_consensus.cc:740] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:04.910550 9507 consensus_queue.cc:237] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:04.910661 9435 consensus_queue.cc:260] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.931891 8843 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet c4f47c22111c427a8ab9c4ae1e105375 (table default.Table_23c657126ccf46fabe10f93f2e991891 [id=b76c4f587a0d4acc8e7d2a27dae1fc7a]) successfully deleted
W20251215 14:55:04.932310 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 30c5c795ea4a4fe591cdf63320ec2521 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 30c5c795ea4a4fe591cdf63320ec2521 already in progress: creating tablet
W20251215 14:55:04.932523 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 188eb879e7c3479ea71c5b1864400243 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 188eb879e7c3479ea71c5b1864400243 already in progress: creating tablet
W20251215 14:55:04.932837 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 16309efc14e747d09ce6e5de4f3c2784 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 16309efc14e747d09ce6e5de4f3c2784 already in progress: creating tablet
I20251215 14:55:04.941848 9427 tablet_bootstrap.cc:492] T 44bd51f9bf77492b8890fc7c8411c887 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:04.942032 9427 ts_tablet_manager.cc:1403] T 44bd51f9bf77492b8890fc7c8411c887 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.054s user 0.004s sys 0.000s
I20251215 14:55:04.945062 9617 consensus_queue.cc:1048] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20251215 14:55:04.951743 8850 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 15a974e3265a4c88aa6d5005ffa04dc8
I20251215 14:55:04.952322 8850 catalog_manager.cc:6724] ReplaceTablet: tablet 15a974e3265a4c88aa6d5005ffa04dc8 deleted and replaced by tablet 034fec793ae74fcda0c73f1cea291311
W20251215 14:55:04.958287 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet 4a6846144c8c409cad340e99374a38c6
W20251215 14:55:04.958420 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet 4816503e4fa1459dbb311997be85f64a
W20251215 14:55:04.958483 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet 018bd6ac8a534a6abc461b57b89b93eb
W20251215 14:55:04.958521 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet bdfc164128a6413a83d83d05b69fb74a
W20251215 14:55:04.958570 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet f9695d47e35448fdad95ff3f24bafd03
W20251215 14:55:04.959919 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet f9695d47e35448fdad95ff3f24bafd03
W20251215 14:55:04.960031 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet 4f1f902cbcb643b9b98fa3d72babba79
W20251215 14:55:04.960074 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet 018bd6ac8a534a6abc461b57b89b93eb
W20251215 14:55:04.960191 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet 2df2138e41844e9f897e57264b62cc9d
W20251215 14:55:04.960239 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet 11a5a6a0895c49648c910fa2ea3ca373
I20251215 14:55:04.961561 9014 tablet_service.cc:1552] Processing DeleteTablet for tablet 15a974e3265a4c88aa6d5005ffa04dc8 with delete_type TABLET_DATA_DELETED (replaced by tablet 034fec793ae74fcda0c73f1cea291311) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:04.962846 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_8f94c89c96d2444e82c9681f3a6ef372"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:04.963644 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f94c89c96d2444e82c9681f3a6ef372 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:04.967217 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 15a974e3265a4c88aa6d5005ffa04dc8 with delete_type TABLET_DATA_DELETED (replaced by tablet 034fec793ae74fcda0c73f1cea291311) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:04.967355 9672 consensus_queue.cc:1048] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:04.968089 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 15a974e3265a4c88aa6d5005ffa04dc8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15a974e3265a4c88aa6d5005ffa04dc8 already in progress: creating tablet
I20251215 14:55:04.973402 9435 ts_tablet_manager.cc:1434] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.078s user 0.001s sys 0.001s
I20251215 14:55:04.974682 9435 tablet_bootstrap.cc:492] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:04.976461 9435 tablet_bootstrap.cc:654] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:04.988114 9489 raft_consensus.cc:493] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:04.988425 9489 raft_consensus.cc:515] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:04.995069 8854 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet fab39532fe6a403683952057c5ccabd9
I20251215 14:55:04.995639 8854 catalog_manager.cc:6724] ReplaceTablet: tablet fab39532fe6a403683952057c5ccabd9 deleted and replaced by tablet 5dd36ea0aa53460f9c1fda4b31063fa7
W20251215 14:55:04.996524 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet 4a6846144c8c409cad340e99374a38c6
W20251215 14:55:04.996632 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet 924c9dd0cd9d40189bfe1457040f3d37
W20251215 14:55:04.996682 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet c0d0022e48f04b83ac1c998a83fe3f55
W20251215 14:55:04.996737 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet 4816503e4fa1459dbb311997be85f64a
W20251215 14:55:04.996778 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet f9695d47e35448fdad95ff3f24bafd03
W20251215 14:55:04.996831 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet 26648bf286c94b2495e565969f945858
W20251215 14:55:04.998291 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet cb2f4fc179744458bc7db2f6c7197ec5
W20251215 14:55:04.998389 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet 4a6846144c8c409cad340e99374a38c6
W20251215 14:55:04.998487 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet f2aae2798eee4775afaa3afc59e98a6c
I20251215 14:55:05.000764 8857 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 2d75636265f14a428aae592438064ea2
W20251215 14:55:05.002146 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet 80d4c9b533ac4facb4205aff84903134
W20251215 14:55:05.002223 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
W20251215 14:55:05.002290 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet e6aad8bed15a416a925ae8c8870d4e51
W20251215 14:55:05.002342 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet c0d0022e48f04b83ac1c998a83fe3f55
W20251215 14:55:05.002408 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet f2aae2798eee4775afaa3afc59e98a6c
W20251215 14:55:05.002454 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet 26648bf286c94b2495e565969f945858
I20251215 14:55:05.002425 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92e21a77ad074572a57b836743903a0b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:05.004130 9151 tablet_service.cc:1552] Processing DeleteTablet for tablet 2d75636265f14a428aae592438064ea2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:04 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:05.004145 8854 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_a1f54fa8891f477eac38ebab96c6df39"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:05.004742 8854 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a1f54fa8891f477eac38ebab96c6df39 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:05.005168 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 2d75636265f14a428aae592438064ea2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d75636265f14a428aae592438064ea2 already in progress: creating tablet
I20251215 14:55:05.005633 9311 raft_consensus.cc:2468] T 44bd51f9bf77492b8890fc7c8411c887 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:05.006757 9150 tablet_service.cc:1552] Processing DeleteTablet for tablet fab39532fe6a403683952057c5ccabd9 with delete_type TABLET_DATA_DELETED (replaced by tablet 5dd36ea0aa53460f9c1fda4b31063fa7) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:05.003000 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_548eacdf412e49fa9b698d79892c65dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:05.007650 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet fab39532fe6a403683952057c5ccabd9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fab39532fe6a403683952057c5ccabd9 already in progress: creating tablet
W20251215 14:55:05.007779 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_548eacdf412e49fa9b698d79892c65dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:05.008051 9248 leader_election.cc:343] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:05.008687 9626 consensus_queue.cc:1048] T 9bd8d964650a49b08093608abf3e31fa P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:05.010144 9489 leader_election.cc:290] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:05.015889 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bd8d964650a49b08093608abf3e31fa
W20251215 14:55:05.016008 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet cb2f4fc179744458bc7db2f6c7197ec5
I20251215 14:55:05.016408 9426 tablet_bootstrap.cc:492] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:05.016548 9426 ts_tablet_manager.cc:1403] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.195s user 0.019s sys 0.008s
W20251215 14:55:05.017208 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet cb2f4fc179744458bc7db2f6c7197ec5
W20251215 14:55:05.017297 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bd8d964650a49b08093608abf3e31fa
I20251215 14:55:05.017352 9426 raft_consensus.cc:359] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.017531 9426 raft_consensus.cc:385] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.017614 9426 raft_consensus.cc:740] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.017843 9426 consensus_queue.cc:260] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.017830 8852 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_eecf0f0bdeea4f46bede829df928cd8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:05.018309 9426 ts_tablet_manager.cc:1434] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:05.018621 9426 tablet_bootstrap.cc:492] T bdfc164128a6413a83d83d05b69fb74a P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:05.021796 9427 raft_consensus.cc:359] T 44bd51f9bf77492b8890fc7c8411c887 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.022028 9427 raft_consensus.cc:385] T 44bd51f9bf77492b8890fc7c8411c887 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.022084 9427 raft_consensus.cc:740] T 44bd51f9bf77492b8890fc7c8411c887 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.022286 9427 consensus_queue.cc:260] T 44bd51f9bf77492b8890fc7c8411c887 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.022884 9427 ts_tablet_manager.cc:1434] T 44bd51f9bf77492b8890fc7c8411c887 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.081s user 0.001s sys 0.001s
I20251215 14:55:05.023197 9427 tablet_bootstrap.cc:492] T 924c9dd0cd9d40189bfe1457040f3d37 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:05.024919 9427 tablet_bootstrap.cc:654] T 924c9dd0cd9d40189bfe1457040f3d37 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:05.025677 8852 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eecf0f0bdeea4f46bede829df928cd8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:05.033545 8855 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 5f03dfdd546c492185c6c31866a090a5
I20251215 14:55:05.035770 9150 tablet_service.cc:1552] Processing DeleteTablet for tablet 5f03dfdd546c492185c6c31866a090a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:04 UTC) from {username='slave'} at 127.0.0.1:54874
W20251215 14:55:05.036554 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 5f03dfdd546c492185c6c31866a090a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f03dfdd546c492185c6c31866a090a5 already in progress: creating tablet
W20251215 14:55:05.044188 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 15a974e3265a4c88aa6d5005ffa04dc8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15a974e3265a4c88aa6d5005ffa04dc8 already in progress: creating tablet
I20251215 14:55:05.046568 9014 tablet_service.cc:1552] Processing DeleteTablet for tablet fab39532fe6a403683952057c5ccabd9 with delete_type TABLET_DATA_DELETED (replaced by tablet 5dd36ea0aa53460f9c1fda4b31063fa7) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:05.046682 9012 tablet_service.cc:1552] Processing DeleteTablet for tablet 2d75636265f14a428aae592438064ea2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:04 UTC) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:05.047701 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet 44bd51f9bf77492b8890fc7c8411c887
W20251215 14:55:05.047832 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:05.048378 8855 master_service.cc:954] ReplaceTablet: received request to replace tablet f32a6e8df31d482fa9b9686e002d81ff from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:05.050817 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_4137cdbc5dba456588ab4ce7aa1382a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:05.051506 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4137cdbc5dba456588ab4ce7aa1382a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:05.051601 9649 log.cc:927] Time spent T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4: Append to log took a long time: real 0.052s user 0.000s sys 0.000s
I20251215 14:55:05.053314 8853 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 194bb745ecb849cb9092fee1afb7dbe6
I20251215 14:55:05.053431 8856 master_service.cc:954] ReplaceTablet: received request to replace tablet 44bd51f9bf77492b8890fc7c8411c887 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:05.054291 8851 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 034fec793ae74fcda0c73f1cea291311
I20251215 14:55:05.065280 9115 leader_election.cc:304] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:05.066309 9615 raft_consensus.cc:2804] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:05.066512 9615 raft_consensus.cc:697] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:05.068940 9507 consensus_queue.cc:1048] T 4a6846144c8c409cad340e99374a38c6 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20251215 14:55:05.069716 9150 tablet_service.cc:1552] Processing DeleteTablet for tablet 194bb745ecb849cb9092fee1afb7dbe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:04 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:05.070950 9662 mvcc.cc:204] Tried to move back new op lower bound from 7232759823519924224 to 7232759822241992704. Current Snapshot: MvccSnapshot[applied={T|T < 7232759823519924224}]
I20251215 14:55:05.078578 8853 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_28c03048db094b5093cd88eb3dc6f7fe" } modify_external_catalogs: true
I20251215 14:55:05.078819 8853 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_28c03048db094b5093cd88eb3dc6f7fe" } modify_external_catalogs: true
I20251215 14:55:05.069557 9615 consensus_queue.cc:237] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.079286 8851 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_8545c01c50ce45489e3e219e52e98acd" } new_table_name: "default.Table_76a8f78ec8a74aadaf69142df6990dc8" modify_external_catalogs: true
I20251215 14:55:05.079514 8858 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_9ae28ea04dcf4d038b4467a5f0788a69" } new_table_name: "default.Table_20d3d5a89e4a447ebcd9f4062e6b477b" modify_external_catalogs: true
W20251215 14:55:05.080721 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 194bb745ecb849cb9092fee1afb7dbe6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 194bb745ecb849cb9092fee1afb7dbe6 already in progress: creating tablet
I20251215 14:55:05.080785 9009 tablet_service.cc:1552] Processing DeleteTablet for tablet 5f03dfdd546c492185c6c31866a090a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:04 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:05.081284 8856 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_a1daf812c33d4105b1fe9ebca98fff4c" } new_table_name: "default.Table_f26de8048da94ed5b0c969a20720fa76" modify_external_catalogs: true
I20251215 14:55:05.081529 8855 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_e396d28d36714ff7bcad7efeb332c4c5" } new_table_name: "default.Table_371fb0a76bea4b17b74b0eb7dc573f00" modify_external_catalogs: true
I20251215 14:55:05.083834 9009 tablet_service.cc:1552] Processing DeleteTablet for tablet 194bb745ecb849cb9092fee1afb7dbe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:04 UTC) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:05.086719 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet fab39532fe6a403683952057c5ccabd9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fab39532fe6a403683952057c5ccabd9 already in progress: creating tablet
W20251215 14:55:05.087323 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 2d75636265f14a428aae592438064ea2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d75636265f14a428aae592438064ea2 already in progress: creating tablet
W20251215 14:55:05.087927 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 5f03dfdd546c492185c6c31866a090a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f03dfdd546c492185c6c31866a090a5 already in progress: creating tablet
W20251215 14:55:05.088276 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 194bb745ecb849cb9092fee1afb7dbe6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 194bb745ecb849cb9092fee1afb7dbe6 already in progress: creating tablet
I20251215 14:55:05.091706 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_a88c3e4ed8414aaeb07e01a30cc69f50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:05.092125 8854 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_f1d62eb0033c45999a3caccdf7c64f34" } new_table_name: "default.Table_272ac9e499e84fd79c962c4228e690a9" modify_external_catalogs: true
W20251215 14:55:05.092320 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a88c3e4ed8414aaeb07e01a30cc69f50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:05.094107 9427 tablet_bootstrap.cc:492] T 924c9dd0cd9d40189bfe1457040f3d37 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:05.094280 9427 ts_tablet_manager.cc:1403] T 924c9dd0cd9d40189bfe1457040f3d37 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.071s user 0.000s sys 0.005s
I20251215 14:55:05.095111 9427 raft_consensus.cc:359] T 924c9dd0cd9d40189bfe1457040f3d37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.095474 9427 raft_consensus.cc:385] T 924c9dd0cd9d40189bfe1457040f3d37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.095613 9427 raft_consensus.cc:740] T 924c9dd0cd9d40189bfe1457040f3d37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.095899 9427 consensus_queue.cc:260] T 924c9dd0cd9d40189bfe1457040f3d37 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.096433 9427 ts_tablet_manager.cc:1434] T 924c9dd0cd9d40189bfe1457040f3d37 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:05.096766 9427 tablet_bootstrap.cc:492] T 2df2138e41844e9f897e57264b62cc9d P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:05.098577 9427 tablet_bootstrap.cc:654] T 2df2138e41844e9f897e57264b62cc9d P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.103914 9507 consensus_queue.cc:1048] T cb2f4fc179744458bc7db2f6c7197ec5 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20251215 14:55:05.108330 9426 tablet_bootstrap.cc:654] T bdfc164128a6413a83d83d05b69fb74a P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.110173 9673 consensus_queue.cc:1048] T c0d0022e48f04b83ac1c998a83fe3f55 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
W20251215 14:55:05.112382 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet f2aae2798eee4775afaa3afc59e98a6c
W20251215 14:55:05.112473 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bd8d964650a49b08093608abf3e31fa
W20251215 14:55:05.112540 8857 catalog_manager.cc:5487] Ignoring report from unknown tablet 924c9dd0cd9d40189bfe1457040f3d37
I20251215 14:55:05.115761 9150 tablet_service.cc:1505] Processing CreateTablet for tablet 82ca60c5a63744ffb0a0c0a140ef665e (DEFAULT_TABLE table=default.Table_802c7f03a650477cb59c4e574f25e862 [id=fa027087d00d452daa95b171d95c5a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.116245 9150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ca60c5a63744ffb0a0c0a140ef665e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.117959 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 56816add0a61454c9980ad09f5815b09 (DEFAULT_TABLE table=default.Table_d582b0f606d1487287ac187149a256c1 [id=1f3c294eae334880b9166c390c519bcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.118357 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56816add0a61454c9980ad09f5815b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.119252 9151 tablet_service.cc:1505] Processing CreateTablet for tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 (DEFAULT_TABLE table=default.Table_a1ec14c414a94c868fbbfe74faf0872e [id=cb60f7deb1c34398b39508393cc4cefd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.119742 9151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ea0509d8eb42bdb2291ff01e8d3bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.126820 9154 tablet_service.cc:1505] Processing CreateTablet for tablet f830b4af355e480bbe75d6060585529e (DEFAULT_TABLE table=default.Table_b84b10eece664a31b983b31c90986bda [id=aac8c87b5b67426d86d47e2825d77f53]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.127347 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f830b4af355e480bbe75d6060585529e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.137099 9286 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49104 (request call id 166) took 1147 ms. Trace:
W20251215 14:55:05.137715 8858 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5560a21e16bb43c7903c1fc66429ecdf consensus state has no leader
I20251215 14:55:05.138178 9291 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49104 (request call id 167) took 1004 ms. Trace:
W20251215 14:55:05.138229 8855 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f080b56cff244a46bfb73d05d3127f31 consensus state has no leader
W20251215 14:55:05.138520 8851 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5dc81eb40614463cb5017475b378eea6 consensus state has no leader
W20251215 14:55:05.138792 8856 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 58926ab073974e2c8b725d5061a544d5 has no consensus state
I20251215 14:55:05.141558 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 88206b17f94242378a35d5314611ac1a (DEFAULT_TABLE table=default.Table_61ca8adc55ea4c149b8ddaf2b30ef360 [id=efe5b2d15f1946cfa19f92b942b760d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.142089 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88206b17f94242378a35d5314611ac1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.143929 9291 rpcz_store.cc:276] 1215 14:55:04.071952 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:04.146066 (+ 74114us) service_pool.cc:225] Handling call
1215 14:55:04.177811 (+ 31745us) ts_tablet_manager.cc:669] Acquired tablet manager lock
1215 14:55:04.177835 (+ 24us) ts_tablet_manager.cc:682] Creating new metadata...
1215 14:55:04.876857 (+699022us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:05.073325 (+196468us) tablet_replica.cc:206] Creating consensus instance
1215 14:55:05.076534 (+ 3209us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20251215 14:55:05.145067 9665 log.cc:927] Time spent T 4816503e4fa1459dbb311997be85f64a P e89303a500544272b601d7c29be802b4: Append to log took a long time: real 0.067s user 0.000s sys 0.000s
I20251215 14:55:05.145943 9626 raft_consensus.cc:493] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:05.146111 9626 raft_consensus.cc:515] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.146852 9626 leader_election.cc:290] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:05.147715 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9695d47e35448fdad95ff3f24bafd03" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:05.147977 9180 raft_consensus.cc:2468] T f9695d47e35448fdad95ff3f24bafd03 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:05.148428 8976 leader_election.cc:304] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:05.148914 9626 raft_consensus.cc:2804] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:05.149729 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9695d47e35448fdad95ff3f24bafd03" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
W20251215 14:55:05.151129 8856 catalog_manager.cc:5487] Ignoring report from unknown tablet 92e21a77ad074572a57b836743903a0b
W20251215 14:55:05.151239 8856 catalog_manager.cc:5487] Ignoring report from unknown tablet 4816503e4fa1459dbb311997be85f64a
W20251215 14:55:05.151300 8856 catalog_manager.cc:5487] Ignoring report from unknown tablet 4f1f902cbcb643b9b98fa3d72babba79
I20251215 14:55:05.155753 9312 raft_consensus.cc:2468] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:05.156291 9154 tablet_service.cc:1505] Processing CreateTablet for tablet a0a74645593d46fcbc0235ec6a4670d8 (DEFAULT_TABLE table=default.Table_497589c332ff4e16ada3e5656acb5606 [id=8fd51436207145d7bf68e122e24fe7a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.156368 9435 tablet_bootstrap.cc:492] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
W20251215 14:55:05.156420 9249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 195825us
I20251215 14:55:05.156772 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a74645593d46fcbc0235ec6a4670d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.157696 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92e21a77ad074572a57b836743903a0b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:05.159722 9684 tablet.cc:1722] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:05.156384 9286 rpcz_store.cc:276] 1215 14:55:03.989580 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:04.144135 (+154555us) service_pool.cc:225] Handling call
1215 14:55:04.172624 (+ 28489us) ts_tablet_manager.cc:669] Acquired tablet manager lock
1215 14:55:04.172687 (+ 63us) ts_tablet_manager.cc:682] Creating new metadata...
1215 14:55:04.894888 (+722201us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:05.136846 (+241958us) tablet_replica.cc:206] Creating consensus instance
1215 14:55:05.137022 (+ 176us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 14:55:05.160177 9435 ts_tablet_manager.cc:1403] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.183s user 0.008s sys 0.008s
I20251215 14:55:05.165776 9435 raft_consensus.cc:359] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.166949 9435 raft_consensus.cc:385] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.167374 9435 raft_consensus.cc:740] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.167965 9435 consensus_queue.cc:260] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.168978 9435 ts_tablet_manager.cc:1434] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:05.171685 9435 tablet_bootstrap.cc:492] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:05.172595 9145 tablet_service.cc:1505] Processing CreateTablet for tablet accc3fdaf8e64b0f96b45150a59516bf (DEFAULT_TABLE table=default.Table_f4e69462c1fa42df8f9776f053474a93 [id=0bb5128a11484a1d8c056985720b1a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.173115 9145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet accc3fdaf8e64b0f96b45150a59516bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.174031 9144 tablet_service.cc:1505] Processing CreateTablet for tablet 5dd36ea0aa53460f9c1fda4b31063fa7 (DEFAULT_TABLE table=default.Table_05353059978c4d13804474b05f6c8d7b [id=6dd2c68a85f648e1b4c51e691c1eb632]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.174436 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dd36ea0aa53460f9c1fda4b31063fa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.181785 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet 5f03dfdd546c492185c6c31866a090a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:04 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:05.184242 9286 tablet_service.cc:1552] Processing DeleteTablet for tablet 15a974e3265a4c88aa6d5005ffa04dc8 with delete_type TABLET_DATA_DELETED (replaced by tablet 034fec793ae74fcda0c73f1cea291311) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:05.185133 9150 tablet_service.cc:1505] Processing CreateTablet for tablet 3c6cfff573434fbcb18feaf6a8e6a153 (DEFAULT_TABLE table=default.Table_ba8f8beb36af4b6ab3fc11419c5c3531 [id=9db10c7c96104a7fb7ab0c44c2911d2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.185734 9150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6cfff573434fbcb18feaf6a8e6a153. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.184909 9284 tablet_service.cc:1552] Processing DeleteTablet for tablet 2d75636265f14a428aae592438064ea2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:04 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:05.185247 9291 tablet_service.cc:1552] Processing DeleteTablet for tablet fab39532fe6a403683952057c5ccabd9 with delete_type TABLET_DATA_DELETED (replaced by tablet 5dd36ea0aa53460f9c1fda4b31063fa7) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:05.191648 9286 tablet_service.cc:1552] Processing DeleteTablet for tablet 194bb745ecb849cb9092fee1afb7dbe6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:04 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:05.182996 9151 tablet_service.cc:1505] Processing CreateTablet for tablet 2811b8ffdb614c91b0d3d4e6e039245b (DEFAULT_TABLE table=default.Table_41cfaeeb78b544a38b5c116552bbecfa [id=53315a8cf3bd4a05b1c5e30fd0acdd56]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.192310 9151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2811b8ffdb614c91b0d3d4e6e039245b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.193019 9291 tablet_service.cc:1505] Processing CreateTablet for tablet 82ca60c5a63744ffb0a0c0a140ef665e (DEFAULT_TABLE table=default.Table_802c7f03a650477cb59c4e574f25e862 [id=fa027087d00d452daa95b171d95c5a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.193475 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ca60c5a63744ffb0a0c0a140ef665e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.193871 9286 tablet_service.cc:1505] Processing CreateTablet for tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 (DEFAULT_TABLE table=default.Table_a1ec14c414a94c868fbbfe74faf0872e [id=cb60f7deb1c34398b39508393cc4cefd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.194272 9286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ea0509d8eb42bdb2291ff01e8d3bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.200407 9435 tablet_bootstrap.cc:654] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.204212 9284 tablet_service.cc:1505] Processing CreateTablet for tablet f830b4af355e480bbe75d6060585529e (DEFAULT_TABLE table=default.Table_b84b10eece664a31b983b31c90986bda [id=aac8c87b5b67426d86d47e2825d77f53]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.204713 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f830b4af355e480bbe75d6060585529e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.208331 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 034fec793ae74fcda0c73f1cea291311 (DEFAULT_TABLE table=default.Table_ece44e44ff964192893318b9b02f5b95 [id=d3f4f5d7775b4973b6c2d07ee0952906]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.208843 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 034fec793ae74fcda0c73f1cea291311. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.211696 9294 tablet_service.cc:1505] Processing CreateTablet for tablet 3c6cfff573434fbcb18feaf6a8e6a153 (DEFAULT_TABLE table=default.Table_ba8f8beb36af4b6ab3fc11419c5c3531 [id=9db10c7c96104a7fb7ab0c44c2911d2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.212095 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6cfff573434fbcb18feaf6a8e6a153. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.213577 9287 tablet_service.cc:1505] Processing CreateTablet for tablet 5dd36ea0aa53460f9c1fda4b31063fa7 (DEFAULT_TABLE table=default.Table_05353059978c4d13804474b05f6c8d7b [id=6dd2c68a85f648e1b4c51e691c1eb632]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.213933 9287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dd36ea0aa53460f9c1fda4b31063fa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.215466 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 88206b17f94242378a35d5314611ac1a (DEFAULT_TABLE table=default.Table_61ca8adc55ea4c149b8ddaf2b30ef360 [id=efe5b2d15f1946cfa19f92b942b760d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.215802 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88206b17f94242378a35d5314611ac1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.219460 9279 tablet_service.cc:1505] Processing CreateTablet for tablet a0a74645593d46fcbc0235ec6a4670d8 (DEFAULT_TABLE table=default.Table_497589c332ff4e16ada3e5656acb5606 [id=8fd51436207145d7bf68e122e24fe7a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.219784 9279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a74645593d46fcbc0235ec6a4670d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.221302 9287 tablet_service.cc:1505] Processing CreateTablet for tablet 034fec793ae74fcda0c73f1cea291311 (DEFAULT_TABLE table=default.Table_ece44e44ff964192893318b9b02f5b95 [id=d3f4f5d7775b4973b6c2d07ee0952906]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.221642 9287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 034fec793ae74fcda0c73f1cea291311. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.226263 9426 tablet_bootstrap.cc:492] T bdfc164128a6413a83d83d05b69fb74a P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:05.226430 9426 ts_tablet_manager.cc:1403] T bdfc164128a6413a83d83d05b69fb74a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.208s user 0.010s sys 0.000s
I20251215 14:55:05.223197 9283 tablet_service.cc:1505] Processing CreateTablet for tablet 2811b8ffdb614c91b0d3d4e6e039245b (DEFAULT_TABLE table=default.Table_41cfaeeb78b544a38b5c116552bbecfa [id=53315a8cf3bd4a05b1c5e30fd0acdd56]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.227476 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2811b8ffdb614c91b0d3d4e6e039245b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.227437 9426 raft_consensus.cc:359] T bdfc164128a6413a83d83d05b69fb74a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.227639 9426 raft_consensus.cc:385] T bdfc164128a6413a83d83d05b69fb74a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.227715 9426 raft_consensus.cc:740] T bdfc164128a6413a83d83d05b69fb74a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.227946 9426 consensus_queue.cc:260] T bdfc164128a6413a83d83d05b69fb74a P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.228615 9426 ts_tablet_manager.cc:1434] T bdfc164128a6413a83d83d05b69fb74a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:05.228910 9426 tablet_bootstrap.cc:492] T b329b0abcad742ff94c1a62a72d1b673 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:05.223523 9290 tablet_service.cc:1505] Processing CreateTablet for tablet accc3fdaf8e64b0f96b45150a59516bf (DEFAULT_TABLE table=default.Table_f4e69462c1fa42df8f9776f053474a93 [id=0bb5128a11484a1d8c056985720b1a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.231443 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet accc3fdaf8e64b0f96b45150a59516bf. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:05.247450 9249 leader_election.cc:343] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:05.247694 9249 leader_election.cc:304] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:05.248066 9675 raft_consensus.cc:2749] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:05.247952 8855 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_9c3c46c55b45498cbd336827286a69aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:05.248467 8851 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_a68d34f520064abe9fb31e83e0162483"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:05.248639 8855 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c3c46c55b45498cbd336827286a69aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:05.248955 8851 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a68d34f520064abe9fb31e83e0162483 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:05.249264 9291 tablet_service.cc:1505] Processing CreateTablet for tablet 56816add0a61454c9980ad09f5815b09 (DEFAULT_TABLE table=default.Table_d582b0f606d1487287ac187149a256c1 [id=1f3c294eae334880b9166c390c519bcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.249635 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56816add0a61454c9980ad09f5815b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.249881 8858 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_abc6bd10434344bd8243529d30fa1c86" } modify_external_catalogs: true
I20251215 14:55:05.250051 8858 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_abc6bd10434344bd8243529d30fa1c86" } modify_external_catalogs: true
W20251215 14:55:05.252928 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet cb2f4fc179744458bc7db2f6c7197ec5
W20251215 14:55:05.253026 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet 4a6846144c8c409cad340e99374a38c6
W20251215 14:55:05.253070 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bd8d964650a49b08093608abf3e31fa
W20251215 14:55:05.253168 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet 4816503e4fa1459dbb311997be85f64a
W20251215 14:55:05.253216 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet 4f1f902cbcb643b9b98fa3d72babba79
W20251215 14:55:05.260126 8854 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 05e70b4070b6437e9b934af4e6b93f6a consensus state has no leader
I20251215 14:55:05.260123 9012 tablet_service.cc:1505] Processing CreateTablet for tablet 56816add0a61454c9980ad09f5815b09 (DEFAULT_TABLE table=default.Table_d582b0f606d1487287ac187149a256c1 [id=1f3c294eae334880b9166c390c519bcb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.260634 9012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56816add0a61454c9980ad09f5815b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.263267 9014 tablet_service.cc:1505] Processing CreateTablet for tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 (DEFAULT_TABLE table=default.Table_a1ec14c414a94c868fbbfe74faf0872e [id=cb60f7deb1c34398b39508393cc4cefd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.263705 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ea0509d8eb42bdb2291ff01e8d3bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.266988 9009 tablet_service.cc:1505] Processing CreateTablet for tablet 82ca60c5a63744ffb0a0c0a140ef665e (DEFAULT_TABLE table=default.Table_802c7f03a650477cb59c4e574f25e862 [id=fa027087d00d452daa95b171d95c5a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.267478 9009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ca60c5a63744ffb0a0c0a140ef665e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.271677 9017 tablet_service.cc:1505] Processing CreateTablet for tablet 3c6cfff573434fbcb18feaf6a8e6a153 (DEFAULT_TABLE table=default.Table_ba8f8beb36af4b6ab3fc11419c5c3531 [id=9db10c7c96104a7fb7ab0c44c2911d2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.272076 9017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c6cfff573434fbcb18feaf6a8e6a153. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:05.275244 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 101904us
I20251215 14:55:05.275417 9011 tablet_service.cc:1505] Processing CreateTablet for tablet f830b4af355e480bbe75d6060585529e (DEFAULT_TABLE table=default.Table_b84b10eece664a31b983b31c90986bda [id=aac8c87b5b67426d86d47e2825d77f53]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.277175 9626 raft_consensus.cc:493] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:05.279054 9010 tablet_service.cc:1505] Processing CreateTablet for tablet 88206b17f94242378a35d5314611ac1a (DEFAULT_TABLE table=default.Table_61ca8adc55ea4c149b8ddaf2b30ef360 [id=efe5b2d15f1946cfa19f92b942b760d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.287429 9435 tablet_bootstrap.cc:492] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
W20251215 14:55:05.287923 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 5f03dfdd546c492185c6c31866a090a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f03dfdd546c492185c6c31866a090a5 already in progress: creating tablet
I20251215 14:55:05.288268 9435 ts_tablet_manager.cc:1403] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.117s user 0.002s sys 0.003s
I20251215 14:55:05.289134 9435 raft_consensus.cc:359] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.289978 9426 tablet_bootstrap.cc:654] T b329b0abcad742ff94c1a62a72d1b673 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:05.290243 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 2d75636265f14a428aae592438064ea2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2d75636265f14a428aae592438064ea2 already in progress: creating tablet
I20251215 14:55:05.290562 8856 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_83de3588e27e48f2a722e2104b267467" } modify_external_catalogs: true
I20251215 14:55:05.290622 8854 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_2dd806808b064dadbe81feaae5862a89"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:05.290791 8856 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_83de3588e27e48f2a722e2104b267467" } modify_external_catalogs: true
W20251215 14:55:05.291231 8854 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2dd806808b064dadbe81feaae5862a89 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:05.292515 8852 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_5d032dd330df4c33aa8ef50ce62c8d08" } modify_external_catalogs: true
I20251215 14:55:05.292584 8850 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_497589c332ff4e16ada3e5656acb5606" } modify_external_catalogs: true
I20251215 14:55:05.292683 8852 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_5d032dd330df4c33aa8ef50ce62c8d08" } modify_external_catalogs: true
I20251215 14:55:05.292765 8850 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_497589c332ff4e16ada3e5656acb5606" } modify_external_catalogs: true
I20251215 14:55:05.295701 8853 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:55:05.298074 9435 raft_consensus.cc:385] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.298540 9435 raft_consensus.cc:740] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.300450 9435 consensus_queue.cc:260] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.300614 9626 raft_consensus.cc:3060] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:05.302448 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet fab39532fe6a403683952057c5ccabd9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fab39532fe6a403683952057c5ccabd9 already in progress: creating tablet
I20251215 14:55:05.303221 9435 ts_tablet_manager.cc:1434] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
W20251215 14:55:05.303226 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 194bb745ecb849cb9092fee1afb7dbe6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 194bb745ecb849cb9092fee1afb7dbe6 already in progress: creating tablet
I20251215 14:55:05.304136 9435 tablet_bootstrap.cc:492] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:05.308192 9435 tablet_bootstrap.cc:654] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:05.310832 8844 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet f080b56cff244a46bfb73d05d3127f31 (table default.Table_371fb0a76bea4b17b74b0eb7dc573f00 [id=a81a53d1daa84a799510d1f4224eb1e1], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet f080b56cff244a46bfb73d05d3127f31 consensus state has no leader
I20251215 14:55:05.312273 9435 tablet_bootstrap.cc:492] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:05.312433 9435 ts_tablet_manager.cc:1403] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20251215 14:55:05.313223 9435 raft_consensus.cc:359] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.313418 9435 raft_consensus.cc:385] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.313535 9435 raft_consensus.cc:740] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.313788 9435 consensus_queue.cc:260] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.314172 9010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88206b17f94242378a35d5314611ac1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.314668 8857 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_cd6f9353272f406f866b8aea97b47b52"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:05.315248 8857 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd6f9353272f406f866b8aea97b47b52 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:05.316960 8851 master_service.cc:954] ReplaceTablet: received request to replace tablet df70bebdc8ad4f8186ba427e840799cf from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:05.317301 8851 master_service.cc:954] ReplaceTablet: received request to replace tablet 9bf4a899338f4bcfac099b5099a22f05 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:05.318910 8855 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_baa5664946144147bafee4511b30105f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:05.319471 8855 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_baa5664946144147bafee4511b30105f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:05.320204 9291 tablet_service.cc:1552] Processing DeleteTablet for tablet 0215ff355fce46b5a4cf1bf4bd7164f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:05.321135 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet 44bd51f9bf77492b8890fc7c8411c887
I20251215 14:55:05.321622 8859 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_f3914f2c87834e22a1e6ee9dd86ec86c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:05.322075 8859 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3914f2c87834e22a1e6ee9dd86ec86c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:05.322227 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 0215ff355fce46b5a4cf1bf4bd7164f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0215ff355fce46b5a4cf1bf4bd7164f3 already in progress: creating tablet
I20251215 14:55:05.323557 9435 ts_tablet_manager.cc:1434] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
W20251215 14:55:05.323734 8853 catalog_manager.cc:5487] Ignoring report from unknown tablet c0d0022e48f04b83ac1c998a83fe3f55
W20251215 14:55:05.323815 8853 catalog_manager.cc:5487] Ignoring report from unknown tablet b329b0abcad742ff94c1a62a72d1b673
W20251215 14:55:05.323859 8853 catalog_manager.cc:5487] Ignoring report from unknown tablet cb2f4fc179744458bc7db2f6c7197ec5
W20251215 14:55:05.323915 8853 catalog_manager.cc:5487] Ignoring report from unknown tablet 4a6846144c8c409cad340e99374a38c6
W20251215 14:55:05.323952 8853 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bd8d964650a49b08093608abf3e31fa
I20251215 14:55:05.323917 9615 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:05.324077 9615 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.324703 9615 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:05.323596 9150 tablet_service.cc:1552] Processing DeleteTablet for tablet 0215ff355fce46b5a4cf1bf4bd7164f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:05.326479 9435 tablet_bootstrap.cc:492] T d922d7b24dbd474cbee47c72f2779a07 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:05.326025 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:55:05.328045 8853 catalog_manager.cc:5487] Ignoring report from unknown tablet fc9bda52c73e4aa6b7e2eb008c63391b
W20251215 14:55:05.328183 8853 catalog_manager.cc:5487] Ignoring report from unknown tablet 018bd6ac8a534a6abc461b57b89b93eb
W20251215 14:55:05.328297 8853 catalog_manager.cc:5487] Ignoring report from unknown tablet 813cfeea5399457e91623fb3abf9fd32
I20251215 14:55:05.329458 9016 tablet_service.cc:1505] Processing CreateTablet for tablet a0a74645593d46fcbc0235ec6a4670d8 (DEFAULT_TABLE table=default.Table_497589c332ff4e16ada3e5656acb5606 [id=8fd51436207145d7bf68e122e24fe7a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.329519 9021 tablet_service.cc:1505] Processing CreateTablet for tablet 2811b8ffdb614c91b0d3d4e6e039245b (DEFAULT_TABLE table=default.Table_41cfaeeb78b544a38b5c116552bbecfa [id=53315a8cf3bd4a05b1c5e30fd0acdd56]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.332672 9435 tablet_bootstrap.cc:654] T d922d7b24dbd474cbee47c72f2779a07 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:05.332844 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:05.332988 9112 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:05.333442 9615 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:05.333798 9015 tablet_service.cc:1505] Processing CreateTablet for tablet accc3fdaf8e64b0f96b45150a59516bf (DEFAULT_TABLE table=default.Table_f4e69462c1fa42df8f9776f053474a93 [id=0bb5128a11484a1d8c056985720b1a5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.334111 8853 master_service.cc:954] ReplaceTablet: received request to replace tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:05.335623 9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f830b4af355e480bbe75d6060585529e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.343647 8858 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet f7af1f66c4f04f649379758ff1b3e387
I20251215 14:55:05.344448 8858 master_service.cc:954] ReplaceTablet: received request to replace tablet ff4508c5a110427eb4d9d2eaaadace0b from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:05.348639 9007 tablet_service.cc:1505] Processing CreateTablet for tablet 034fec793ae74fcda0c73f1cea291311 (DEFAULT_TABLE table=default.Table_ece44e44ff964192893318b9b02f5b95 [id=d3f4f5d7775b4973b6c2d07ee0952906]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.350664 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a74645593d46fcbc0235ec6a4670d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.351747 9020 tablet_service.cc:1505] Processing CreateTablet for tablet 5dd36ea0aa53460f9c1fda4b31063fa7 (DEFAULT_TABLE table=default.Table_05353059978c4d13804474b05f6c8d7b [id=6dd2c68a85f648e1b4c51e691c1eb632]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:05.352025 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet 0215ff355fce46b5a4cf1bf4bd7164f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:05.353298 9291 tablet_service.cc:1552] Processing DeleteTablet for tablet f7af1f66c4f04f649379758ff1b3e387 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:05.356495 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet f7af1f66c4f04f649379758ff1b3e387 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:05.358012 9021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2811b8ffdb614c91b0d3d4e6e039245b. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:05.358525 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet f7af1f66c4f04f649379758ff1b3e387 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7af1f66c4f04f649379758ff1b3e387 already in progress: creating tablet
I20251215 14:55:05.354619 9150 tablet_service.cc:1552] Processing DeleteTablet for tablet f7af1f66c4f04f649379758ff1b3e387 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:05.362509 8856 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7
W20251215 14:55:05.363813 8856 catalog_manager.cc:5487] Ignoring report from unknown tablet c0d0022e48f04b83ac1c998a83fe3f55
W20251215 14:55:05.364236 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet c0d0022e48f04b83ac1c998a83fe3f55
I20251215 14:55:05.364293 8856 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_bdb881513410499d96d921c275f0bd61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:05.364742 8854 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_1209e44783914fd0875ebeca6528fa3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:05.364897 8856 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bdb881513410499d96d921c275f0bd61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:05.365253 8854 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1209e44783914fd0875ebeca6528fa3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:05.366655 9150 tablet_service.cc:1552] Processing DeleteTablet for tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:54874
W20251215 14:55:05.367110 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 0215ff355fce46b5a4cf1bf4bd7164f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0215ff355fce46b5a4cf1bf4bd7164f3 already in progress: creating tablet
W20251215 14:55:05.367884 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet f7af1f66c4f04f649379758ff1b3e387 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7af1f66c4f04f649379758ff1b3e387 already in progress: creating tablet
I20251215 14:55:05.368938 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 034fec793ae74fcda0c73f1cea291311. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.372139 9609 consensus_queue.cc:1048] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:05.374321 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dd36ea0aa53460f9c1fda4b31063fa7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.374823 9291 tablet_service.cc:1552] Processing DeleteTablet for tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:05.374672 9626 raft_consensus.cc:515] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.375370 8852 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet d922d7b24dbd474cbee47c72f2779a07
I20251215 14:55:05.375873 9626 leader_election.cc:290] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:05.376659 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet c0d0022e48f04b83ac1c998a83fe3f55
W20251215 14:55:05.376742 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet bdfc164128a6413a83d83d05b69fb74a
I20251215 14:55:05.376731 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:05.376789 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet 018bd6ac8a534a6abc461b57b89b93eb
I20251215 14:55:05.377256 8852 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_8517e4afab414864a30f6afa1d656b2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:05.377512 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9695d47e35448fdad95ff3f24bafd03" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:05.377707 9180 raft_consensus.cc:3060] T f9695d47e35448fdad95ff3f24bafd03 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:05.377748 8852 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8517e4afab414864a30f6afa1d656b2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:05.380352 9180 raft_consensus.cc:2468] T f9695d47e35448fdad95ff3f24bafd03 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
W20251215 14:55:05.382988 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 0215ff355fce46b5a4cf1bf4bd7164f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0215ff355fce46b5a4cf1bf4bd7164f3 already in progress: creating tablet
W20251215 14:55:05.383251 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet f7af1f66c4f04f649379758ff1b3e387 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7af1f66c4f04f649379758ff1b3e387 already in progress: creating tablet
W20251215 14:55:05.383452 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 already in progress: creating tablet
I20251215 14:55:05.384186 8850 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet a0a74645593d46fcbc0235ec6a4670d8
I20251215 14:55:05.384852 8850 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_d884e36a60cf4a109778a5bfa32afaa8" } new_table_name: "default.Table_d27029eebe7b40ad85ba792bad6d92c5" modify_external_catalogs: true
I20251215 14:55:05.386354 8857 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_bf76d4a7a65242d5b022304a0722e09a" } new_table_name: "default.Table_6ee288ff34ea426582a74cc4cf626490" modify_external_catalogs: true
I20251215 14:55:05.386426 8976 leader_election.cc:304] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:05.387475 9426 tablet_bootstrap.cc:492] T b329b0abcad742ff94c1a62a72d1b673 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:05.387590 8851 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 9bf4a899338f4bcfac099b5099a22f05
I20251215 14:55:05.387720 9426 ts_tablet_manager.cc:1403] T b329b0abcad742ff94c1a62a72d1b673 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.159s user 0.009s sys 0.035s
I20251215 14:55:05.387992 8851 catalog_manager.cc:6724] ReplaceTablet: tablet 9bf4a899338f4bcfac099b5099a22f05 deleted and replaced by tablet 78b3f18a62d544b38a0682bf3bc00977
I20251215 14:55:05.388283 8851 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_3a992edcd1f14784877bb2cface4de61" } new_table_name: "default.Table_aba7a90daaf544eb972bd7349f27ae63" modify_external_catalogs: true
I20251215 14:55:05.389137 9626 raft_consensus.cc:2804] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:05.389268 9626 raft_consensus.cc:697] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:05.389082 9426 raft_consensus.cc:359] T b329b0abcad742ff94c1a62a72d1b673 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.389402 9426 raft_consensus.cc:385] T b329b0abcad742ff94c1a62a72d1b673 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.389544 9426 raft_consensus.cc:740] T b329b0abcad742ff94c1a62a72d1b673 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.389549 9626 consensus_queue.cc:237] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.389876 9426 consensus_queue.cc:260] T b329b0abcad742ff94c1a62a72d1b673 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.388883 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9695d47e35448fdad95ff3f24bafd03" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:05.391149 9313 raft_consensus.cc:3060] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:05.393893 9313 raft_consensus.cc:2468] T f9695d47e35448fdad95ff3f24bafd03 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:05.394348 9435 tablet_bootstrap.cc:492] T d922d7b24dbd474cbee47c72f2779a07 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:05.396461 9151 tablet_service.cc:1552] Processing DeleteTablet for tablet 9bf4a899338f4bcfac099b5099a22f05 with delete_type TABLET_DATA_DELETED (replaced by tablet 78b3f18a62d544b38a0682bf3bc00977) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:05.396456 9154 tablet_service.cc:1552] Processing DeleteTablet for tablet a0a74645593d46fcbc0235ec6a4670d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:05.396301 9435 ts_tablet_manager.cc:1403] T d922d7b24dbd474cbee47c72f2779a07 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.072s user 0.000s sys 0.007s
W20251215 14:55:05.397876 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 9bf4a899338f4bcfac099b5099a22f05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bf4a899338f4bcfac099b5099a22f05 already in progress: creating tablet
I20251215 14:55:05.397771 9426 ts_tablet_manager.cc:1434] T b329b0abcad742ff94c1a62a72d1b673 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
W20251215 14:55:05.398177 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet a0a74645593d46fcbc0235ec6a4670d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0a74645593d46fcbc0235ec6a4670d8 already in progress: creating tablet
I20251215 14:55:05.400055 9427 tablet_bootstrap.cc:492] T 2df2138e41844e9f897e57264b62cc9d P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:05.401417 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet accc3fdaf8e64b0f96b45150a59516bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:05.402135 9427 ts_tablet_manager.cc:1403] T 2df2138e41844e9f897e57264b62cc9d P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.304s user 0.006s sys 0.005s
W20251215 14:55:05.406277 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet b329b0abcad742ff94c1a62a72d1b673
I20251215 14:55:05.406869 8855 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_272ac9e499e84fd79c962c4228e690a9" } new_table_name: "default.Table_1c4625e0c84d45528a90ab30fb24012d" modify_external_catalogs: true
I20251215 14:55:05.407927 9435 raft_consensus.cc:359] T d922d7b24dbd474cbee47c72f2779a07 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.408134 9435 raft_consensus.cc:385] T d922d7b24dbd474cbee47c72f2779a07 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.408206 9435 raft_consensus.cc:740] T d922d7b24dbd474cbee47c72f2779a07 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.409997 9150 tablet_service.cc:1552] Processing DeleteTablet for tablet d922d7b24dbd474cbee47c72f2779a07 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:54874
W20251215 14:55:05.410635 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 already in progress: creating tablet
W20251215 14:55:05.411516 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet d922d7b24dbd474cbee47c72f2779a07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d922d7b24dbd474cbee47c72f2779a07 already in progress: creating tablet
I20251215 14:55:05.411823 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet a0a74645593d46fcbc0235ec6a4670d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:05.412075 9287 tablet_service.cc:1552] Processing DeleteTablet for tablet 9bf4a899338f4bcfac099b5099a22f05 with delete_type TABLET_DATA_DELETED (replaced by tablet 78b3f18a62d544b38a0682bf3bc00977) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:05.412938 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet a0a74645593d46fcbc0235ec6a4670d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0a74645593d46fcbc0235ec6a4670d8 already in progress: creating tablet
W20251215 14:55:05.413228 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 9bf4a899338f4bcfac099b5099a22f05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bf4a899338f4bcfac099b5099a22f05 already in progress: creating tablet
I20251215 14:55:05.413424 9291 tablet_service.cc:1552] Processing DeleteTablet for tablet d922d7b24dbd474cbee47c72f2779a07 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:05.414014 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet d922d7b24dbd474cbee47c72f2779a07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d922d7b24dbd474cbee47c72f2779a07 already in progress: creating tablet
W20251215 14:55:05.414564 8859 catalog_manager.cc:5487] Ignoring report from unknown tablet b329b0abcad742ff94c1a62a72d1b673
I20251215 14:55:05.416606 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet a0a74645593d46fcbc0235ec6a4670d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:05.417312 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet d922d7b24dbd474cbee47c72f2779a07 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:05.417585 9426 tablet_bootstrap.cc:492] T fc9bda52c73e4aa6b7e2eb008c63391b P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:05.419138 9435 consensus_queue.cc:260] T d922d7b24dbd474cbee47c72f2779a07 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.419358 9426 tablet_bootstrap.cc:654] T fc9bda52c73e4aa6b7e2eb008c63391b P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.420120 8859 master_service.cc:954] ReplaceTablet: received request to replace tablet 18cd1f63d51e4565bb8c55be13e3e099 from {username='slave'} at 127.0.0.1:34038
W20251215 14:55:05.422183 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 already in progress: creating tablet
I20251215 14:55:05.428558 8853 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet 65ea0509d8eb42bdb2291ff01e8d3bd6
I20251215 14:55:05.429008 8853 catalog_manager.cc:6724] ReplaceTablet: tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 deleted and replaced by tablet 21a98ce868924690b8a5715f4103c360
W20251215 14:55:05.429864 8853 catalog_manager.cc:5487] Ignoring report from unknown tablet 018bd6ac8a534a6abc461b57b89b93eb
W20251215 14:55:05.429926 8853 catalog_manager.cc:5487] Ignoring report from unknown tablet c0d0022e48f04b83ac1c998a83fe3f55
I20251215 14:55:05.431326 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet 9bf4a899338f4bcfac099b5099a22f05 with delete_type TABLET_DATA_DELETED (replaced by tablet 78b3f18a62d544b38a0682bf3bc00977) from {username='slave'} at 127.0.0.1:37746
I20251215 14:55:05.434137 8858 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Sending DeleteTablet for 3 replicas of tablet ff4508c5a110427eb4d9d2eaaadace0b
I20251215 14:55:05.434580 8858 catalog_manager.cc:6724] ReplaceTablet: tablet ff4508c5a110427eb4d9d2eaaadace0b deleted and replaced by tablet 15b8a2a337e54321afd67f7562c412a0
I20251215 14:55:05.437002 9150 tablet_service.cc:1552] Processing DeleteTablet for tablet ff4508c5a110427eb4d9d2eaaadace0b with delete_type TABLET_DATA_DELETED (replaced by tablet 15b8a2a337e54321afd67f7562c412a0) from {username='slave'} at 127.0.0.1:54874
I20251215 14:55:05.437500 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 with delete_type TABLET_DATA_DELETED (replaced by tablet 21a98ce868924690b8a5715f4103c360) from {username='slave'} at 127.0.0.1:54874
W20251215 14:55:05.438207 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet ff4508c5a110427eb4d9d2eaaadace0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff4508c5a110427eb4d9d2eaaadace0b already in progress: creating tablet
W20251215 14:55:05.438488 8844 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 already in progress: creating tablet
W20251215 14:55:05.438933 8843 catalog_manager.cc:4952] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet a0a74645593d46fcbc0235ec6a4670d8 because the tablet was not found. No further retry: Not found: Tablet not found: a0a74645593d46fcbc0235ec6a4670d8
W20251215 14:55:05.439190 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet d922d7b24dbd474cbee47c72f2779a07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d922d7b24dbd474cbee47c72f2779a07 already in progress: creating tablet
I20251215 14:55:05.439862 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet ff4508c5a110427eb4d9d2eaaadace0b with delete_type TABLET_DATA_DELETED (replaced by tablet 15b8a2a337e54321afd67f7562c412a0) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:05.441414 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 9bf4a899338f4bcfac099b5099a22f05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bf4a899338f4bcfac099b5099a22f05 already in progress: creating tablet
W20251215 14:55:05.441726 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet ff4508c5a110427eb4d9d2eaaadace0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff4508c5a110427eb4d9d2eaaadace0b already in progress: creating tablet
I20251215 14:55:05.443136 9427 raft_consensus.cc:359] T 2df2138e41844e9f897e57264b62cc9d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.443720 9427 raft_consensus.cc:385] T 2df2138e41844e9f897e57264b62cc9d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.443851 9427 raft_consensus.cc:740] T 2df2138e41844e9f897e57264b62cc9d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.444216 9427 consensus_queue.cc:260] T 2df2138e41844e9f897e57264b62cc9d P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.445174 9427 ts_tablet_manager.cc:1434] T 2df2138e41844e9f897e57264b62cc9d P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.043s user 0.001s sys 0.001s
I20251215 14:55:05.445760 9427 tablet_bootstrap.cc:492] T 92e21a77ad074572a57b836743903a0b P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:05.448038 9426 tablet_bootstrap.cc:492] T fc9bda52c73e4aa6b7e2eb008c63391b P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:05.448256 9426 ts_tablet_manager.cc:1403] T fc9bda52c73e4aa6b7e2eb008c63391b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.007s
I20251215 14:55:05.449806 9426 raft_consensus.cc:359] T fc9bda52c73e4aa6b7e2eb008c63391b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.450055 9426 raft_consensus.cc:385] T fc9bda52c73e4aa6b7e2eb008c63391b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.450173 9426 raft_consensus.cc:740] T fc9bda52c73e4aa6b7e2eb008c63391b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.450464 9426 consensus_queue.cc:260] T fc9bda52c73e4aa6b7e2eb008c63391b P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.450791 9012 tablet_service.cc:1552] Processing DeleteTablet for tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 with delete_type TABLET_DATA_DELETED (replaced by tablet 21a98ce868924690b8a5715f4103c360) from {username='slave'} at 127.0.0.1:37746
W20251215 14:55:05.453140 8843 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 already in progress: creating tablet
I20251215 14:55:05.453903 9287 tablet_service.cc:1552] Processing DeleteTablet for tablet ff4508c5a110427eb4d9d2eaaadace0b with delete_type TABLET_DATA_DELETED (replaced by tablet 15b8a2a337e54321afd67f7562c412a0) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:05.453912 9291 tablet_service.cc:1552] Processing DeleteTablet for tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 with delete_type TABLET_DATA_DELETED (replaced by tablet 21a98ce868924690b8a5715f4103c360) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:05.455319 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet ff4508c5a110427eb4d9d2eaaadace0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff4508c5a110427eb4d9d2eaaadace0b already in progress: creating tablet
W20251215 14:55:05.456419 8854 catalog_manager.cc:5487] Ignoring report from unknown tablet fc9bda52c73e4aa6b7e2eb008c63391b
W20251215 14:55:05.464658 8852 catalog_manager.cc:5487] Ignoring report from unknown tablet 4f1f902cbcb643b9b98fa3d72babba79
W20251215 14:55:05.465818 8850 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb3b95d32c7044bd8a4451381c19aeba consensus state has no leader
I20251215 14:55:05.466833 9426 ts_tablet_manager.cc:1434] T fc9bda52c73e4aa6b7e2eb008c63391b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
W20251215 14:55:05.470095 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet fc9bda52c73e4aa6b7e2eb008c63391b
I20251215 14:55:05.471781 9426 tablet_bootstrap.cc:492] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:05.474645 8857 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 18cd1f63d51e4565bb8c55be13e3e099 consensus state has no leader
I20251215 14:55:05.475268 9427 tablet_bootstrap.cc:654] T 92e21a77ad074572a57b836743903a0b P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.477244 9426 tablet_bootstrap.cc:654] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:05.480556 8851 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3cdfcddd91fe47de8fd14dc718f421a6 consensus state has no leader
W20251215 14:55:05.482873 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 already in progress: creating tablet
I20251215 14:55:05.483112 9426 tablet_bootstrap.cc:492] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:05.483431 9426 ts_tablet_manager.cc:1403] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.002s
I20251215 14:55:05.483467 9291 tablet_service.cc:1552] Processing DeleteTablet for tablet d922d7b24dbd474cbee47c72f2779a07 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:49104
I20251215 14:55:05.484002 9435 ts_tablet_manager.cc:1434] T d922d7b24dbd474cbee47c72f2779a07 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.069s user 0.000s sys 0.002s
W20251215 14:55:05.484127 8846 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet d922d7b24dbd474cbee47c72f2779a07 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d922d7b24dbd474cbee47c72f2779a07 already in progress: creating tablet
I20251215 14:55:05.485433 9426 raft_consensus.cc:359] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.486603 9426 raft_consensus.cc:385] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.486792 9426 raft_consensus.cc:740] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.486905 9435 tablet_bootstrap.cc:492] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:05.487572 9426 consensus_queue.cc:260] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.488209 8851 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_83a4b5504c4e4edbb77b41a026d2e0eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:05.488785 8851 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83a4b5504c4e4edbb77b41a026d2e0eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:05.490000 8857 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_fb8fb745144644eea96b20d598f52fa2" } new_table_name: "default.Table_99268441afd84c5fbfbd1080deabb144" modify_external_catalogs: true
I20251215 14:55:05.491580 9435 tablet_bootstrap.cc:654] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:05.492700 8855 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 05e70b4070b6437e9b934af4e6b93f6a consensus state has no leader
I20251215 14:55:05.494388 9426 ts_tablet_manager.cc:1434] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20251215 14:55:05.496255 9291 tablet_service.cc:1552] Processing DeleteTablet for tablet d922d7b24dbd474cbee47c72f2779a07 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:49104
W20251215 14:55:05.497128 8855 catalog_manager.cc:5487] Ignoring report from unknown tablet 92e21a77ad074572a57b836743903a0b
I20251215 14:55:05.498034 9701 tablet_replica.cc:333] T d922d7b24dbd474cbee47c72f2779a07 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:05.498231 9701 raft_consensus.cc:2243] T d922d7b24dbd474cbee47c72f2779a07 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:05.498447 9701 raft_consensus.cc:2272] T d922d7b24dbd474cbee47c72f2779a07 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:05.499722 9426 tablet_bootstrap.cc:492] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:05.500263 9701 ts_tablet_manager.cc:1916] T d922d7b24dbd474cbee47c72f2779a07 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:05.502956 9427 tablet_bootstrap.cc:492] T 92e21a77ad074572a57b836743903a0b P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:05.503103 9427 ts_tablet_manager.cc:1403] T 92e21a77ad074572a57b836743903a0b P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.057s user 0.001s sys 0.005s
I20251215 14:55:05.503528 8855 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_ae411cdd8f1740839d5490d643672e18" } modify_external_catalogs: true
I20251215 14:55:05.503716 8855 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_ae411cdd8f1740839d5490d643672e18" } modify_external_catalogs: true
I20251215 14:55:05.503973 9427 raft_consensus.cc:359] T 92e21a77ad074572a57b836743903a0b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.504155 9427 raft_consensus.cc:385] T 92e21a77ad074572a57b836743903a0b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.504235 9427 raft_consensus.cc:740] T 92e21a77ad074572a57b836743903a0b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.504880 9426 tablet_bootstrap.cc:654] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:05.505663 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet 92e21a77ad074572a57b836743903a0b
I20251215 14:55:05.509133 9676 consensus_queue.cc:1048] T 80d4c9b533ac4facb4205aff84903134 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:05.510443 8850 catalog_manager.cc:5487] Ignoring report from unknown tablet 80d4c9b533ac4facb4205aff84903134
I20251215 14:55:05.511649 9427 consensus_queue.cc:260] T 92e21a77ad074572a57b836743903a0b P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.521827 9701 ts_tablet_manager.cc:1929] T d922d7b24dbd474cbee47c72f2779a07 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:05.522018 9701 log.cc:1199] T d922d7b24dbd474cbee47c72f2779a07 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/d922d7b24dbd474cbee47c72f2779a07
I20251215 14:55:05.522475 9701 ts_tablet_manager.cc:1950] T d922d7b24dbd474cbee47c72f2779a07 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:05.522629 8850 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_68741bcb63154f56abf551a2c960108c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:05.522648 8852 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_9b34c87957f84ac085d807b10a2eec83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:05.513010 9427 ts_tablet_manager.cc:1434] T 92e21a77ad074572a57b836743903a0b P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
W20251215 14:55:05.523267 8852 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b34c87957f84ac085d807b10a2eec83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:05.523818 8846 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet d922d7b24dbd474cbee47c72f2779a07 (table default.Table_5d032dd330df4c33aa8ef50ce62c8d08 [id=977e2ac089d545278d13e59908bad89e]) successfully deleted
I20251215 14:55:05.524197 9427 tablet_bootstrap.cc:492] T b329b0abcad742ff94c1a62a72d1b673 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:05.523263 8850 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68741bcb63154f56abf551a2c960108c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:05.526499 9427 tablet_bootstrap.cc:654] T b329b0abcad742ff94c1a62a72d1b673 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:05.533916 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:05.534447 9435 tablet_bootstrap.cc:492] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:05.534608 9435 ts_tablet_manager.cc:1403] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.049s user 0.012s sys 0.001s
I20251215 14:55:05.535427 9435 raft_consensus.cc:359] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.535604 9435 raft_consensus.cc:385] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.535697 9435 raft_consensus.cc:740] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.535928 9435 consensus_queue.cc:260] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:05.539531 8856 catalog_manager.cc:5487] Ignoring report from unknown tablet f32a6e8df31d482fa9b9686e002d81ff
W20251215 14:55:05.541723 8856 catalog_manager.cc:5487] Ignoring report from unknown tablet 80d4c9b533ac4facb4205aff84903134
I20251215 14:55:05.542354 9435 ts_tablet_manager.cc:1434] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
W20251215 14:55:05.544715 8856 catalog_manager.cc:5487] Ignoring report from unknown tablet f32a6e8df31d482fa9b9686e002d81ff
I20251215 14:55:05.547029 8854 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_b84b10eece664a31b983b31c90986bda" } modify_external_catalogs: true
I20251215 14:55:05.547220 8854 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_b84b10eece664a31b983b31c90986bda" } modify_external_catalogs: true
I20251215 14:55:05.548415 9435 tablet_bootstrap.cc:492] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:05.550228 9435 tablet_bootstrap.cc:654] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:05.552182 8856 catalog_manager.cc:5487] Ignoring report from unknown tablet 80d4c9b533ac4facb4205aff84903134
I20251215 14:55:05.561514 8856 master_service.cc:954] ReplaceTablet: received request to replace tablet f9695d47e35448fdad95ff3f24bafd03 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:05.564307 8856 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_20d2c5b358444df59324e21800508f8d" } modify_external_catalogs: true
I20251215 14:55:05.564636 8856 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_20d2c5b358444df59324e21800508f8d" } modify_external_catalogs: true
I20251215 14:55:05.568253 8858 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34038:
name: "default.Table_07a3e98683664565943371f2c3fb4d65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:05.568847 8858 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07a3e98683664565943371f2c3fb4d65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:05.569429 9427 tablet_bootstrap.cc:492] T b329b0abcad742ff94c1a62a72d1b673 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:05.569607 9427 ts_tablet_manager.cc:1403] T b329b0abcad742ff94c1a62a72d1b673 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.045s user 0.008s sys 0.007s
I20251215 14:55:05.569859 9435 tablet_bootstrap.cc:492] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:05.570009 9435 ts_tablet_manager.cc:1403] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.007s
I20251215 14:55:05.570399 9427 raft_consensus.cc:359] T b329b0abcad742ff94c1a62a72d1b673 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.570616 9427 raft_consensus.cc:385] T b329b0abcad742ff94c1a62a72d1b673 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.570679 9427 raft_consensus.cc:740] T b329b0abcad742ff94c1a62a72d1b673 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.570727 9435 raft_consensus.cc:359] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.570919 9435 raft_consensus.cc:385] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.570987 9435 raft_consensus.cc:740] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.570940 9427 consensus_queue.cc:260] T b329b0abcad742ff94c1a62a72d1b673 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.571247 9435 consensus_queue.cc:260] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.574079 9435 ts_tablet_manager.cc:1434] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:05.574364 9435 tablet_bootstrap.cc:492] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:05.574373 8853 catalog_manager.cc:5487] Ignoring report from unknown tablet 26876cdffd7e4664bc8f7efb74885776
I20251215 14:55:05.575273 9626 raft_consensus.cc:493] T 44bd51f9bf77492b8890fc7c8411c887 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:05.575464 9426 tablet_bootstrap.cc:492] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:05.575443 9626 raft_consensus.cc:515] T 44bd51f9bf77492b8890fc7c8411c887 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.575644 9426 ts_tablet_manager.cc:1403] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.078s user 0.005s sys 0.001s
I20251215 14:55:05.576119 9626 leader_election.cc:290] T 44bd51f9bf77492b8890fc7c8411c887 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:05.576789 9426 raft_consensus.cc:359] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.577126 9426 raft_consensus.cc:385] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.577237 8853 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_a88c3e4ed8414aaeb07e01a30cc69f50" } modify_external_catalogs: true
I20251215 14:55:05.577301 9426 raft_consensus.cc:740] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.577452 8853 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34038:
table { table_name: "default.Table_a88c3e4ed8414aaeb07e01a30cc69f50" } modify_external_catalogs: true
I20251215 14:55:05.577757 9426 consensus_queue.cc:260] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.578492 9427 ts_tablet_manager.cc:1434] T b329b0abcad742ff94c1a62a72d1b673 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20251215 14:55:05.576874 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44bd51f9bf77492b8890fc7c8411c887" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:05.581240 9676 raft_consensus.cc:493] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:05.582952 9426 ts_tablet_manager.cc:1434] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20251215 14:55:05.583331 9676 raft_consensus.cc:515] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.584273 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44bd51f9bf77492b8890fc7c8411c887" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:05.584523 9313 raft_consensus.cc:2393] T 44bd51f9bf77492b8890fc7c8411c887 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:05.584970 8978 leader_election.cc:304] T 44bd51f9bf77492b8890fc7c8411c887 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:05.585425 9626 raft_consensus.cc:3060] T 44bd51f9bf77492b8890fc7c8411c887 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:05.585738 9678 raft_consensus.cc:493] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:05.585873 9678 raft_consensus.cc:515] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.586889 9426 tablet_bootstrap.cc:492] T 813cfeea5399457e91623fb3abf9fd32 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:05.587812 9678 leader_election.cc:290] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:05.589061 9676 leader_election.cc:290] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:05.589421 9426 tablet_bootstrap.cc:654] T 813cfeea5399457e91623fb3abf9fd32 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.590423 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b329b0abcad742ff94c1a62a72d1b673" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:05.590659 9178 raft_consensus.cc:2468] T b329b0abcad742ff94c1a62a72d1b673 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:05.591140 9435 tablet_bootstrap.cc:654] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.591361 9249 leader_election.cc:304] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:05.591842 9676 raft_consensus.cc:2804] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:05.591938 9676 raft_consensus.cc:493] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:05.591976 9626 raft_consensus.cc:2749] T 44bd51f9bf77492b8890fc7c8411c887 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:05.592029 9676 raft_consensus.cc:3060] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:05.592284 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f32a6e8df31d482fa9b9686e002d81ff" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:05.592803 9249 leader_election.cc:343] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:05.593454 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f32a6e8df31d482fa9b9686e002d81ff" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:05.594015 9248 leader_election.cc:343] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:05.594130 9248 leader_election.cc:304] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:05.594522 9678 raft_consensus.cc:2749] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:05.594817 9676 raft_consensus.cc:515] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.595371 9039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b329b0abcad742ff94c1a62a72d1b673" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:05.595605 9039 raft_consensus.cc:2468] T b329b0abcad742ff94c1a62a72d1b673 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:05.596877 9039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b329b0abcad742ff94c1a62a72d1b673" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:05.597064 9039 raft_consensus.cc:3060] T b329b0abcad742ff94c1a62a72d1b673 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:05.599952 9039 raft_consensus.cc:2468] T b329b0abcad742ff94c1a62a72d1b673 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:05.600622 9248 leader_election.cc:304] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:05.601281 9676 leader_election.cc:290] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:05.601636 9676 raft_consensus.cc:2804] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:05.602053 9676 raft_consensus.cc:697] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:05.602620 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b329b0abcad742ff94c1a62a72d1b673" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:05.602818 9180 raft_consensus.cc:3060] T b329b0abcad742ff94c1a62a72d1b673 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:05.603118 9676 consensus_queue.cc:237] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.605886 9180 raft_consensus.cc:2468] T b329b0abcad742ff94c1a62a72d1b673 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:05.609402 9426 tablet_bootstrap.cc:492] T 813cfeea5399457e91623fb3abf9fd32 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:05.610456 9426 ts_tablet_manager.cc:1403] T 813cfeea5399457e91623fb3abf9fd32 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20251215 14:55:05.610507 9427 tablet_bootstrap.cc:492] T e6aad8bed15a416a925ae8c8870d4e51 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:05.611286 9426 raft_consensus.cc:359] T 813cfeea5399457e91623fb3abf9fd32 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.611469 9426 raft_consensus.cc:385] T 813cfeea5399457e91623fb3abf9fd32 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.611574 9426 raft_consensus.cc:740] T 813cfeea5399457e91623fb3abf9fd32 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.611811 9426 consensus_queue.cc:260] T 813cfeea5399457e91623fb3abf9fd32 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.612452 9426 ts_tablet_manager.cc:1434] T 813cfeea5399457e91623fb3abf9fd32 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:05.612931 9426 tablet_bootstrap.cc:492] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:05.614568 9426 tablet_bootstrap.cc:654] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.618734 9435 tablet_bootstrap.cc:492] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:05.619132 9435 ts_tablet_manager.cc:1403] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.045s user 0.000s sys 0.005s
I20251215 14:55:05.619743 9427 tablet_bootstrap.cc:654] T e6aad8bed15a416a925ae8c8870d4e51 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.622720 9435 raft_consensus.cc:359] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.623529 9435 raft_consensus.cc:385] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.623910 9435 raft_consensus.cc:740] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.624919 9435 consensus_queue.cc:260] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.629477 9435 ts_tablet_manager.cc:1434] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.010s user 0.000s sys 0.003s
I20251215 14:55:05.629918 9426 tablet_bootstrap.cc:492] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:05.630249 9426 ts_tablet_manager.cc:1403] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.001s
I20251215 14:55:05.630929 9435 tablet_bootstrap.cc:492] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:05.631155 9426 raft_consensus.cc:359] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.631716 9426 raft_consensus.cc:385] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.631835 9426 raft_consensus.cc:740] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.632144 9426 consensus_queue.cc:260] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.637306 9435 tablet_bootstrap.cc:654] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.642779 9427 tablet_bootstrap.cc:492] T e6aad8bed15a416a925ae8c8870d4e51 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:05.643018 9427 ts_tablet_manager.cc:1403] T e6aad8bed15a416a925ae8c8870d4e51 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.001s
I20251215 14:55:05.643946 9427 raft_consensus.cc:359] T e6aad8bed15a416a925ae8c8870d4e51 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.644238 9427 raft_consensus.cc:385] T e6aad8bed15a416a925ae8c8870d4e51 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.644384 9427 raft_consensus.cc:740] T e6aad8bed15a416a925ae8c8870d4e51 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.644786 9427 consensus_queue.cc:260] T e6aad8bed15a416a925ae8c8870d4e51 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.647207 9427 ts_tablet_manager.cc:1434] T e6aad8bed15a416a925ae8c8870d4e51 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:05.647567 9427 tablet_bootstrap.cc:492] T 813cfeea5399457e91623fb3abf9fd32 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:05.651484 9427 tablet_bootstrap.cc:654] T 813cfeea5399457e91623fb3abf9fd32 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.655215 9435 tablet_bootstrap.cc:492] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:05.655539 9435 ts_tablet_manager.cc:1403] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.005s
I20251215 14:55:05.656903 9435 raft_consensus.cc:359] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.657269 9435 raft_consensus.cc:385] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.657466 9435 raft_consensus.cc:740] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.657866 9435 consensus_queue.cc:260] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.661217 9435 ts_tablet_manager.cc:1434] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20251215 14:55:05.662788 9676 raft_consensus.cc:493] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:05.662935 9676 raft_consensus.cc:515] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.663757 9676 leader_election.cc:290] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:05.664484 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "813cfeea5399457e91623fb3abf9fd32" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:05.664690 9180 raft_consensus.cc:2468] T 813cfeea5399457e91623fb3abf9fd32 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:05.664638 9039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "813cfeea5399457e91623fb3abf9fd32" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:05.665225 9249 leader_election.cc:304] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:05.662529 9435 tablet_bootstrap.cc:492] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:05.665928 9248 leader_election.cc:343] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:05.666669 9676 raft_consensus.cc:2804] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:05.666775 9676 raft_consensus.cc:493] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:05.666857 9676 raft_consensus.cc:3060] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:05.667402 9426 ts_tablet_manager.cc:1434] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.037s user 0.002s sys 0.000s
I20251215 14:55:05.667753 9426 tablet_bootstrap.cc:492] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:05.669550 9676 raft_consensus.cc:515] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.670492 9426 tablet_bootstrap.cc:654] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.671629 9039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "813cfeea5399457e91623fb3abf9fd32" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
W20251215 14:55:05.672595 9248 leader_election.cc:343] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:05.673225 9676 leader_election.cc:290] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:05.673635 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "813cfeea5399457e91623fb3abf9fd32" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:05.673810 9180 raft_consensus.cc:3060] T 813cfeea5399457e91623fb3abf9fd32 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:05.676321 9435 tablet_bootstrap.cc:654] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.676451 9180 raft_consensus.cc:2468] T 813cfeea5399457e91623fb3abf9fd32 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:05.677134 9487 rpc_server.cc:307] RPC server started. Bound to: 127.8.121.190:44279
I20251215 14:55:05.677302 9249 leader_election.cc:304] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:05.677443 9753 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.121.190:44279 every 8 connection(s)
I20251215 14:55:05.677819 9676 raft_consensus.cc:2804] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:05.678293 9676 raft_consensus.cc:697] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:05.678644 9676 consensus_queue.cc:237] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.679344 9487 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/info.pb
I20251215 14:55:05.681783 9427 tablet_bootstrap.cc:492] T 813cfeea5399457e91623fb3abf9fd32 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:05.681952 8678 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu as pid 9487
I20251215 14:55:05.682058 9427 ts_tablet_manager.cc:1403] T 813cfeea5399457e91623fb3abf9fd32 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.000s
I20251215 14:55:05.682827 9427 raft_consensus.cc:359] T 813cfeea5399457e91623fb3abf9fd32 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.683017 9427 raft_consensus.cc:385] T 813cfeea5399457e91623fb3abf9fd32 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.683079 9427 raft_consensus.cc:740] T 813cfeea5399457e91623fb3abf9fd32 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.683418 9427 consensus_queue.cc:260] T 813cfeea5399457e91623fb3abf9fd32 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.685482 9617 consensus_queue.cc:1048] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:05.686542 9427 ts_tablet_manager.cc:1434] T 813cfeea5399457e91623fb3abf9fd32 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:05.687011 9427 tablet_bootstrap.cc:492] T fc9bda52c73e4aa6b7e2eb008c63391b P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:05.694548 9427 tablet_bootstrap.cc:654] T fc9bda52c73e4aa6b7e2eb008c63391b P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.697842 9626 raft_consensus.cc:493] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:05.698014 9626 raft_consensus.cc:515] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.698714 9626 leader_election.cc:290] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:05.699244 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bdfc164128a6413a83d83d05b69fb74a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:05.699451 9314 raft_consensus.cc:2468] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:05.699558 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bdfc164128a6413a83d83d05b69fb74a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:05.699810 9180 raft_consensus.cc:2468] T bdfc164128a6413a83d83d05b69fb74a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:05.699999 8978 leader_election.cc:304] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:05.700264 9626 raft_consensus.cc:2804] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:05.700361 9626 raft_consensus.cc:493] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:05.700438 9626 raft_consensus.cc:3060] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:05.703092 9626 raft_consensus.cc:515] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.704018 9626 leader_election.cc:290] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:05.704504 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bdfc164128a6413a83d83d05b69fb74a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:05.704699 9180 raft_consensus.cc:3060] T bdfc164128a6413a83d83d05b69fb74a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:05.707945 9042 raft_consensus.cc:3060] T 2df2138e41844e9f897e57264b62cc9d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:05.708137 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bdfc164128a6413a83d83d05b69fb74a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:05.707968 9039 raft_consensus.cc:3060] T 924c9dd0cd9d40189bfe1457040f3d37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:05.708343 9314 raft_consensus.cc:3060] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:05.711050 9314 raft_consensus.cc:2468] T bdfc164128a6413a83d83d05b69fb74a P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:05.712244 9507 consensus_queue.cc:1048] T 2df2138e41844e9f897e57264b62cc9d P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:05.712780 9507 consensus_queue.cc:1048] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:05.714454 9180 raft_consensus.cc:2468] T bdfc164128a6413a83d83d05b69fb74a P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:05.715340 8976 leader_election.cc:304] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:05.716650 9626 raft_consensus.cc:2804] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:05.716987 9626 raft_consensus.cc:697] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:05.717417 9427 tablet_bootstrap.cc:492] T fc9bda52c73e4aa6b7e2eb008c63391b P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:05.717602 9427 ts_tablet_manager.cc:1403] T fc9bda52c73e4aa6b7e2eb008c63391b P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.000s
I20251215 14:55:05.717798 9626 consensus_queue.cc:237] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.720703 9427 raft_consensus.cc:359] T fc9bda52c73e4aa6b7e2eb008c63391b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.720906 9427 raft_consensus.cc:385] T fc9bda52c73e4aa6b7e2eb008c63391b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.721004 9427 raft_consensus.cc:740] T fc9bda52c73e4aa6b7e2eb008c63391b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.721915 9427 consensus_queue.cc:260] T fc9bda52c73e4aa6b7e2eb008c63391b P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.722945 9435 tablet_bootstrap.cc:492] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:05.723153 9427 ts_tablet_manager.cc:1434] T fc9bda52c73e4aa6b7e2eb008c63391b P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:05.723475 9435 ts_tablet_manager.cc:1403] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.061s user 0.006s sys 0.003s
I20251215 14:55:05.723639 9427 tablet_bootstrap.cc:492] T f32a6e8df31d482fa9b9686e002d81ff P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:05.725414 9427 tablet_bootstrap.cc:654] T f32a6e8df31d482fa9b9686e002d81ff P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.730540 9435 raft_consensus.cc:359] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.730998 9435 raft_consensus.cc:385] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.731209 9435 raft_consensus.cc:740] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.731673 9435 consensus_queue.cc:260] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.733150 9435 ts_tablet_manager.cc:1434] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.009s user 0.000s sys 0.003s
I20251215 14:55:05.733807 9435 tablet_bootstrap.cc:492] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:05.740979 9507 consensus_queue.cc:1048] T 924c9dd0cd9d40189bfe1457040f3d37 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:05.744516 9435 tablet_bootstrap.cc:654] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.753870 9427 tablet_bootstrap.cc:492] T f32a6e8df31d482fa9b9686e002d81ff P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:05.754062 9427 ts_tablet_manager.cc:1403] T f32a6e8df31d482fa9b9686e002d81ff P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20251215 14:55:05.754918 9427 raft_consensus.cc:359] T f32a6e8df31d482fa9b9686e002d81ff P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.758721 9426 tablet_bootstrap.cc:492] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:05.758939 9426 ts_tablet_manager.cc:1403] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.091s user 0.010s sys 0.000s
I20251215 14:55:05.755126 9427 raft_consensus.cc:385] T f32a6e8df31d482fa9b9686e002d81ff P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.759621 9427 raft_consensus.cc:740] T f32a6e8df31d482fa9b9686e002d81ff P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.760313 9435 tablet_bootstrap.cc:492] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:05.760481 9435 ts_tablet_manager.cc:1403] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.004s
I20251215 14:55:05.760454 9427 consensus_queue.cc:260] T f32a6e8df31d482fa9b9686e002d81ff P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.760938 9427 ts_tablet_manager.cc:1434] T f32a6e8df31d482fa9b9686e002d81ff P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20251215 14:55:05.761227 9427 tablet_bootstrap.cc:492] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:05.761175 9435 raft_consensus.cc:359] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.761358 9435 raft_consensus.cc:385] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.761416 9435 raft_consensus.cc:740] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.761636 9435 consensus_queue.cc:260] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.762107 9435 ts_tablet_manager.cc:1434] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:05.762836 9427 tablet_bootstrap.cc:654] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.763972 9435 tablet_bootstrap.cc:492] T ae8a49b9a3bf4845943b1ad8e318ccbb P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:05.765512 9435 tablet_bootstrap.cc:654] T ae8a49b9a3bf4845943b1ad8e318ccbb P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.768442 9676 raft_consensus.cc:493] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:05.768592 9676 raft_consensus.cc:515] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.770277 9676 leader_election.cc:290] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:05.770962 9039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95583eee8a5041b1ade97e8f8f0db271" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:05.771467 9248 leader_election.cc:343] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:05.779603 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95583eee8a5041b1ade97e8f8f0db271" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:05.780242 9249 leader_election.cc:343] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:05.780385 9249 leader_election.cc:304] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:05.782101 9507 consensus_queue.cc:1048] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20251215 14:55:05.787248 9426 raft_consensus.cc:359] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.787485 9426 raft_consensus.cc:385] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.787560 9761 sys_catalog.cc:263] Verifying existing consensus state
I20251215 14:55:05.787576 9426 raft_consensus.cc:740] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.787808 9426 consensus_queue.cc:260] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.789749 9426 ts_tablet_manager.cc:1434] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.031s user 0.002s sys 0.000s
I20251215 14:55:05.790064 9426 tablet_bootstrap.cc:492] T fab39532fe6a403683952057c5ccabd9 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:05.790668 9676 raft_consensus.cc:2749] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:05.792047 9426 tablet_bootstrap.cc:654] T fab39532fe6a403683952057c5ccabd9 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.804138 9435 tablet_bootstrap.cc:492] T ae8a49b9a3bf4845943b1ad8e318ccbb P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:05.804308 9435 ts_tablet_manager.cc:1403] T ae8a49b9a3bf4845943b1ad8e318ccbb P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.040s user 0.007s sys 0.004s
I20251215 14:55:05.805071 9435 raft_consensus.cc:359] T ae8a49b9a3bf4845943b1ad8e318ccbb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.805251 9435 raft_consensus.cc:385] T ae8a49b9a3bf4845943b1ad8e318ccbb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.805337 9435 raft_consensus.cc:740] T ae8a49b9a3bf4845943b1ad8e318ccbb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.807336 9435 consensus_queue.cc:260] T ae8a49b9a3bf4845943b1ad8e318ccbb P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.808454 9435 ts_tablet_manager.cc:1434] T ae8a49b9a3bf4845943b1ad8e318ccbb P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:05.809230 9435 tablet_bootstrap.cc:492] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:05.810844 9435 tablet_bootstrap.cc:654] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.817849 9088 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:05.818958 9427 tablet_bootstrap.cc:492] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:05.819145 9427 ts_tablet_manager.cc:1403] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.058s user 0.007s sys 0.008s
I20251215 14:55:05.820235 9427 raft_consensus.cc:359] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.820420 9427 raft_consensus.cc:385] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.820504 9427 raft_consensus.cc:740] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.820791 9427 consensus_queue.cc:260] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.826567 9361 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:05.834897 9676 raft_consensus.cc:493] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:05.835105 9676 raft_consensus.cc:515] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.835781 9676 leader_election.cc:290] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:05.836776 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc9bda52c73e4aa6b7e2eb008c63391b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:05.837009 9042 raft_consensus.cc:2468] T fc9bda52c73e4aa6b7e2eb008c63391b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:05.837306 9781 raft_consensus.cc:493] T 813cfeea5399457e91623fb3abf9fd32 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:05.837548 9248 leader_election.cc:304] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:05.837620 9781 raft_consensus.cc:515] T 813cfeea5399457e91623fb3abf9fd32 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:05.838199 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc9bda52c73e4aa6b7e2eb008c63391b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:05.838450 9180 raft_consensus.cc:2468] T fc9bda52c73e4aa6b7e2eb008c63391b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:05.839335 9676 raft_consensus.cc:2804] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:05.839432 9676 raft_consensus.cc:493] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:05.839541 9676 raft_consensus.cc:3060] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:05.842262 9427 ts_tablet_manager.cc:1434] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.023s user 0.001s sys 0.005s
I20251215 14:55:05.842623 9676 raft_consensus.cc:515] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.842839 9427 tablet_bootstrap.cc:492] T fab39532fe6a403683952057c5ccabd9 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:05.842947 9507 consensus_queue.cc:1048] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:05.844461 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc9bda52c73e4aa6b7e2eb008c63391b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:05.844683 9042 raft_consensus.cc:3060] T fc9bda52c73e4aa6b7e2eb008c63391b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:05.844821 9427 tablet_bootstrap.cc:654] T fab39532fe6a403683952057c5ccabd9 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.847873 9042 raft_consensus.cc:2468] T fc9bda52c73e4aa6b7e2eb008c63391b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:05.848608 9248 leader_election.cc:304] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:05.848958 9678 raft_consensus.cc:2804] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:05.849093 9678 raft_consensus.cc:697] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:05.849395 9678 consensus_queue.cc:237] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.849756 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc9bda52c73e4aa6b7e2eb008c63391b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:05.849956 9180 raft_consensus.cc:3060] T fc9bda52c73e4aa6b7e2eb008c63391b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:05.852778 9180 raft_consensus.cc:2468] T fc9bda52c73e4aa6b7e2eb008c63391b P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:05.853236 9427 tablet_bootstrap.cc:492] T fab39532fe6a403683952057c5ccabd9 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:05.853459 9427 ts_tablet_manager.cc:1403] T fab39532fe6a403683952057c5ccabd9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.002s
I20251215 14:55:05.853657 9676 leader_election.cc:290] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:05.854463 9427 raft_consensus.cc:359] T fab39532fe6a403683952057c5ccabd9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.854734 9427 raft_consensus.cc:385] T fab39532fe6a403683952057c5ccabd9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.854813 9427 raft_consensus.cc:740] T fab39532fe6a403683952057c5ccabd9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.855099 9427 consensus_queue.cc:260] T fab39532fe6a403683952057c5ccabd9 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.870980 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "813cfeea5399457e91623fb3abf9fd32" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:05.871289 9180 raft_consensus.cc:2393] T 813cfeea5399457e91623fb3abf9fd32 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:05.873489 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "813cfeea5399457e91623fb3abf9fd32" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:05.874127 8978 leader_election.cc:304] T 813cfeea5399457e91623fb3abf9fd32 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:05.874469 9669 raft_consensus.cc:3060] T 813cfeea5399457e91623fb3abf9fd32 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:05.875749 9427 ts_tablet_manager.cc:1434] T fab39532fe6a403683952057c5ccabd9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20251215 14:55:05.876107 9427 tablet_bootstrap.cc:492] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:05.878793 9781 leader_election.cc:290] T 813cfeea5399457e91623fb3abf9fd32 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:05.879364 9226 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:05.882134 9426 tablet_bootstrap.cc:492] T fab39532fe6a403683952057c5ccabd9 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:05.882313 9426 ts_tablet_manager.cc:1403] T fab39532fe6a403683952057c5ccabd9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.092s user 0.010s sys 0.009s
I20251215 14:55:05.883244 9426 raft_consensus.cc:359] T fab39532fe6a403683952057c5ccabd9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.883442 9426 raft_consensus.cc:385] T fab39532fe6a403683952057c5ccabd9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.883522 9426 raft_consensus.cc:740] T fab39532fe6a403683952057c5ccabd9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.883944 9426 consensus_queue.cc:260] T fab39532fe6a403683952057c5ccabd9 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.884670 9426 ts_tablet_manager.cc:1434] T fab39532fe6a403683952057c5ccabd9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:05.885331 9426 tablet_bootstrap.cc:492] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:05.886822 9427 tablet_bootstrap.cc:654] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.887012 9226 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:05.892431 9669 raft_consensus.cc:2749] T 813cfeea5399457e91623fb3abf9fd32 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:05.904320 9426 tablet_bootstrap.cc:654] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.901706 9761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Bootstrap starting.
I20251215 14:55:05.907370 9435 tablet_bootstrap.cc:492] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:05.907553 9435 ts_tablet_manager.cc:1403] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.098s user 0.016s sys 0.016s
I20251215 14:55:05.908586 9427 tablet_bootstrap.cc:492] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:05.908744 9427 ts_tablet_manager.cc:1403] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s
I20251215 14:55:05.908656 9435 raft_consensus.cc:359] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.908874 9435 raft_consensus.cc:385] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.908957 9435 raft_consensus.cc:740] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.909180 9435 consensus_queue.cc:260] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.910912 9435 ts_tablet_manager.cc:1434] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:05.911235 9435 tablet_bootstrap.cc:492] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:05.912511 9427 raft_consensus.cc:359] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.912708 9427 raft_consensus.cc:385] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.912796 9427 raft_consensus.cc:740] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.912869 9435 tablet_bootstrap.cc:654] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.913046 9427 consensus_queue.cc:260] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.913563 9427 ts_tablet_manager.cc:1434] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:05.913841 9427 tablet_bootstrap.cc:492] T 0db6246dee2643d98094408410618259 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:05.923861 9427 tablet_bootstrap.cc:654] T 0db6246dee2643d98094408410618259 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.925179 9615 consensus_queue.cc:1048] T 44bd51f9bf77492b8890fc7c8411c887 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:05.930181 9427 tablet_bootstrap.cc:492] T 0db6246dee2643d98094408410618259 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:05.930352 9427 ts_tablet_manager.cc:1403] T 0db6246dee2643d98094408410618259 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20251215 14:55:05.931069 9427 raft_consensus.cc:359] T 0db6246dee2643d98094408410618259 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.931298 9427 raft_consensus.cc:385] T 0db6246dee2643d98094408410618259 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.931375 9427 raft_consensus.cc:740] T 0db6246dee2643d98094408410618259 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.936192 9427 consensus_queue.cc:260] T 0db6246dee2643d98094408410618259 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.937160 9426 tablet_bootstrap.cc:492] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:05.937342 9426 ts_tablet_manager.cc:1403] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.052s user 0.005s sys 0.000s
I20251215 14:55:05.938345 9426 raft_consensus.cc:359] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.938933 9426 raft_consensus.cc:385] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.939023 9426 raft_consensus.cc:740] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.939229 9426 consensus_queue.cc:260] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.939698 9426 ts_tablet_manager.cc:1434] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:05.939987 9426 tablet_bootstrap.cc:492] T 26876cdffd7e4664bc8f7efb74885776 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:05.942900 9426 tablet_bootstrap.cc:654] T 26876cdffd7e4664bc8f7efb74885776 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.945037 9435 tablet_bootstrap.cc:492] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:05.945191 9435 ts_tablet_manager.cc:1403] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.034s user 0.008s sys 0.006s
I20251215 14:55:05.944665 9427 ts_tablet_manager.cc:1434] T 0db6246dee2643d98094408410618259 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20251215 14:55:05.946067 9427 tablet_bootstrap.cc:492] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:05.945969 9435 raft_consensus.cc:359] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.946134 9435 raft_consensus.cc:385] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.946221 9435 raft_consensus.cc:740] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.946465 9435 consensus_queue.cc:260] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.948690 9361 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:05.948884 9435 ts_tablet_manager.cc:1434] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:05.949384 9435 tablet_bootstrap.cc:492] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:05.952939 9427 tablet_bootstrap.cc:654] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.952936 9435 tablet_bootstrap.cc:654] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.960037 9426 tablet_bootstrap.cc:492] T 26876cdffd7e4664bc8f7efb74885776 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:05.960230 9426 ts_tablet_manager.cc:1403] T 26876cdffd7e4664bc8f7efb74885776 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20251215 14:55:05.961004 9426 raft_consensus.cc:359] T 26876cdffd7e4664bc8f7efb74885776 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.961195 9426 raft_consensus.cc:385] T 26876cdffd7e4664bc8f7efb74885776 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.961270 9426 raft_consensus.cc:740] T 26876cdffd7e4664bc8f7efb74885776 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.961505 9426 consensus_queue.cc:260] T 26876cdffd7e4664bc8f7efb74885776 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.962111 9426 ts_tablet_manager.cc:1434] T 26876cdffd7e4664bc8f7efb74885776 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:05.963722 9427 tablet_bootstrap.cc:492] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:05.963865 9427 ts_tablet_manager.cc:1403] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20251215 14:55:05.964578 9427 raft_consensus.cc:359] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.964753 9427 raft_consensus.cc:385] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.964839 9427 raft_consensus.cc:740] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.965065 9427 consensus_queue.cc:260] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.965576 9427 ts_tablet_manager.cc:1434] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:05.965940 9427 tablet_bootstrap.cc:492] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:05.966477 9761 log.cc:826] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Log is configured to *not* fsync() on all Append() calls
I20251215 14:55:05.967623 9427 tablet_bootstrap.cc:654] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.975870 9426 tablet_bootstrap.cc:492] T 0db6246dee2643d98094408410618259 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:05.977664 9426 tablet_bootstrap.cc:654] T 0db6246dee2643d98094408410618259 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.978977 9427 tablet_bootstrap.cc:492] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:05.979156 9427 ts_tablet_manager.cc:1403] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20251215 14:55:05.981709 9435 tablet_bootstrap.cc:492] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:05.981894 9435 ts_tablet_manager.cc:1403] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.033s user 0.008s sys 0.004s
I20251215 14:55:05.982654 9435 raft_consensus.cc:359] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.982861 9435 raft_consensus.cc:385] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.982942 9435 raft_consensus.cc:740] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.983222 9435 consensus_queue.cc:260] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.988934 9435 ts_tablet_manager.cc:1434] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20251215 14:55:05.989302 9435 tablet_bootstrap.cc:492] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:05.991812 9427 raft_consensus.cc:359] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.992055 9427 raft_consensus.cc:385] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:05.992141 9427 raft_consensus.cc:740] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:05.993462 9427 consensus_queue.cc:260] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:05.994141 9427 ts_tablet_manager.cc:1434] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20251215 14:55:05.994475 9427 tablet_bootstrap.cc:492] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:05.996408 9427 tablet_bootstrap.cc:654] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:05.996569 9435 tablet_bootstrap.cc:654] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.006397 9761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=15 ignored=0} inserts{seen=23 ignored=0} mutations{seen=1 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251215 14:55:06.007117 9761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Bootstrap complete.
I20251215 14:55:06.008159 9435 tablet_bootstrap.cc:492] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.008337 9435 ts_tablet_manager.cc:1403] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.001s
I20251215 14:55:06.009114 9435 raft_consensus.cc:359] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.009303 9435 raft_consensus.cc:385] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.009395 9435 raft_consensus.cc:740] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.009617 9435 consensus_queue.cc:260] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.009675 9088 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:06.010133 9435 ts_tablet_manager.cc:1434] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:06.010439 9435 tablet_bootstrap.cc:492] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.010489 9427 tablet_bootstrap.cc:492] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:06.010649 9427 ts_tablet_manager.cc:1403] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.000s
I20251215 14:55:06.011433 9427 raft_consensus.cc:359] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.011617 9427 raft_consensus.cc:385] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.011708 9427 raft_consensus.cc:740] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.011933 9427 consensus_queue.cc:260] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.012369 9427 ts_tablet_manager.cc:1434] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:06.012706 9427 tablet_bootstrap.cc:492] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:06.014457 9427 tablet_bootstrap.cc:654] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.014870 9678 raft_consensus.cc:493] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.015043 9678 raft_consensus.cc:515] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.015658 9678 leader_election.cc:290] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:06.016304 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0db6246dee2643d98094408410618259" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:06.016448 9426 tablet_bootstrap.cc:492] T 0db6246dee2643d98094408410618259 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.016621 9426 ts_tablet_manager.cc:1403] T 0db6246dee2643d98094408410618259 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.007s
I20251215 14:55:06.017094 9039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0db6246dee2643d98094408410618259" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.017179 9435 tablet_bootstrap.cc:654] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.017334 9039 raft_consensus.cc:2468] T 0db6246dee2643d98094408410618259 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
W20251215 14:55:06.017478 9249 leader_election.cc:343] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.017486 9426 raft_consensus.cc:359] T 0db6246dee2643d98094408410618259 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.017691 9426 raft_consensus.cc:385] T 0db6246dee2643d98094408410618259 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.017787 9426 raft_consensus.cc:740] T 0db6246dee2643d98094408410618259 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.017871 9248 leader_election.cc:304] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:06.018013 9426 consensus_queue.cc:260] T 0db6246dee2643d98094408410618259 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.018360 9678 raft_consensus.cc:2804] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.018455 9678 raft_consensus.cc:493] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.018555 9678 raft_consensus.cc:3060] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.020241 9426 ts_tablet_manager.cc:1434] T 0db6246dee2643d98094408410618259 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:06.020579 9426 tablet_bootstrap.cc:492] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.021337 9678 raft_consensus.cc:515] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.022653 9426 tablet_bootstrap.cc:654] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.022653 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0db6246dee2643d98094408410618259" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:06.022965 9180 raft_consensus.cc:3060] T 0db6246dee2643d98094408410618259 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.026063 9180 raft_consensus.cc:2468] T 0db6246dee2643d98094408410618259 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:06.027653 9676 raft_consensus.cc:493] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.027823 9676 raft_consensus.cc:515] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.028429 9676 leader_election.cc:290] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:06.029224 9039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fab39532fe6a403683952057c5ccabd9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.029438 9039 raft_consensus.cc:2468] T fab39532fe6a403683952057c5ccabd9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:06.029551 9249 leader_election.cc:304] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.030159 9676 raft_consensus.cc:2804] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.030292 9676 raft_consensus.cc:697] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:06.030572 9676 consensus_queue.cc:237] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.031103 9800 raft_consensus.cc:493] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1f310d741d8247488792985606a1c19e)
I20251215 14:55:06.031421 9800 raft_consensus.cc:515] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:06.032130 9248 leader_election.cc:304] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.032429 9675 raft_consensus.cc:2804] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.032531 9675 raft_consensus.cc:493] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.032613 9675 raft_consensus.cc:3060] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.035218 9675 raft_consensus.cc:515] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.035825 9675 leader_election.cc:290] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:06.036665 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fab39532fe6a403683952057c5ccabd9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:06.036813 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fab39532fe6a403683952057c5ccabd9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:06.036927 9178 raft_consensus.cc:3060] T fab39532fe6a403683952057c5ccabd9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.037004 9039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fab39532fe6a403683952057c5ccabd9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.037177 9039 raft_consensus.cc:3060] T fab39532fe6a403683952057c5ccabd9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.037950 9678 leader_election.cc:290] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:06.039062 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0db6246dee2643d98094408410618259" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.039263 9042 raft_consensus.cc:3060] T 0db6246dee2643d98094408410618259 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.039810 9178 raft_consensus.cc:2468] T fab39532fe6a403683952057c5ccabd9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:06.039968 9039 raft_consensus.cc:2468] T fab39532fe6a403683952057c5ccabd9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:06.040865 9427 tablet_bootstrap.cc:492] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:06.041402 9427 ts_tablet_manager.cc:1403] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.029s user 0.006s sys 0.000s
I20251215 14:55:06.042084 9042 raft_consensus.cc:2468] T 0db6246dee2643d98094408410618259 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:06.042461 9669 raft_consensus.cc:493] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.042595 9669 raft_consensus.cc:515] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.043248 9669 leader_election.cc:290] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.043639 9426 tablet_bootstrap.cc:492] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.043825 9426 ts_tablet_manager.cc:1403] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.003s
I20251215 14:55:06.043958 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae8a49b9a3bf4845943b1ad8e318ccbb" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:06.043982 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae8a49b9a3bf4845943b1ad8e318ccbb" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.044178 9314 raft_consensus.cc:2468] T ae8a49b9a3bf4845943b1ad8e318ccbb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
W20251215 14:55:06.044481 8976 leader_election.cc:343] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.044764 9426 raft_consensus.cc:359] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.044965 9426 raft_consensus.cc:385] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.045042 9426 raft_consensus.cc:740] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.045135 8978 leader_election.cc:304] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:06.045264 9426 consensus_queue.cc:260] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.045336 9249 leader_election.cc:304] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.045671 9669 raft_consensus.cc:2804] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.045791 9669 raft_consensus.cc:493] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.045846 9675 raft_consensus.cc:2804] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.045876 9669 raft_consensus.cc:3060] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.045990 9675 raft_consensus.cc:697] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:06.046279 9675 consensus_queue.cc:237] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.048592 9435 tablet_bootstrap.cc:492] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.048770 9435 ts_tablet_manager.cc:1403] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.006s
I20251215 14:55:06.049600 9435 raft_consensus.cc:359] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.049806 9435 raft_consensus.cc:385] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.049890 9435 raft_consensus.cc:740] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.050149 9435 consensus_queue.cc:260] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.050045 9669 raft_consensus.cc:515] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.050626 9507 raft_consensus.cc:493] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.050796 9507 raft_consensus.cc:515] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:06.050980 9426 ts_tablet_manager.cc:1434] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20251215 14:55:06.033219 9800 leader_election.cc:290] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cad1fca07ac7419cb608c21541f672f3 (127.8.121.190:44279), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:06.051429 9426 tablet_bootstrap.cc:492] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.050522 9761 raft_consensus.cc:359] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:06.051502 9507 leader_election.cc:290] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.052507 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92e21a77ad074572a57b836743903a0b" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.052708 9314 raft_consensus.cc:2468] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:06.053130 9426 tablet_bootstrap.cc:654] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.053164 9115 leader_election.cc:304] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.054172 9507 raft_consensus.cc:2804] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.054276 9507 raft_consensus.cc:493] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.054353 9507 raft_consensus.cc:3060] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.057085 9507 raft_consensus.cc:515] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:06.053941 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92e21a77ad074572a57b836743903a0b" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.054064 9427 raft_consensus.cc:359] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.058430 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92e21a77ad074572a57b836743903a0b" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.058471 9427 raft_consensus.cc:385] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.058509 9041 raft_consensus.cc:2468] T 92e21a77ad074572a57b836743903a0b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:06.058599 9427 raft_consensus.cc:740] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.058837 9427 consensus_queue.cc:260] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.059449 9427 ts_tablet_manager.cc:1434] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20251215 14:55:06.059768 9427 tablet_bootstrap.cc:492] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:06.061395 9761 raft_consensus.cc:740] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cad1fca07ac7419cb608c21541f672f3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.061483 9427 tablet_bootstrap.cc:654] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.061450 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92e21a77ad074572a57b836743903a0b" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:06.061633 9314 raft_consensus.cc:3060] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.062434 9761 consensus_queue.cc:260] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 1.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:06.062659 9435 ts_tablet_manager.cc:1434] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20251215 14:55:06.063005 9435 tablet_bootstrap.cc:492] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.063390 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae8a49b9a3bf4845943b1ad8e318ccbb" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:06.063874 8976 leader_election.cc:343] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.066592 9426 tablet_bootstrap.cc:492] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.066763 9426 ts_tablet_manager.cc:1403] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20251215 14:55:06.067621 9314 raft_consensus.cc:2468] T 92e21a77ad074572a57b836743903a0b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:06.067560 9426 raft_consensus.cc:359] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.067766 9426 raft_consensus.cc:385] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.067909 9426 raft_consensus.cc:740] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.068240 9426 consensus_queue.cc:260] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.068336 9115 leader_election.cc:304] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:06.068789 9615 raft_consensus.cc:2804] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.068985 9426 ts_tablet_manager.cc:1434] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20251215 14:55:06.069255 9426 tablet_bootstrap.cc:492] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.072307 9811 sys_catalog.cc:455] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:55:06.072934 9435 tablet_bootstrap.cc:654] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.074369 9507 leader_election.cc:290] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.075788 9426 tablet_bootstrap.cc:654] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.075883 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae8a49b9a3bf4845943b1ad8e318ccbb" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:06.076227 9427 tablet_bootstrap.cc:492] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:06.076390 9427 ts_tablet_manager.cc:1403] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.000s
I20251215 14:55:06.076452 8869 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "40747def373e4b19abfa5d21ba0a4315" candidate_term: 2 candidate_status { last_received { term: 1 index: 364 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:06.076610 9435 tablet_bootstrap.cc:492] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.076752 9435 ts_tablet_manager.cc:1403] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20251215 14:55:06.077210 9427 raft_consensus.cc:359] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.077405 9427 raft_consensus.cc:385] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.077494 9427 raft_consensus.cc:740] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.077585 9435 raft_consensus.cc:359] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.077769 9435 raft_consensus.cc:385] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.077739 9427 consensus_queue.cc:260] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.077864 9435 raft_consensus.cc:740] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.078081 9435 consensus_queue.cc:260] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.078372 9427 ts_tablet_manager.cc:1434] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:06.078625 9435 ts_tablet_manager.cc:1434] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:06.078656 9427 tablet_bootstrap.cc:492] T 26876cdffd7e4664bc8f7efb74885776 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:06.079921 9435 tablet_bootstrap.cc:492] T df70bebdc8ad4f8186ba427e840799cf P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.076440 9669 leader_election.cc:290] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.081120 9427 tablet_bootstrap.cc:654] T 26876cdffd7e4664bc8f7efb74885776 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.081382 9811 sys_catalog.cc:458] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: This master's current role is: FOLLOWER
I20251215 14:55:06.074572 9761 sys_catalog.cc:565] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: configured and running, proceeding with master startup.
I20251215 14:55:06.081115 9314 raft_consensus.cc:3060] T ae8a49b9a3bf4845943b1ad8e318ccbb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.086513 9435 tablet_bootstrap.cc:654] T df70bebdc8ad4f8186ba427e840799cf P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.089505 9714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "40747def373e4b19abfa5d21ba0a4315" candidate_term: 2 candidate_status { last_received { term: 1 index: 364 } } ignore_live_leader: false dest_uuid: "cad1fca07ac7419cb608c21541f672f3" is_pre_election: true
I20251215 14:55:06.090181 9714 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40747def373e4b19abfa5d21ba0a4315 in term 1.
I20251215 14:55:06.092406 8772 leader_election.cc:304] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40747def373e4b19abfa5d21ba0a4315, cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e
I20251215 14:55:06.092867 9800 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 14:55:06.093030 9800 raft_consensus.cc:493] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1f310d741d8247488792985606a1c19e)
I20251215 14:55:06.093138 9800 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:06.100734 9800 raft_consensus.cc:515] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:06.101666 9800 leader_election.cc:290] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [CANDIDATE]: Term 2 election: Requested vote from peers cad1fca07ac7419cb608c21541f672f3 (127.8.121.190:44279), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:06.102424 9714 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "40747def373e4b19abfa5d21ba0a4315" candidate_term: 2 candidate_status { last_received { term: 1 index: 364 } } ignore_live_leader: false dest_uuid: "cad1fca07ac7419cb608c21541f672f3"
I20251215 14:55:06.102669 8869 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "40747def373e4b19abfa5d21ba0a4315" candidate_term: 2 candidate_status { last_received { term: 1 index: 364 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e"
I20251215 14:55:06.102638 9714 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:06.107508 9314 raft_consensus.cc:2468] T ae8a49b9a3bf4845943b1ad8e318ccbb P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:06.108234 9714 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40747def373e4b19abfa5d21ba0a4315 in term 2.
I20251215 14:55:06.108852 8772 leader_election.cc:304] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40747def373e4b19abfa5d21ba0a4315, cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e
I20251215 14:55:06.110044 9800 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 14:55:06.111560 9800 raft_consensus.cc:697] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [term 2 LEADER]: Becoming Leader. State: Replica: 40747def373e4b19abfa5d21ba0a4315, State: Running, Role: LEADER
I20251215 14:55:06.112107 9800 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 364, Committed index: 364, Last appended: 1.364, Last appended by leader: 364, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:06.115885 9818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40747def373e4b19abfa5d21ba0a4315. Latest consensus state: current_term: 2 leader_uuid: "40747def373e4b19abfa5d21ba0a4315" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:55:06.116267 9818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [sys.catalog]: This master's current role is: LEADER
I20251215 14:55:06.120834 9435 tablet_bootstrap.cc:492] T df70bebdc8ad4f8186ba427e840799cf P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.121026 9435 ts_tablet_manager.cc:1403] T df70bebdc8ad4f8186ba427e840799cf P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.003s
I20251215 14:55:06.121569 8978 leader_election.cc:304] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:06.121902 9435 raft_consensus.cc:359] T df70bebdc8ad4f8186ba427e840799cf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.122080 9669 raft_consensus.cc:2804] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.122115 9435 raft_consensus.cc:385] T df70bebdc8ad4f8186ba427e840799cf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.122179 9435 raft_consensus.cc:740] T df70bebdc8ad4f8186ba427e840799cf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.122237 9669 raft_consensus.cc:697] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:06.122426 9435 consensus_queue.cc:260] T df70bebdc8ad4f8186ba427e840799cf P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.122489 9669 consensus_queue.cc:237] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.124058 9435 ts_tablet_manager.cc:1434] T df70bebdc8ad4f8186ba427e840799cf P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:06.125710 9361 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:06.126585 9435 tablet_bootstrap.cc:492] T 32432afc6e8d458bb7ed7abc42fb3dde P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.128556 9435 tablet_bootstrap.cc:654] T 32432afc6e8d458bb7ed7abc42fb3dde P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.129480 9819 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251215 14:55:06.136704 9426 tablet_bootstrap.cc:492] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.136955 9426 ts_tablet_manager.cc:1403] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.068s user 0.024s sys 0.019s
I20251215 14:55:06.137835 9426 raft_consensus.cc:359] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.138109 9426 raft_consensus.cc:385] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.138231 9426 raft_consensus.cc:740] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.138963 9427 tablet_bootstrap.cc:492] T 26876cdffd7e4664bc8f7efb74885776 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:06.139120 9427 ts_tablet_manager.cc:1403] T 26876cdffd7e4664bc8f7efb74885776 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.061s user 0.004s sys 0.013s
I20251215 14:55:06.139786 9427 raft_consensus.cc:359] T 26876cdffd7e4664bc8f7efb74885776 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.139935 9615 raft_consensus.cc:697] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:06.140015 9427 raft_consensus.cc:385] T 26876cdffd7e4664bc8f7efb74885776 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.140087 9427 raft_consensus.cc:740] T 26876cdffd7e4664bc8f7efb74885776 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.140205 9426 consensus_queue.cc:260] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.140336 9427 consensus_queue.cc:260] T 26876cdffd7e4664bc8f7efb74885776 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.140882 9427 ts_tablet_manager.cc:1434] T 26876cdffd7e4664bc8f7efb74885776 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251215 14:55:06.140427 9615 consensus_queue.cc:237] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:06.142009 9426 ts_tablet_manager.cc:1434] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:06.142416 9426 tablet_bootstrap.cc:492] T 7f38c44dbc884d74a61c7ed98deaf6aa P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.144277 9426 tablet_bootstrap.cc:654] T 7f38c44dbc884d74a61c7ed98deaf6aa P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.146059 9427 tablet_bootstrap.cc:492] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:06.146766 9435 tablet_bootstrap.cc:492] T 32432afc6e8d458bb7ed7abc42fb3dde P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.146934 9435 ts_tablet_manager.cc:1403] T 32432afc6e8d458bb7ed7abc42fb3dde P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20251215 14:55:06.147889 9427 tablet_bootstrap.cc:654] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.147805 9435 raft_consensus.cc:359] T 32432afc6e8d458bb7ed7abc42fb3dde P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.148008 9435 raft_consensus.cc:385] T 32432afc6e8d458bb7ed7abc42fb3dde P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.148116 9435 raft_consensus.cc:740] T 32432afc6e8d458bb7ed7abc42fb3dde P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.150429 9427 tablet_bootstrap.cc:492] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:06.150601 9427 ts_tablet_manager.cc:1403] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20251215 14:55:06.151602 9435 consensus_queue.cc:260] T 32432afc6e8d458bb7ed7abc42fb3dde P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.152873 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_a1f54fa8891f477eac38ebab96c6df39 [id=00e923cf937e4af19387ece153f163ba]
I20251215 14:55:06.155998 9615 raft_consensus.cc:493] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.156273 9615 raft_consensus.cc:515] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.156673 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_fb8fb745144644eea96b20d598f52fa2 [id=02a2b4848c874afe8f9860eee9bc6ce7]
I20251215 14:55:06.157160 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f]
W20251215 14:55:06.158391 9115 leader_election.cc:343] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: d922d7b24dbd474cbee47c72f2779a07
I20251215 14:55:06.158710 9615 leader_election.cc:290] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.160701 9426 tablet_bootstrap.cc:492] T 7f38c44dbc884d74a61c7ed98deaf6aa P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.160840 9426 ts_tablet_manager.cc:1403] T 7f38c44dbc884d74a61c7ed98deaf6aa P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.000s
I20251215 14:55:06.161652 9426 raft_consensus.cc:359] T 7f38c44dbc884d74a61c7ed98deaf6aa P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.161847 9426 raft_consensus.cc:385] T 7f38c44dbc884d74a61c7ed98deaf6aa P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.161931 9426 raft_consensus.cc:740] T 7f38c44dbc884d74a61c7ed98deaf6aa P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.162127 9426 consensus_queue.cc:260] T 7f38c44dbc884d74a61c7ed98deaf6aa P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.162643 9426 ts_tablet_manager.cc:1434] T 7f38c44dbc884d74a61c7ed98deaf6aa P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:06.162918 9426 tablet_bootstrap.cc:492] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.164521 9426 tablet_bootstrap.cc:654] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.164880 9676 raft_consensus.cc:493] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.165058 9676 raft_consensus.cc:515] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.165362 9678 raft_consensus.cc:493] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.165546 9678 raft_consensus.cc:515] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.166163 9678 leader_election.cc:290] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:06.166451 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a597fd6c7c044228ffb2a5a5f924e70" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:06.167475 9249 leader_election.cc:343] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.167951 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16edd0bfd67848e688fa12d9c679fdac" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:06.168022 9676 leader_election.cc:290] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:06.168054 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d [id=066e8ae14004436cb8b4f3f740b45b19]
I20251215 14:55:06.168192 9435 ts_tablet_manager.cc:1434] T 32432afc6e8d458bb7ed7abc42fb3dde P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.021s user 0.000s sys 0.003s
W20251215 14:55:06.168627 9249 leader_election.cc:343] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.168707 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_e06edd0b78e6468ebf09728e684489da [id=08069854f54c40f7be88313791a1de21]
I20251215 14:55:06.170387 9435 tablet_bootstrap.cc:492] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.171542 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_f4e69462c1fa42df8f9776f053474a93 [id=0bb5128a11484a1d8c056985720b1a5d]
I20251215 14:55:06.172293 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_f416fea67a974ab084b7b48a60426131 [id=0e3677e1f3d048ecad508d50304ee56a]
I20251215 14:55:06.173295 9435 tablet_bootstrap.cc:654] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.175045 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_bec53ce4c0c04be8bb0aabb4ce60974b [id=0ed94690124e4fd7a23a6ddf2291c6d6]
I20251215 14:55:06.177161 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_baa5664946144147bafee4511b30105f [id=15ddee7fbd5047caad852f1a4c453515]
I20251215 14:55:06.177964 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_9fff09bdf4114198810006599bcf1f3d [id=1a10676eee8b47098cf45bee49e3f502]
I20251215 14:55:06.178277 9669 consensus_queue.cc:1048] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 14:55:06.178987 9435 tablet_bootstrap.cc:492] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.179070 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16edd0bfd67848e688fa12d9c679fdac" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.179205 9435 ts_tablet_manager.cc:1403] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.002s
W20251215 14:55:06.179988 9248 leader_election.cc:343] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.180136 9248 leader_election.cc:304] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:06.180788 9676 raft_consensus.cc:2749] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:06.181314 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a597fd6c7c044228ffb2a5a5f924e70" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.181519 9042 raft_consensus.cc:2468] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:06.181416 9435 raft_consensus.cc:359] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.181854 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d922d7b24dbd474cbee47c72f2779a07" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.181921 9248 leader_election.cc:304] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:06.182034 9041 raft_consensus.cc:2468] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:06.182461 9676 raft_consensus.cc:2804] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.182402 9427 raft_consensus.cc:359] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.182585 9676 raft_consensus.cc:493] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.182631 9427 raft_consensus.cc:385] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.182668 9676 raft_consensus.cc:3060] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.182719 9427 raft_consensus.cc:740] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.182950 9427 consensus_queue.cc:260] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.183255 9112 leader_election.cc:304] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters: e89303a500544272b601d7c29be802b4
I20251215 14:55:06.184152 9615 raft_consensus.cc:2804] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.184247 9615 raft_consensus.cc:493] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.184331 9615 raft_consensus.cc:3060] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.185238 9427 ts_tablet_manager.cc:1434] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.035s user 0.002s sys 0.000s
I20251215 14:55:06.185601 9427 tablet_bootstrap.cc:492] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:06.185541 9676 raft_consensus.cc:515] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.187047 9676 leader_election.cc:290] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:06.187398 9435 raft_consensus.cc:385] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.187496 9435 raft_consensus.cc:740] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.187469 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a597fd6c7c044228ffb2a5a5f924e70" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:06.188026 9249 leader_election.cc:343] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.188632 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a597fd6c7c044228ffb2a5a5f924e70" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.188817 9041 raft_consensus.cc:3060] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.187058 9615 raft_consensus.cc:515] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.190637 9435 consensus_queue.cc:260] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.191566 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d922d7b24dbd474cbee47c72f2779a07" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.191758 9042 raft_consensus.cc:3060] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:06.192294 9115 leader_election.cc:343] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: d922d7b24dbd474cbee47c72f2779a07
I20251215 14:55:06.192633 9615 leader_election.cc:290] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.193203 9435 ts_tablet_manager.cc:1434] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.014s user 0.000s sys 0.002s
I20251215 14:55:06.193471 9669 raft_consensus.cc:493] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.193545 9435 tablet_bootstrap.cc:492] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.193615 9669 raft_consensus.cc:515] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.194211 9669 leader_election.cc:290] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.194260 9042 raft_consensus.cc:2468] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:06.195114 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9425749d471f4f95bbae030977e278e4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:06.195268 9435 tablet_bootstrap.cc:654] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.195549 9112 leader_election.cc:304] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters: e89303a500544272b601d7c29be802b4
I20251215 14:55:06.196074 9812 raft_consensus.cc:2804] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.196198 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9425749d471f4f95bbae030977e278e4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.196230 9812 raft_consensus.cc:697] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:06.196532 9812 consensus_queue.cc:237] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:06.196990 8976 leader_election.cc:343] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:06.197423 8978 leader_election.cc:343] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.197522 8978 leader_election.cc:304] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:06.197909 9669 raft_consensus.cc:2749] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:06.201637 9041 raft_consensus.cc:2468] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:06.201663 9782 consensus_queue.cc:1048] T f9695d47e35448fdad95ff3f24bafd03 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:06.202477 9248 leader_election.cc:304] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:06.203183 9678 raft_consensus.cc:2804] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.203305 9678 raft_consensus.cc:697] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:06.203532 9678 consensus_queue.cc:237] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.205739 9226 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:06.207329 9427 tablet_bootstrap.cc:654] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.212762 9435 tablet_bootstrap.cc:492] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.212929 9435 ts_tablet_manager.cc:1403] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.006s
I20251215 14:55:06.213783 9435 raft_consensus.cc:359] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.213976 9435 raft_consensus.cc:385] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.214066 9435 raft_consensus.cc:740] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.217841 9435 consensus_queue.cc:260] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.218528 9435 ts_tablet_manager.cc:1434] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20251215 14:55:06.218859 9435 tablet_bootstrap.cc:492] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.221009 9426 tablet_bootstrap.cc:492] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.221223 9426 ts_tablet_manager.cc:1403] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.058s user 0.008s sys 0.022s
I20251215 14:55:06.221468 9435 tablet_bootstrap.cc:654] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.229561 9435 tablet_bootstrap.cc:492] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.229830 9435 ts_tablet_manager.cc:1403] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20251215 14:55:06.230816 9435 raft_consensus.cc:359] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.231071 9435 raft_consensus.cc:385] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.231187 9435 raft_consensus.cc:740] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.231446 9435 consensus_queue.cc:260] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.231750 9427 tablet_bootstrap.cc:492] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:06.231884 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_d582b0f606d1487287ac187149a256c1 [id=1f3c294eae334880b9166c390c519bcb]
I20251215 14:55:06.231984 9427 ts_tablet_manager.cc:1403] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.003s
I20251215 14:55:06.232091 9435 ts_tablet_manager.cc:1434] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:06.232405 9435 tablet_bootstrap.cc:492] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.232779 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_aba7a90daaf544eb972bd7349f27ae63 [id=2bd880b71b174f528054fbc22143c01f]
I20251215 14:55:06.233639 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_548eacdf412e49fa9b698d79892c65dd [id=3715f4772ae646fca209a8bebfbb0586]
I20251215 14:55:06.234236 9435 tablet_bootstrap.cc:654] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.234195 9427 raft_consensus.cc:359] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.234575 9427 raft_consensus.cc:385] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.234700 9427 raft_consensus.cc:740] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.235002 9427 consensus_queue.cc:260] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.235433 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_cd6f9353272f406f866b8aea97b47b52 [id=40a32fedadfe44bca3c1013ceb2b84c6]
I20251215 14:55:06.236752 9435 tablet_bootstrap.cc:492] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.236901 9435 ts_tablet_manager.cc:1403] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20251215 14:55:06.238306 9435 raft_consensus.cc:359] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.238513 9435 raft_consensus.cc:385] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.238765 9426 raft_consensus.cc:359] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.238628 9435 raft_consensus.cc:740] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.239054 9426 raft_consensus.cc:385] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.239192 9426 raft_consensus.cc:740] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.239135 9435 consensus_queue.cc:260] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.239563 9426 consensus_queue.cc:260] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.239750 9435 ts_tablet_manager.cc:1434] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:06.240618 9426 ts_tablet_manager.cc:1434] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20251215 14:55:06.241189 9426 tablet_bootstrap.cc:492] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.242904 9678 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.243306 9678 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.243778 9615 raft_consensus.cc:493] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.244002 9615 raft_consensus.cc:515] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.244493 9427 ts_tablet_manager.cc:1434] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20251215 14:55:06.244669 9615 leader_election.cc:290] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.245334 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3cdfcddd91fe47de8fd14dc718f421a6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.245625 9041 raft_consensus.cc:2468] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:06.246263 9427 tablet_bootstrap.cc:492] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:06.246441 9112 leader_election.cc:304] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:06.246944 9426 tablet_bootstrap.cc:654] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.246969 9615 raft_consensus.cc:2804] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.247366 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3cdfcddd91fe47de8fd14dc718f421a6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.247458 9615 raft_consensus.cc:493] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.247577 9615 raft_consensus.cc:3060] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.247771 9314 raft_consensus.cc:2468] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:06.250021 9435 tablet_bootstrap.cc:492] T 7f38c44dbc884d74a61c7ed98deaf6aa P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.250217 9615 raft_consensus.cc:515] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.251536 9615 leader_election.cc:290] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.251608 9435 tablet_bootstrap.cc:654] T 7f38c44dbc884d74a61c7ed98deaf6aa P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.251806 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3cdfcddd91fe47de8fd14dc718f421a6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.252002 9041 raft_consensus.cc:3060] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.252667 9427 tablet_bootstrap.cc:654] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.257874 9041 raft_consensus.cc:2468] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:06.258733 9112 leader_election.cc:304] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:06.259217 9615 raft_consensus.cc:2804] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.259393 9615 raft_consensus.cc:697] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:06.259657 9615 consensus_queue.cc:237] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.260911 9807 raft_consensus.cc:493] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.261072 9807 raft_consensus.cc:515] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.261404 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3cdfcddd91fe47de8fd14dc718f421a6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:06.261837 9807 leader_election.cc:290] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:06.262197 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26876cdffd7e4664bc8f7efb74885776" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:06.262363 9180 raft_consensus.cc:2468] T 26876cdffd7e4664bc8f7efb74885776 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:06.262331 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26876cdffd7e4664bc8f7efb74885776" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.262575 9042 raft_consensus.cc:2468] T 26876cdffd7e4664bc8f7efb74885776 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:06.262763 9249 leader_election.cc:304] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.263005 9807 raft_consensus.cc:2804] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.263129 9807 raft_consensus.cc:493] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.263242 9807 raft_consensus.cc:3060] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.263279 9314 raft_consensus.cc:3060] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.265847 9807 raft_consensus.cc:515] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.266461 9807 leader_election.cc:290] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:06.266832 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26876cdffd7e4664bc8f7efb74885776" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:06.266992 9180 raft_consensus.cc:3060] T 26876cdffd7e4664bc8f7efb74885776 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.268261 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26876cdffd7e4664bc8f7efb74885776" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.268471 9041 raft_consensus.cc:3060] T 26876cdffd7e4664bc8f7efb74885776 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.269768 9180 raft_consensus.cc:2468] T 26876cdffd7e4664bc8f7efb74885776 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:06.270304 9249 leader_election.cc:304] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.270609 9807 raft_consensus.cc:2804] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.270754 9807 raft_consensus.cc:697] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:06.271031 9807 consensus_queue.cc:237] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.271425 9041 raft_consensus.cc:2468] T 26876cdffd7e4664bc8f7efb74885776 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:06.272763 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0215ff355fce46b5a4cf1bf4bd7164f3" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:06.273275 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.273579 9678 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:06.276589 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0215ff355fce46b5a4cf1bf4bd7164f3" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:06.277881 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.278019 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:06.276604 9427 tablet_bootstrap.cc:492] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:06.279999 9427 ts_tablet_manager.cc:1403] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.003s
I20251215 14:55:06.281253 9678 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:06.280889 9427 raft_consensus.cc:359] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.281677 9427 raft_consensus.cc:385] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.281823 9427 raft_consensus.cc:740] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.282080 9427 consensus_queue.cc:260] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.284235 9427 ts_tablet_manager.cc:1434] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20251215 14:55:06.284595 9427 tablet_bootstrap.cc:492] T f9411030d08d40aabbdee6670ba95821 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:06.286581 9427 tablet_bootstrap.cc:654] T f9411030d08d40aabbdee6670ba95821 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.242542 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_eecf0f0bdeea4f46bede829df928cd8c [id=41f7f84b468f4860b54a4544d236cecc]
I20251215 14:55:06.291313 9314 raft_consensus.cc:2468] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:06.292232 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_42e5c1011ba64c0b9602eed064c8ecbd [id=4343a6c3acc545d7be8d3b7ec617da90]
I20251215 14:55:06.293313 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b [id=472c67fefad54383b4ebac7e3c77d325]
I20251215 14:55:06.294042 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_0593d9b93de9400ba29718af1b328262 [id=50a94314f5ba46e3a75b5a15e7362299]
I20251215 14:55:06.294415 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_9c3c46c55b45498cbd336827286a69aa [id=527d4e360777473fa1c70305b2ddebef]
I20251215 14:55:06.294826 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_41cfaeeb78b544a38b5c116552bbecfa [id=53315a8cf3bd4a05b1c5e30fd0acdd56]
I20251215 14:55:06.295502 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_2920b8dba9704f489af552aa0ce58b64 [id=53456f18769d4b1ebe4743594e412016]
I20251215 14:55:06.295836 9435 tablet_bootstrap.cc:492] T 7f38c44dbc884d74a61c7ed98deaf6aa P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.295924 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_f1ad091bc41747ffba1fca75bcf619b7 [id=5cc820ec2c8b427db1c89647b295363e]
I20251215 14:55:06.296267 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_4137cdbc5dba456588ab4ce7aa1382a4 [id=5d35eeea3abd4b59911dd31745a9e54a]
I20251215 14:55:06.296270 9435 ts_tablet_manager.cc:1403] T 7f38c44dbc884d74a61c7ed98deaf6aa P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.046s user 0.011s sys 0.009s
I20251215 14:55:06.296663 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_20d3d5a89e4a447ebcd9f4062e6b477b [id=5f7704a7da85406cb20243ca8c50962d]
I20251215 14:55:06.297286 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_1209e44783914fd0875ebeca6528fa3b [id=60fd0f030f204325bf52f45926de8151]
I20251215 14:55:06.297691 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_e726b47802404f3aaccb61d6aaaa72a5 [id=62dd6789e50a49ca96ec0db0ef20bb44]
I20251215 14:55:06.298081 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_4372b5372fdf4a0d991207a20dcbca19 [id=640d70bd78554e92823dc104e06227d3]
I20251215 14:55:06.298458 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e [id=6b4b04bb03f04a8a9cd7bc893acf612c]
I20251215 14:55:06.298828 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_05353059978c4d13804474b05f6c8d7b [id=6dd2c68a85f648e1b4c51e691c1eb632]
I20251215 14:55:06.298375 9435 raft_consensus.cc:359] T 7f38c44dbc884d74a61c7ed98deaf6aa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.299249 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_a88c3e4ed8414aaeb07e01a30cc69f50 [id=6f8c6c9e7f754c2885cfa19070c5af16]
I20251215 14:55:06.299226 9435 raft_consensus.cc:385] T 7f38c44dbc884d74a61c7ed98deaf6aa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.299494 9435 raft_consensus.cc:740] T 7f38c44dbc884d74a61c7ed98deaf6aa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.299614 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_7fbfc1dd536247d4b9f3472efe93ca60 [id=7413713b56f2433fa892caa112c9317a]
I20251215 14:55:06.299986 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_bdb881513410499d96d921c275f0bd61 [id=78a9312f35ba4cc9a76448c917cdd81a]
I20251215 14:55:06.300341 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_152b267c68cb4172a6257b9978784879 [id=78e6675d27304f3abebf11d1634f5440]
I20251215 14:55:06.300175 9435 consensus_queue.cc:260] T 7f38c44dbc884d74a61c7ed98deaf6aa P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.300907 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_d27029eebe7b40ad85ba792bad6d92c5 [id=7ec65d77d89d4e40a60b716f721e2940]
I20251215 14:55:06.301532 9435 ts_tablet_manager.cc:1434] T 7f38c44dbc884d74a61c7ed98deaf6aa P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20251215 14:55:06.301630 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_f26de8048da94ed5b0c969a20720fa76 [id=906e2eb92abb4483bd96e56f6f0fe474]
I20251215 14:55:06.302217 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_76a8f78ec8a74aadaf69142df6990dc8 [id=94ddd629cb1e4f5eb0061100187f4202]
I20251215 14:55:06.302651 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_d88499634e6e47fd84ec1fdb6d93c314 [id=968fae72cb884ec9acb262fdfd5c7f74]
I20251215 14:55:06.304306 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_ba8f8beb36af4b6ab3fc11419c5c3531 [id=9db10c7c96104a7fb7ab0c44c2911d2e]
I20251215 14:55:06.304765 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1]
I20251215 14:55:06.305186 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_c1335c74e0f740b08e701ac0246125f0 [id=a4fa8fe05f924de6b14bcc04e80479ce]
I20251215 14:55:06.305564 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_371fb0a76bea4b17b74b0eb7dc573f00 [id=a81a53d1daa84a799510d1f4224eb1e1]
I20251215 14:55:06.305943 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_b84b10eece664a31b983b31c90986bda [id=aac8c87b5b67426d86d47e2825d77f53]
I20251215 14:55:06.306335 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_6ee288ff34ea426582a74cc4cf626490 [id=ab537167c6d94d9d83ed06b734395be3]
I20251215 14:55:06.306740 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781]
I20251215 14:55:06.307088 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_ae411cdd8f1740839d5490d643672e18 [id=b16ae3d8bb2a40eda9602301a2a2dc2e]
I20251215 14:55:06.307750 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_f3914f2c87834e22a1e6ee9dd86ec86c [id=b402450af7c34bcfbc766b88beb217bb]
I20251215 14:55:06.307901 9426 tablet_bootstrap.cc:492] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.308207 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_77da0b679b494783bb486ac3e8887892 [id=b7ff2d02e55b4e839049b20b89227526]
I20251215 14:55:06.308669 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_74cef17050464ec6968b0d9dce366720 [id=bec2dd63f0aa4a05961adb6a70fbfd94]
I20251215 14:55:06.308693 9426 ts_tablet_manager.cc:1403] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.068s user 0.007s sys 0.012s
I20251215 14:55:06.309084 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_a68d34f520064abe9fb31e83e0162483 [id=c0d22f90a4f046feaf4e5b11515a6b2d]
I20251215 14:55:06.309540 9426 raft_consensus.cc:359] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.309696 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_862e5241fcc042d8bf376e55c3c86fa0 [id=c1c5f6c604c24855a17e2dfb4174965b]
I20251215 14:55:06.310156 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_20d2c5b358444df59324e21800508f8d [id=c421ca23de494f4ba674e4cc86bac3da]
I20251215 14:55:06.302239 9435 tablet_bootstrap.cc:492] T 37181f50142f4d8bb88713221a755d50 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.310593 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_f9cf4c41c7b846e88bae24711ee3421a [id=c427c258b3b443eea28d804f57a2bb30]
I20251215 14:55:06.311002 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_38b1c1a82dd441dfa8131162ac117124 [id=c50e99dfae684c81a80bfce95ff35672]
I20251215 14:55:06.311434 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_8f94c89c96d2444e82c9681f3a6ef372 [id=c6a51393c76f4e7a83480bcca232e954]
I20251215 14:55:06.311496 9426 raft_consensus.cc:385] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.311627 9426 raft_consensus.cc:740] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.311875 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_a1ec14c414a94c868fbbfe74faf0872e [id=cb60f7deb1c34398b39508393cc4cefd]
I20251215 14:55:06.311940 9426 consensus_queue.cc:260] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.312326 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_3f190fdaff1446908955f4b5957a8084 [id=cbafb4499c90447d8f185928d3e58b20]
I20251215 14:55:06.312781 9426 ts_tablet_manager.cc:1434] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:06.313077 9426 tablet_bootstrap.cc:492] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.313194 9807 raft_consensus.cc:493] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.313365 9807 raft_consensus.cc:515] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.314004 9807 leader_election.cc:290] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:06.314813 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcd7d00fa01f4a9cbdf0d505684dab0e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.315047 9041 raft_consensus.cc:2468] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:06.315543 9850 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20251215 14:55:06.315577 9248 leader_election.cc:304] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.315922 9807 raft_consensus.cc:2804] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.316022 9807 raft_consensus.cc:493] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.316124 9807 raft_consensus.cc:3060] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.317471 9427 tablet_bootstrap.cc:492] T f9411030d08d40aabbdee6670ba95821 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:06.317636 9427 ts_tablet_manager.cc:1403] T f9411030d08d40aabbdee6670ba95821 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.002s
I20251215 14:55:06.318264 9426 tablet_bootstrap.cc:654] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.318395 9427 raft_consensus.cc:359] T f9411030d08d40aabbdee6670ba95821 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.318598 9427 raft_consensus.cc:385] T f9411030d08d40aabbdee6670ba95821 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.318785 9427 raft_consensus.cc:740] T f9411030d08d40aabbdee6670ba95821 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.319281 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcd7d00fa01f4a9cbdf0d505684dab0e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:06.319373 9427 consensus_queue.cc:260] T f9411030d08d40aabbdee6670ba95821 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:06.320050 9249 leader_election.cc:343] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.322880 9696 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e89303a500544272b601d7c29be802b4" instance_seqno: 1765810501001456) as {username='slave'} at 127.8.121.131:46877; Asking this server to re-register.
I20251215 14:55:06.319048 9807 raft_consensus.cc:515] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.325398 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcd7d00fa01f4a9cbdf0d505684dab0e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:06.325868 9689 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" instance_seqno: 1765810500551421) as {username='slave'} at 127.8.121.130:52339; Asking this server to re-register.
W20251215 14:55:06.326140 9249 leader_election.cc:343] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.327433 9226 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:06.327399 9807 leader_election.cc:290] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:06.328274 9361 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:06.328763 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcd7d00fa01f4a9cbdf0d505684dab0e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.328980 9041 raft_consensus.cc:3060] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.329864 9427 ts_tablet_manager.cc:1434] T f9411030d08d40aabbdee6670ba95821 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20251215 14:55:06.330343 9615 raft_consensus.cc:493] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.330509 9615 raft_consensus.cc:515] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:06.330806 9696 ts_manager.cc:194] Registered new tserver with Master: 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:06.331195 9615 leader_election.cc:290] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.331306 9427 tablet_bootstrap.cc:492] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:06.332568 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6aad8bed15a416a925ae8c8870d4e51" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.332808 9042 raft_consensus.cc:2468] T e6aad8bed15a416a925ae8c8870d4e51 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:06.333369 9112 leader_election.cc:304] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:06.333856 9615 raft_consensus.cc:2804] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.333981 9615 raft_consensus.cc:493] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.334071 9615 raft_consensus.cc:3060] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.336261 9426 tablet_bootstrap.cc:492] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.338531 9615 raft_consensus.cc:515] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:06.339900 9615 leader_election.cc:290] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.340788 9426 ts_tablet_manager.cc:1403] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.003s
I20251215 14:55:06.341681 9426 raft_consensus.cc:359] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.341919 9426 raft_consensus.cc:385] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.342022 9426 raft_consensus.cc:740] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.342278 9426 consensus_queue.cc:260] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.342303 9041 raft_consensus.cc:2468] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
W20251215 14:55:06.342371 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 5560a21e16bb43c7903c1fc66429ecdf (table default.Table_20d3d5a89e4a447ebcd9f4062e6b477b [id=5f7704a7da85406cb20243ca8c50962d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5560a21e16bb43c7903c1fc66429ecdf consensus state has no leader
I20251215 14:55:06.343365 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6aad8bed15a416a925ae8c8870d4e51" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.343637 9042 raft_consensus.cc:3060] T e6aad8bed15a416a925ae8c8870d4e51 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.346868 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_2dd806808b064dadbe81feaae5862a89 [id=cfa97744d0364459ba63ed1d52dc15db]
I20251215 14:55:06.348201 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_1ea29a2534e24318a5604a9a1c93fbe0 [id=cfc66f0ad54746d78dd5ad5a6054f3f4]
I20251215 14:55:06.349888 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_a469ba7678054925965fe69d826f1c16 [id=d0891c1ad38b48348b350482a3298f39]
I20251215 14:55:06.350706 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_ada3150d10a34cb4aaf8a16a487fa543 [id=d12dc623fa0a4a6cbd87ee8180c4c885]
I20251215 14:55:06.351684 9042 raft_consensus.cc:2468] T e6aad8bed15a416a925ae8c8870d4e51 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:06.328894 9435 tablet_bootstrap.cc:654] T 37181f50142f4d8bb88713221a755d50 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.354442 9850 catalog_manager.cc:1269] Loaded cluster ID: ed5da7b2c3a646fcbe8e0bb3a7589268
I20251215 14:55:06.354550 9850 catalog_manager.cc:1562] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: loading cluster ID for follower catalog manager: success
I20251215 14:55:06.354897 9696 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" instance_seqno: 1765810500082532) as {username='slave'} at 127.8.121.129:34947; Asking this server to re-register.
I20251215 14:55:06.331883 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6aad8bed15a416a925ae8c8870d4e51" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.355263 9314 raft_consensus.cc:2468] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:06.346027 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6aad8bed15a416a925ae8c8870d4e51" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:06.356292 9313 raft_consensus.cc:3060] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.357563 9088 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:06.358686 9427 tablet_bootstrap.cc:654] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.358873 9313 raft_consensus.cc:2468] T e6aad8bed15a416a925ae8c8870d4e51 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:06.346493 9248 leader_election.cc:304] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:06.359079 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_c9cd184036e942449e5f5a3d806a1000 [id=d8410eb19405483eafbfc5b83e088c2d]
I20251215 14:55:06.359237 9426 ts_tablet_manager.cc:1434] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:06.359241 9112 leader_election.cc:304] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:06.359923 9807 raft_consensus.cc:2804] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.359998 9615 raft_consensus.cc:2804] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.360082 9807 raft_consensus.cc:697] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:06.360291 9426 tablet_bootstrap.cc:492] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.360332 9807 consensus_queue.cc:237] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.360288 9615 raft_consensus.cc:697] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:06.361186 9615 consensus_queue.cc:237] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:06.363209 9426 tablet_bootstrap.cc:654] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.364589 9689 ts_manager.cc:194] Registered new tserver with Master: e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.364820 9678 consensus_queue.cc:1048] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:06.366344 9850 catalog_manager.cc:1584] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: acquiring CA information for follower catalog manager: success
I20251215 14:55:06.366590 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_6bd7eee6a17d43f4baf1db824203acab [id=d916193804f94519b84d259c0420e1a1]
I20251215 14:55:06.367358 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_8517e4afab414864a30f6afa1d656b2d [id=dfb1938060a24761aae3e9d919ed5464]
I20251215 14:55:06.368083 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_61ca8adc55ea4c149b8ddaf2b30ef360 [id=efe5b2d15f1946cfa19f92b942b760d5]
I20251215 14:55:06.368497 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_c042437915b141518837aa551d8500d0 [id=f2428abb656749d0907096c2df05ef64]
I20251215 14:55:06.368969 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_0c66ce7473b248f58f74dd76a8c48045 [id=f735b0a748bf4b35bd47e7b1431994b1]
I20251215 14:55:06.369410 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_ad8e8a5df4ec4b53a051977d42d10a17 [id=f87a4d1335e64e9f9234807ded6cc7d9]
I20251215 14:55:06.369863 9819 catalog_manager.cc:679] Loaded metadata for table default.Table_802c7f03a650477cb59c4e574f25e862 [id=fa027087d00d452daa95b171d95c5a82]
I20251215 14:55:06.376001 9850 catalog_manager.cc:1612] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251215 14:55:06.381659 9426 tablet_bootstrap.cc:492] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.381826 9426 ts_tablet_manager.cc:1403] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.002s
I20251215 14:55:06.382602 9689 ts_manager.cc:194] Registered new tserver with Master: 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:06.382651 9426 raft_consensus.cc:359] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.382827 9426 raft_consensus.cc:385] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.382905 9426 raft_consensus.cc:740] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.383131 9426 consensus_queue.cc:260] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.383668 9426 ts_tablet_manager.cc:1434] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:06.383968 9426 tablet_bootstrap.cc:492] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.385699 9426 tablet_bootstrap.cc:654] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.403738 9819 tablet_loader.cc:96] loaded metadata for tablet 050260e67b924f13847b9550a91e274b (table default.Table_f3914f2c87834e22a1e6ee9dd86ec86c [id=b402450af7c34bcfbc766b88beb217bb])
I20251215 14:55:06.404215 9819 tablet_loader.cc:96] loaded metadata for tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781])
I20251215 14:55:06.404469 9426 tablet_bootstrap.cc:492] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.404614 9819 tablet_loader.cc:96] loaded metadata for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1])
I20251215 14:55:06.404663 9426 ts_tablet_manager.cc:1403] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.002s
I20251215 14:55:06.405014 9819 tablet_loader.cc:96] loaded metadata for tablet 0a597fd6c7c044228ffb2a5a5f924e70 (table default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f])
I20251215 14:55:06.405325 9819 tablet_loader.cc:96] loaded metadata for tablet 123361ef48714d859ee5ac85c3c37d08 (table default.Table_152b267c68cb4172a6257b9978784879 [id=78e6675d27304f3abebf11d1634f5440])
I20251215 14:55:06.405519 9426 raft_consensus.cc:359] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.405650 9819 tablet_loader.cc:96] loaded metadata for tablet 15b8a2a337e54321afd67f7562c412a0 (table default.Table_1ea29a2534e24318a5604a9a1c93fbe0 [id=cfc66f0ad54746d78dd5ad5a6054f3f4])
I20251215 14:55:06.405725 9426 raft_consensus.cc:385] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.405814 9426 raft_consensus.cc:740] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.406086 9819 tablet_loader.cc:96] loaded metadata for tablet 16edd0bfd67848e688fa12d9c679fdac (table default.Table_c1335c74e0f740b08e701ac0246125f0 [id=a4fa8fe05f924de6b14bcc04e80479ce])
I20251215 14:55:06.406069 9426 consensus_queue.cc:260] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.406502 9819 tablet_loader.cc:96] loaded metadata for tablet 18cd1f63d51e4565bb8c55be13e3e099 (table default.Table_6ee288ff34ea426582a74cc4cf626490 [id=ab537167c6d94d9d83ed06b734395be3])
I20251215 14:55:06.407014 9819 tablet_loader.cc:96] loaded metadata for tablet 21a98ce868924690b8a5715f4103c360 (table default.Table_a1ec14c414a94c868fbbfe74faf0872e [id=cb60f7deb1c34398b39508393cc4cefd])
I20251215 14:55:06.407444 9819 tablet_loader.cc:96] loaded metadata for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_3f190fdaff1446908955f4b5957a8084 [id=cbafb4499c90447d8f185928d3e58b20])
I20251215 14:55:06.407356 9678 consensus_queue.cc:1048] T b329b0abcad742ff94c1a62a72d1b673 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:06.408264 9426 ts_tablet_manager.cc:1434] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:06.408627 9426 tablet_bootstrap.cc:492] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.410562 9819 tablet_loader.cc:96] loaded metadata for tablet 2811b8ffdb614c91b0d3d4e6e039245b (table default.Table_41cfaeeb78b544a38b5c116552bbecfa [id=53315a8cf3bd4a05b1c5e30fd0acdd56])
I20251215 14:55:06.411247 9819 tablet_loader.cc:96] loaded metadata for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 (table default.Table_0593d9b93de9400ba29718af1b328262 [id=50a94314f5ba46e3a75b5a15e7362299])
I20251215 14:55:06.411302 9426 tablet_bootstrap.cc:654] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.413666 9819 tablet_loader.cc:96] loaded metadata for tablet 35326e99d413431583b25d11269d09dc (table default.Table_eecf0f0bdeea4f46bede829df928cd8c [id=41f7f84b468f4860b54a4544d236cecc])
I20251215 14:55:06.418045 9819 tablet_loader.cc:96] loaded metadata for tablet 35ade4502ed7497a82b362d38c65244a (table default.Table_cd6f9353272f406f866b8aea97b47b52 [id=40a32fedadfe44bca3c1013ceb2b84c6])
I20251215 14:55:06.418507 9819 tablet_loader.cc:96] loaded metadata for tablet 38e50a7f2bdd4907ab41436b59397ea6 (table default.Table_ada3150d10a34cb4aaf8a16a487fa543 [id=d12dc623fa0a4a6cbd87ee8180c4c885])
I20251215 14:55:06.418896 9819 tablet_loader.cc:96] loaded metadata for tablet 3af4f753a04b429a857e018f201ae6ed (table default.Table_bdb881513410499d96d921c275f0bd61 [id=78a9312f35ba4cc9a76448c917cdd81a])
I20251215 14:55:06.419240 9819 tablet_loader.cc:96] loaded metadata for tablet 3c274c9002544af4947aa4ee76a705ce (table default.Table_e06edd0b78e6468ebf09728e684489da [id=08069854f54c40f7be88313791a1de21])
I20251215 14:55:06.419620 9819 tablet_loader.cc:96] loaded metadata for tablet 3c6cfff573434fbcb18feaf6a8e6a153 (table default.Table_ba8f8beb36af4b6ab3fc11419c5c3531 [id=9db10c7c96104a7fb7ab0c44c2911d2e])
I20251215 14:55:06.420015 9819 tablet_loader.cc:96] loaded metadata for tablet 3cdfcddd91fe47de8fd14dc718f421a6 (table default.Table_aba7a90daaf544eb972bd7349f27ae63 [id=2bd880b71b174f528054fbc22143c01f])
I20251215 14:55:06.420433 9819 tablet_loader.cc:96] loaded metadata for tablet 429c0b2d7cb2428c8de6b02acde36044 (table default.Table_20d2c5b358444df59324e21800508f8d [id=c421ca23de494f4ba674e4cc86bac3da])
I20251215 14:55:06.420905 9819 tablet_loader.cc:96] loaded metadata for tablet 4af4cf6ec825467383349098eda661c6 (table default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e [id=6b4b04bb03f04a8a9cd7bc893acf612c])
I20251215 14:55:06.421705 9819 tablet_loader.cc:96] loaded metadata for tablet 4c96b655cf284326ae3fa2a165e2bf95 (table default.Table_77da0b679b494783bb486ac3e8887892 [id=b7ff2d02e55b4e839049b20b89227526])
I20251215 14:55:06.422104 9819 tablet_loader.cc:96] loaded metadata for tablet 5560a21e16bb43c7903c1fc66429ecdf (table default.Table_20d3d5a89e4a447ebcd9f4062e6b477b [id=5f7704a7da85406cb20243ca8c50962d])
I20251215 14:55:06.422186 9426 tablet_bootstrap.cc:492] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.422358 9426 ts_tablet_manager.cc:1403] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.005s
I20251215 14:55:06.422472 9819 tablet_loader.cc:96] loaded metadata for tablet 56816add0a61454c9980ad09f5815b09 (table default.Table_d582b0f606d1487287ac187149a256c1 [id=1f3c294eae334880b9166c390c519bcb])
I20251215 14:55:06.422789 9819 tablet_loader.cc:96] loaded metadata for tablet 5830296559264b609909486aa15c9e2e (table default.Table_2dd806808b064dadbe81feaae5862a89 [id=cfa97744d0364459ba63ed1d52dc15db])
I20251215 14:55:06.423092 9819 tablet_loader.cc:96] loaded metadata for tablet 58926ab073974e2c8b725d5061a544d5 (table default.Table_f26de8048da94ed5b0c969a20720fa76 [id=906e2eb92abb4483bd96e56f6f0fe474])
I20251215 14:55:06.423132 9435 tablet_bootstrap.cc:492] T 37181f50142f4d8bb88713221a755d50 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.423128 9426 raft_consensus.cc:359] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.423358 9426 raft_consensus.cc:385] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.423380 9435 ts_tablet_manager.cc:1403] T 37181f50142f4d8bb88713221a755d50 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.121s user 0.004s sys 0.011s
I20251215 14:55:06.423441 9819 tablet_loader.cc:96] loaded metadata for tablet 5bfe8cc0805247de9df4a59d461818f3 (table default.Table_7fbfc1dd536247d4b9f3472efe93ca60 [id=7413713b56f2433fa892caa112c9317a])
I20251215 14:55:06.423458 9426 raft_consensus.cc:740] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.423663 9426 consensus_queue.cc:260] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.423801 9819 tablet_loader.cc:96] loaded metadata for tablet 5dc81eb40614463cb5017475b378eea6 (table default.Table_76a8f78ec8a74aadaf69142df6990dc8 [id=94ddd629cb1e4f5eb0061100187f4202])
I20251215 14:55:06.424172 9819 tablet_loader.cc:96] loaded metadata for tablet 5dd36ea0aa53460f9c1fda4b31063fa7 (table default.Table_05353059978c4d13804474b05f6c8d7b [id=6dd2c68a85f648e1b4c51e691c1eb632])
I20251215 14:55:06.424188 9426 ts_tablet_manager.cc:1434] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:06.424254 9435 raft_consensus.cc:359] T 37181f50142f4d8bb88713221a755d50 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.424537 9819 tablet_loader.cc:96] loaded metadata for tablet 605da10c8d3049e8b94caa9738576aab (table default.Table_9fff09bdf4114198810006599bcf1f3d [id=1a10676eee8b47098cf45bee49e3f502])
I20251215 14:55:06.424655 9435 raft_consensus.cc:385] T 37181f50142f4d8bb88713221a755d50 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.424805 9435 raft_consensus.cc:740] T 37181f50142f4d8bb88713221a755d50 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.424897 9819 tablet_loader.cc:96] loaded metadata for tablet 61aef86a30e842f2a90f9f1c88c84f4d (table default.Table_38b1c1a82dd441dfa8131162ac117124 [id=c50e99dfae684c81a80bfce95ff35672])
I20251215 14:55:06.425096 9435 consensus_queue.cc:260] T 37181f50142f4d8bb88713221a755d50 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.425688 9435 ts_tablet_manager.cc:1434] T 37181f50142f4d8bb88713221a755d50 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:06.426535 9427 tablet_bootstrap.cc:492] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:06.426676 9427 ts_tablet_manager.cc:1403] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.096s user 0.005s sys 0.001s
I20251215 14:55:06.427444 9615 raft_consensus.cc:493] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.427484 9427 raft_consensus.cc:359] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.427647 9427 raft_consensus.cc:385] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.427592 9615 raft_consensus.cc:515] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.427729 9427 raft_consensus.cc:740] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.428166 9819 tablet_loader.cc:96] loaded metadata for tablet 6229b8bc8d3d446c944c819670b10d54 (table default.Table_baa5664946144147bafee4511b30105f [id=15ddee7fbd5047caad852f1a4c453515])
I20251215 14:55:06.428227 9615 leader_election.cc:290] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.428668 9426 tablet_bootstrap.cc:492] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.428901 9819 tablet_loader.cc:96] loaded metadata for tablet 66f2c74e55f04a6fa4b2c238c0a6b901 (table default.Table_4137cdbc5dba456588ab4ce7aa1382a4 [id=5d35eeea3abd4b59911dd31745a9e54a])
I20251215 14:55:06.426096 9435 tablet_bootstrap.cc:492] T 9425749d471f4f95bbae030977e278e4 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.429203 9819 tablet_loader.cc:96] loaded metadata for tablet 682cafa003a64138a01024be2573fe34 (table default.Table_9c3c46c55b45498cbd336827286a69aa [id=527d4e360777473fa1c70305b2ddebef])
I20251215 14:55:06.429544 9819 tablet_loader.cc:96] loaded metadata for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 (table default.Table_0c66ce7473b248f58f74dd76a8c48045 [id=f735b0a748bf4b35bd47e7b1431994b1])
I20251215 14:55:06.429931 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df70bebdc8ad4f8186ba427e840799cf" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.430347 9426 tablet_bootstrap.cc:654] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.431111 9427 consensus_queue.cc:260] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:06.431375 9112 leader_election.cc:343] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.431600 9615 raft_consensus.cc:493] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.431728 9615 raft_consensus.cc:515] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.432343 9615 leader_election.cc:290] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.434841 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f32a6e8df31d482fa9b9686e002d81ff" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.435068 9042 raft_consensus.cc:2468] T f32a6e8df31d482fa9b9686e002d81ff P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:06.436040 9112 leader_election.cc:304] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:06.436348 9615 raft_consensus.cc:2804] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.436483 9615 raft_consensus.cc:493] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.436568 9615 raft_consensus.cc:3060] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.439205 9427 ts_tablet_manager.cc:1434] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20251215 14:55:06.439319 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f32a6e8df31d482fa9b9686e002d81ff" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.439589 9314 raft_consensus.cc:2468] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:06.439774 9819 tablet_loader.cc:96] loaded metadata for tablet 6ec16a234222470bb9cf8c29db536cc1 (table default.Table_8f94c89c96d2444e82c9681f3a6ef372 [id=c6a51393c76f4e7a83480bcca232e954])
I20251215 14:55:06.440119 9819 tablet_loader.cc:96] loaded metadata for tablet 7634179e7bef4b95ae6e06b4581888e7 (table default.Table_d88499634e6e47fd84ec1fdb6d93c314 [id=968fae72cb884ec9acb262fdfd5c7f74])
I20251215 14:55:06.440519 9819 tablet_loader.cc:96] loaded metadata for tablet 77780f8cfe544db7baee2c761fe52ca2 (table default.Table_c042437915b141518837aa551d8500d0 [id=f2428abb656749d0907096c2df05ef64])
I20251215 14:55:06.440248 9615 raft_consensus.cc:515] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.440891 9819 tablet_loader.cc:96] loaded metadata for tablet 78b3f18a62d544b38a0682bf3bc00977 (table default.Table_ad8e8a5df4ec4b53a051977d42d10a17 [id=f87a4d1335e64e9f9234807ded6cc7d9])
I20251215 14:55:06.441222 9819 tablet_loader.cc:96] loaded metadata for tablet 79f3a7a065d243c98b465a984bd2b1f9 (table default.Table_548eacdf412e49fa9b698d79892c65dd [id=3715f4772ae646fca209a8bebfbb0586])
I20251215 14:55:06.441675 9819 tablet_loader.cc:96] loaded metadata for tablet 7f38c44dbc884d74a61c7ed98deaf6aa (table default.Table_74cef17050464ec6968b0d9dce366720 [id=bec2dd63f0aa4a05961adb6a70fbfd94])
I20251215 14:55:06.442024 9819 tablet_loader.cc:96] loaded metadata for tablet 804ad50f38314be3bf9e118eee9fe748 (table default.Table_8517e4afab414864a30f6afa1d656b2d [id=dfb1938060a24761aae3e9d919ed5464])
I20251215 14:55:06.442381 9819 tablet_loader.cc:96] loaded metadata for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_802c7f03a650477cb59c4e574f25e862 [id=fa027087d00d452daa95b171d95c5a82])
I20251215 14:55:06.442448 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f32a6e8df31d482fa9b9686e002d81ff" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.442667 9042 raft_consensus.cc:3060] T f32a6e8df31d482fa9b9686e002d81ff P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.442735 9819 tablet_loader.cc:96] loaded metadata for tablet 88206b17f94242378a35d5314611ac1a (table default.Table_61ca8adc55ea4c149b8ddaf2b30ef360 [id=efe5b2d15f1946cfa19f92b942b760d5])
I20251215 14:55:06.443056 9819 tablet_loader.cc:96] loaded metadata for tablet 90c0254840b442a3817171b06f2726c8 (table default.Table_ae411cdd8f1740839d5490d643672e18 [id=b16ae3d8bb2a40eda9602301a2a2dc2e])
I20251215 14:55:06.445629 9042 raft_consensus.cc:2468] T f32a6e8df31d482fa9b9686e002d81ff P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:06.446262 9112 leader_election.cc:304] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:06.446676 9617 raft_consensus.cc:2804] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.446812 9617 raft_consensus.cc:697] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:06.447108 9617 consensus_queue.cc:237] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.448603 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df70bebdc8ad4f8186ba427e840799cf" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.448882 9313 raft_consensus.cc:2468] T df70bebdc8ad4f8186ba427e840799cf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:06.449222 9427 tablet_bootstrap.cc:492] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:06.449335 9115 leader_election.cc:304] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:06.449753 9507 raft_consensus.cc:2804] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.449851 9507 raft_consensus.cc:493] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.449963 9507 raft_consensus.cc:3060] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.451639 9427 tablet_bootstrap.cc:654] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.452607 9507 raft_consensus.cc:515] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.452987 9819 tablet_loader.cc:96] loaded metadata for tablet 95caeaf32d154c0ba4c88dd3f295876d (table default.Table_e726b47802404f3aaccb61d6aaaa72a5 [id=62dd6789e50a49ca96ec0db0ef20bb44])
I20251215 14:55:06.453297 9507 leader_election.cc:290] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.453456 9819 tablet_loader.cc:96] loaded metadata for tablet 96b2d20fd2304e7a9995206a043b7944 (table default.Table_42e5c1011ba64c0b9602eed064c8ecbd [id=4343a6c3acc545d7be8d3b7ec617da90])
I20251215 14:55:06.453809 9819 tablet_loader.cc:96] loaded metadata for tablet 9beef04f876d40d89dac5970ac6828e9 (table default.Table_a88c3e4ed8414aaeb07e01a30cc69f50 [id=6f8c6c9e7f754c2885cfa19070c5af16])
I20251215 14:55:06.454356 9435 tablet_bootstrap.cc:654] T 9425749d471f4f95bbae030977e278e4 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.454586 9819 tablet_loader.cc:96] loaded metadata for tablet a639396098a941249afd9c3560073131 (table default.Table_f1ad091bc41747ffba1fca75bcf619b7 [id=5cc820ec2c8b427db1c89647b295363e])
I20251215 14:55:06.454821 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df70bebdc8ad4f8186ba427e840799cf" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:06.454886 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df70bebdc8ad4f8186ba427e840799cf" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.454950 9819 tablet_loader.cc:96] loaded metadata for tablet accc3fdaf8e64b0f96b45150a59516bf (table default.Table_f4e69462c1fa42df8f9776f053474a93 [id=0bb5128a11484a1d8c056985720b1a5d])
I20251215 14:55:06.454998 9314 raft_consensus.cc:3060] T df70bebdc8ad4f8186ba427e840799cf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.455366 9782 raft_consensus.cc:493] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:06.455453 9112 leader_election.cc:343] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.455518 9782 raft_consensus.cc:515] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.456156 9782 leader_election.cc:290] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.456938 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16edd0bfd67848e688fa12d9c679fdac" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:06.457139 9180 raft_consensus.cc:2468] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:06.457589 8976 leader_election.cc:304] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:06.457795 9314 raft_consensus.cc:2468] T df70bebdc8ad4f8186ba427e840799cf P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:06.457903 9782 raft_consensus.cc:2804] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.457976 9782 raft_consensus.cc:493] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.458067 9782 raft_consensus.cc:3060] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.459229 9115 leader_election.cc:304] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:06.459895 9507 raft_consensus.cc:2804] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.460083 9507 raft_consensus.cc:697] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:06.460680 9507 consensus_queue.cc:237] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.461006 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16edd0bfd67848e688fa12d9c679fdac" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.461175 9782 raft_consensus.cc:515] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.461244 9314 raft_consensus.cc:2468] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:06.462037 9782 leader_election.cc:290] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.462158 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16edd0bfd67848e688fa12d9c679fdac" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:06.462324 9180 raft_consensus.cc:3060] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.462544 9819 tablet_loader.cc:96] loaded metadata for tablet ae8a49b9a3bf4845943b1ad8e318ccbb (table default.Table_fb8fb745144644eea96b20d598f52fa2 [id=02a2b4848c874afe8f9860eee9bc6ce7])
I20251215 14:55:06.462996 9819 tablet_loader.cc:96] loaded metadata for tablet b9b39c879d444172871f43349978dc86 (table default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b [id=472c67fefad54383b4ebac7e3c77d325])
I20251215 14:55:06.463358 9819 tablet_loader.cc:96] loaded metadata for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d [id=066e8ae14004436cb8b4f3f740b45b19])
I20251215 14:55:06.463697 9819 tablet_loader.cc:96] loaded metadata for tablet bb3b95d32c7044bd8a4451381c19aeba (table default.Table_d27029eebe7b40ad85ba792bad6d92c5 [id=7ec65d77d89d4e40a60b716f721e2940])
I20251215 14:55:06.463372 9615 leader_election.cc:290] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.464047 9819 tablet_loader.cc:96] loaded metadata for tablet bcd7d00fa01f4a9cbdf0d505684dab0e (table default.Table_f9cf4c41c7b846e88bae24711ee3421a [id=c427c258b3b443eea28d804f57a2bb30])
I20251215 14:55:06.464402 9819 tablet_loader.cc:96] loaded metadata for tablet bfead52afe8040a88ba0d826f482b1bd (table default.Table_c9cd184036e942449e5f5a3d806a1000 [id=d8410eb19405483eafbfc5b83e088c2d])
I20251215 14:55:06.464745 9819 tablet_loader.cc:96] loaded metadata for tablet c00aecc23c6541cbae4abd7cb1b3077b (table default.Table_4372b5372fdf4a0d991207a20dcbca19 [id=640d70bd78554e92823dc104e06227d3])
I20251215 14:55:06.465075 9819 tablet_loader.cc:96] loaded metadata for tablet c7f760639a664cfb9f4af5578154b981 (table default.Table_bec53ce4c0c04be8bb0aabb4ce60974b [id=0ed94690124e4fd7a23a6ddf2291c6d6])
I20251215 14:55:06.465132 9180 raft_consensus.cc:2468] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:06.465432 9819 tablet_loader.cc:96] loaded metadata for tablet c8af1d0b67424bec90b59863a975254e (table default.Table_2920b8dba9704f489af552aa0ce58b64 [id=53456f18769d4b1ebe4743594e412016])
I20251215 14:55:06.465745 9819 tablet_loader.cc:96] loaded metadata for tablet d4cff0ed3782446397dbae8a2da52ed7 (table default.Table_a68d34f520064abe9fb31e83e0162483 [id=c0d22f90a4f046feaf4e5b11515a6b2d])
I20251215 14:55:06.466122 8976 leader_election.cc:304] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:06.466759 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16edd0bfd67848e688fa12d9c679fdac" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:06.466998 9314 raft_consensus.cc:3060] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.469937 9427 tablet_bootstrap.cc:492] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:06.470185 9427 ts_tablet_manager.cc:1403] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.003s
I20251215 14:55:06.471000 9782 raft_consensus.cc:2804] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.471395 9782 raft_consensus.cc:697] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:06.473011 9678 consensus_queue.cc:1048] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:06.473347 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f32a6e8df31d482fa9b9686e002d81ff" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:06.473610 9313 raft_consensus.cc:3060] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.471685 9782 consensus_queue.cc:237] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.471241 9427 raft_consensus.cc:359] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.480540 9427 raft_consensus.cc:385] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.480887 9427 raft_consensus.cc:740] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.481614 9427 consensus_queue.cc:260] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.482898 9427 ts_tablet_manager.cc:1434] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20251215 14:55:06.483258 9427 tablet_bootstrap.cc:492] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:06.483660 9314 raft_consensus.cc:2468] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:06.484992 9427 tablet_bootstrap.cc:654] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.484282 9313 raft_consensus.cc:2468] T f32a6e8df31d482fa9b9686e002d81ff P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:06.485749 9819 tablet_loader.cc:96] loaded metadata for tablet e0c88310853f47b0aa1af9a3d676bef6 (table default.Table_a469ba7678054925965fe69d826f1c16 [id=d0891c1ad38b48348b350482a3298f39])
I20251215 14:55:06.486146 9819 tablet_loader.cc:96] loaded metadata for tablet e2104a3530264fa982b20aed20afb0b4 (table default.Table_6bd7eee6a17d43f4baf1db824203acab [id=d916193804f94519b84d259c0420e1a1])
I20251215 14:55:06.486615 9819 tablet_loader.cc:96] loaded metadata for tablet e48a6b6dfe094c34b30b8d3a44c66435 (table default.Table_a1f54fa8891f477eac38ebab96c6df39 [id=00e923cf937e4af19387ece153f163ba])
I20251215 14:55:06.487823 9819 tablet_loader.cc:96] loaded metadata for tablet f080b56cff244a46bfb73d05d3127f31 (table default.Table_371fb0a76bea4b17b74b0eb7dc573f00 [id=a81a53d1daa84a799510d1f4224eb1e1])
I20251215 14:55:06.493062 9426 tablet_bootstrap.cc:492] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.493080 9675 consensus_queue.cc:1048] T 813cfeea5399457e91623fb3abf9fd32 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:06.493281 9426 ts_tablet_manager.cc:1403] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.065s user 0.010s sys 0.020s
I20251215 14:55:06.494092 9426 raft_consensus.cc:359] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.494333 9426 raft_consensus.cc:385] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.494441 9426 raft_consensus.cc:740] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.494726 9426 consensus_queue.cc:260] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.495391 9426 ts_tablet_manager.cc:1434] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:06.495767 9426 tablet_bootstrap.cc:492] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.497624 9426 tablet_bootstrap.cc:654] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.504181 9819 tablet_loader.cc:96] loaded metadata for tablet f121a14828e6443695960c0e540ae573 (table default.Table_f416fea67a974ab084b7b48a60426131 [id=0e3677e1f3d048ecad508d50304ee56a])
I20251215 14:55:06.507788 9819 tablet_loader.cc:96] loaded metadata for tablet f830b4af355e480bbe75d6060585529e (table default.Table_b84b10eece664a31b983b31c90986bda [id=aac8c87b5b67426d86d47e2825d77f53])
I20251215 14:55:06.508186 9819 tablet_loader.cc:96] loaded metadata for tablet fc50995f6d934b58ab5f6f6f370cb7e5 (table default.Table_1209e44783914fd0875ebeca6528fa3b [id=60fd0f030f204325bf52f45926de8151])
I20251215 14:55:06.508584 9819 tablet_loader.cc:96] loaded metadata for tablet fda9eb99ccef4c16a0a947510566ecf4 (table default.Table_862e5241fcc042d8bf376e55c3c86fa0 [id=c1c5f6c604c24855a17e2dfb4174965b])
I20251215 14:55:06.514588 9426 tablet_bootstrap.cc:492] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.514799 9426 ts_tablet_manager.cc:1403] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.005s
I20251215 14:55:06.515579 9819 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251215 14:55:06.515805 9426 raft_consensus.cc:359] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.516026 9426 raft_consensus.cc:385] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.516141 9426 raft_consensus.cc:740] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.516400 9426 consensus_queue.cc:260] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.517017 9426 ts_tablet_manager.cc:1434] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:06.517343 9426 tablet_bootstrap.cc:492] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.518985 9426 tablet_bootstrap.cc:654] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.521690 9427 tablet_bootstrap.cc:492] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:06.521894 9427 ts_tablet_manager.cc:1403] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.000s
I20251215 14:55:06.522441 9435 tablet_bootstrap.cc:492] T 9425749d471f4f95bbae030977e278e4 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.522651 9435 ts_tablet_manager.cc:1403] T 9425749d471f4f95bbae030977e278e4 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.097s user 0.007s sys 0.006s
I20251215 14:55:06.522758 9427 raft_consensus.cc:359] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.523573 9435 raft_consensus.cc:359] T 9425749d471f4f95bbae030977e278e4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.524482 9435 raft_consensus.cc:385] T 9425749d471f4f95bbae030977e278e4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.524634 9435 raft_consensus.cc:740] T 9425749d471f4f95bbae030977e278e4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.525141 9435 consensus_queue.cc:260] T 9425749d471f4f95bbae030977e278e4 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.525871 9435 ts_tablet_manager.cc:1434] T 9425749d471f4f95bbae030977e278e4 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:06.530085 9507 raft_consensus.cc:493] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.530359 9507 raft_consensus.cc:515] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.530678 9435 tablet_bootstrap.cc:492] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.530697 9426 tablet_bootstrap.cc:492] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.530838 9426 ts_tablet_manager.cc:1403] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.002s
I20251215 14:55:06.531653 9426 raft_consensus.cc:359] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.531859 9426 raft_consensus.cc:385] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.531970 9426 raft_consensus.cc:740] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.532238 9426 consensus_queue.cc:260] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.532648 9507 leader_election.cc:290] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.532878 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c00aecc23c6541cbae4abd7cb1b3077b" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
W20251215 14:55:06.533500 9115 leader_election.cc:343] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.534266 9435 tablet_bootstrap.cc:654] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.534691 9426 ts_tablet_manager.cc:1434] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251215 14:55:06.535009 9426 tablet_bootstrap.cc:492] T 37181f50142f4d8bb88713221a755d50 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.536600 9426 tablet_bootstrap.cc:654] T 37181f50142f4d8bb88713221a755d50 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.532244 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c00aecc23c6541cbae4abd7cb1b3077b" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.545768 9427 raft_consensus.cc:385] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.545918 9427 raft_consensus.cc:740] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.546135 9427 consensus_queue.cc:260] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:06.546344 9112 leader_election.cc:343] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.546478 9112 leader_election.cc:304] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:06.546991 9507 raft_consensus.cc:2749] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:06.551998 9435 tablet_bootstrap.cc:492] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.552323 9435 ts_tablet_manager.cc:1403] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.000s
I20251215 14:55:06.553223 9435 raft_consensus.cc:359] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.553444 9435 raft_consensus.cc:385] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.553576 9435 raft_consensus.cc:740] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.553833 9435 consensus_queue.cc:260] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.554503 9435 ts_tablet_manager.cc:1434] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:06.555323 9435 tablet_bootstrap.cc:492] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.558388 9435 tablet_bootstrap.cc:654] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.557169 9427 ts_tablet_manager.cc:1434] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.035s user 0.002s sys 0.000s
I20251215 14:55:06.561633 9427 tablet_bootstrap.cc:492] T 062a482917794ae5a67ec685a2491ba2 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:06.564384 9427 tablet_bootstrap.cc:654] T 062a482917794ae5a67ec685a2491ba2 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.570606 9819 catalog_manager.cc:1269] Loaded cluster ID: ed5da7b2c3a646fcbe8e0bb3a7589268
I20251215 14:55:06.572079 9507 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.572252 9507 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.572906 9507 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.573602 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0215ff355fce46b5a4cf1bf4bd7164f3" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.573740 9427 tablet_bootstrap.cc:492] T 062a482917794ae5a67ec685a2491ba2 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:06.573665 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0215ff355fce46b5a4cf1bf4bd7164f3" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.573865 9313 raft_consensus.cc:2468] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:06.573899 9427 ts_tablet_manager.cc:1403] T 062a482917794ae5a67ec685a2491ba2 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20251215 14:55:06.574245 9115 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:06.574519 9112 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.574692 9617 raft_consensus.cc:2804] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.574657 9427 raft_consensus.cc:359] T 062a482917794ae5a67ec685a2491ba2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.574803 9617 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.574841 9435 tablet_bootstrap.cc:492] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.574918 9617 raft_consensus.cc:3060] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.574985 9435 ts_tablet_manager.cc:1403] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.001s
I20251215 14:55:06.575912 9435 raft_consensus.cc:359] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.576114 9435 raft_consensus.cc:385] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.576184 9435 raft_consensus.cc:740] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.576398 9435 consensus_queue.cc:260] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.576859 9435 ts_tablet_manager.cc:1434] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:06.577180 9435 tablet_bootstrap.cc:492] T 15a974e3265a4c88aa6d5005ffa04dc8 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.577845 9617 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.578567 9617 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.578936 9435 tablet_bootstrap.cc:654] T 15a974e3265a4c88aa6d5005ffa04dc8 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.579066 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0215ff355fce46b5a4cf1bf4bd7164f3" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:06.579262 9313 raft_consensus.cc:3060] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.582453 9807 raft_consensus.cc:493] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.582613 9807 raft_consensus.cc:515] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.583338 9807 leader_election.cc:290] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:06.585678 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9411030d08d40aabbdee6670ba95821" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:06.586319 9249 leader_election.cc:343] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.592573 9313 raft_consensus.cc:2468] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:06.593250 9115 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.593617 9507 raft_consensus.cc:2804] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.593770 9507 raft_consensus.cc:697] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:06.593999 9507 consensus_queue.cc:237] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.579058 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0215ff355fce46b5a4cf1bf4bd7164f3" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.597141 9427 raft_consensus.cc:385] T 062a482917794ae5a67ec685a2491ba2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.597270 9427 raft_consensus.cc:740] T 062a482917794ae5a67ec685a2491ba2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.587626 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9411030d08d40aabbdee6670ba95821" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.597498 9042 raft_consensus.cc:2468] T f9411030d08d40aabbdee6670ba95821 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:06.597607 9427 consensus_queue.cc:260] T 062a482917794ae5a67ec685a2491ba2 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.598114 9248 leader_election.cc:304] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:06.598536 9819 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251215 14:55:06.598592 9807 raft_consensus.cc:2804] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.598712 9807 raft_consensus.cc:493] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.598742 9435 tablet_bootstrap.cc:492] T 15a974e3265a4c88aa6d5005ffa04dc8 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.598804 9426 tablet_bootstrap.cc:492] T 37181f50142f4d8bb88713221a755d50 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.598807 9807 raft_consensus.cc:3060] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.598897 9435 ts_tablet_manager.cc:1403] T 15a974e3265a4c88aa6d5005ffa04dc8 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.006s
I20251215 14:55:06.598939 9426 ts_tablet_manager.cc:1403] T 37181f50142f4d8bb88713221a755d50 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.064s user 0.007s sys 0.013s
I20251215 14:55:06.599725 9426 raft_consensus.cc:359] T 37181f50142f4d8bb88713221a755d50 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.599895 9426 raft_consensus.cc:385] T 37181f50142f4d8bb88713221a755d50 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.599812 9435 raft_consensus.cc:359] T 15a974e3265a4c88aa6d5005ffa04dc8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.599977 9426 raft_consensus.cc:740] T 37181f50142f4d8bb88713221a755d50 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.600013 9435 raft_consensus.cc:385] T 15a974e3265a4c88aa6d5005ffa04dc8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.600101 9435 raft_consensus.cc:740] T 15a974e3265a4c88aa6d5005ffa04dc8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.600235 9426 consensus_queue.cc:260] T 37181f50142f4d8bb88713221a755d50 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.600348 9435 consensus_queue.cc:260] T 15a974e3265a4c88aa6d5005ffa04dc8 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.600870 9426 ts_tablet_manager.cc:1434] T 37181f50142f4d8bb88713221a755d50 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:06.601047 9435 ts_tablet_manager.cc:1434] T 15a974e3265a4c88aa6d5005ffa04dc8 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20251215 14:55:06.601137 9426 tablet_bootstrap.cc:492] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.601572 9807 raft_consensus.cc:515] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.601809 9435 tablet_bootstrap.cc:492] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.602833 9426 tablet_bootstrap.cc:654] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.603083 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9411030d08d40aabbdee6670ba95821" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:06.603891 9112 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:06.604907 9249 leader_election.cc:343] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.605075 9807 leader_election.cc:290] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:06.607969 9435 tablet_bootstrap.cc:654] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.608237 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9411030d08d40aabbdee6670ba95821" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.608438 9042 raft_consensus.cc:3060] T f9411030d08d40aabbdee6670ba95821 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.608960 9427 ts_tablet_manager.cc:1434] T 062a482917794ae5a67ec685a2491ba2 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.035s user 0.003s sys 0.000s
I20251215 14:55:06.611107 9042 raft_consensus.cc:2468] T f9411030d08d40aabbdee6670ba95821 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:06.616338 9248 leader_election.cc:304] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:06.616950 9807 raft_consensus.cc:2804] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.617164 9807 raft_consensus.cc:697] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:06.617573 9427 tablet_bootstrap.cc:492] T df70bebdc8ad4f8186ba427e840799cf P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:06.617522 9807 consensus_queue.cc:237] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.618037 9782 raft_consensus.cc:493] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.618183 9782 raft_consensus.cc:515] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.618883 9782 leader_election.cc:290] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.621114 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f38c44dbc884d74a61c7ed98deaf6aa" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:06.621368 9178 raft_consensus.cc:2468] T 7f38c44dbc884d74a61c7ed98deaf6aa P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:06.621881 8976 leader_election.cc:304] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:06.622148 9782 raft_consensus.cc:2804] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.622257 9782 raft_consensus.cc:493] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.622350 9782 raft_consensus.cc:3060] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.625406 9782 raft_consensus.cc:515] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.625746 9626 raft_consensus.cc:493] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.625887 9626 raft_consensus.cc:515] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.626509 9626 leader_election.cc:290] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.628255 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37181f50142f4d8bb88713221a755d50" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:06.628500 9178 raft_consensus.cc:2468] T 37181f50142f4d8bb88713221a755d50 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:06.629050 8976 leader_election.cc:304] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:06.629364 9626 raft_consensus.cc:2804] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.629472 9626 raft_consensus.cc:493] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.629554 9626 raft_consensus.cc:3060] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.629873 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f38c44dbc884d74a61c7ed98deaf6aa" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:06.630048 9180 raft_consensus.cc:3060] T 7f38c44dbc884d74a61c7ed98deaf6aa P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.632086 9626 raft_consensus.cc:515] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.632731 9180 raft_consensus.cc:2468] T 7f38c44dbc884d74a61c7ed98deaf6aa P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:06.633178 9626 leader_election.cc:290] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.633394 8976 leader_election.cc:304] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:06.633725 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f38c44dbc884d74a61c7ed98deaf6aa" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.633926 9313 raft_consensus.cc:2468] T 7f38c44dbc884d74a61c7ed98deaf6aa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:06.634994 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37181f50142f4d8bb88713221a755d50" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.635290 9313 raft_consensus.cc:2468] T 37181f50142f4d8bb88713221a755d50 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:06.636199 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f38c44dbc884d74a61c7ed98deaf6aa" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:06.636380 9313 raft_consensus.cc:3060] T 7f38c44dbc884d74a61c7ed98deaf6aa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.636500 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37181f50142f4d8bb88713221a755d50" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:06.636641 9314 raft_consensus.cc:3060] T 37181f50142f4d8bb88713221a755d50 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.639389 9313 raft_consensus.cc:2468] T 7f38c44dbc884d74a61c7ed98deaf6aa P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:06.639462 9314 raft_consensus.cc:2468] T 37181f50142f4d8bb88713221a755d50 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:06.639667 9782 leader_election.cc:290] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.639897 9782 raft_consensus.cc:2804] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.640074 8978 leader_election.cc:304] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.640069 9782 raft_consensus.cc:697] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:06.640468 9777 raft_consensus.cc:2804] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.640647 9777 raft_consensus.cc:697] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:06.640820 9782 consensus_queue.cc:237] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.640904 9777 consensus_queue.cc:237] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.643915 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37181f50142f4d8bb88713221a755d50" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:06.644379 9427 tablet_bootstrap.cc:654] T df70bebdc8ad4f8186ba427e840799cf P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.644376 9180 raft_consensus.cc:3060] T 37181f50142f4d8bb88713221a755d50 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.654966 9819 catalog_manager.cc:1514] Loading token signing keys...
I20251215 14:55:06.657891 9180 raft_consensus.cc:2468] T 37181f50142f4d8bb88713221a755d50 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:06.658231 9427 tablet_bootstrap.cc:492] T df70bebdc8ad4f8186ba427e840799cf P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:06.658818 9427 ts_tablet_manager.cc:1403] T df70bebdc8ad4f8186ba427e840799cf P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.041s user 0.003s sys 0.002s
I20251215 14:55:06.663717 9427 raft_consensus.cc:359] T df70bebdc8ad4f8186ba427e840799cf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.663942 9427 raft_consensus.cc:385] T df70bebdc8ad4f8186ba427e840799cf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.664016 9426 tablet_bootstrap.cc:492] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.664052 9427 raft_consensus.cc:740] T df70bebdc8ad4f8186ba427e840799cf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.664206 9426 ts_tablet_manager.cc:1403] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.063s user 0.013s sys 0.011s
I20251215 14:55:06.664321 9427 consensus_queue.cc:260] T df70bebdc8ad4f8186ba427e840799cf P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.664960 9427 ts_tablet_manager.cc:1434] T df70bebdc8ad4f8186ba427e840799cf P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251215 14:55:06.664958 9426 raft_consensus.cc:359] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.665165 9426 raft_consensus.cc:385] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.665257 9427 tablet_bootstrap.cc:492] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:06.665256 9426 raft_consensus.cc:740] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.665539 9426 consensus_queue.cc:260] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.666976 9427 tablet_bootstrap.cc:654] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.667688 9426 ts_tablet_manager.cc:1434] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:06.668018 9426 tablet_bootstrap.cc:492] T 062a482917794ae5a67ec685a2491ba2 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.668685 9819 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Loaded TSK: 0
I20251215 14:55:06.669566 9426 tablet_bootstrap.cc:654] T 062a482917794ae5a67ec685a2491ba2 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.670675 9819 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251215 14:55:06.671363 9435 tablet_bootstrap.cc:492] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.671571 9435 ts_tablet_manager.cc:1403] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.007s
I20251215 14:55:06.672349 9435 raft_consensus.cc:359] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.672588 9435 raft_consensus.cc:385] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.672685 9435 raft_consensus.cc:740] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.673000 9435 consensus_queue.cc:260] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.676743 9435 ts_tablet_manager.cc:1434] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20251215 14:55:06.681187 9435 tablet_bootstrap.cc:492] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.682729 9427 tablet_bootstrap.cc:492] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:06.682960 9427 ts_tablet_manager.cc:1403] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.004s
I20251215 14:55:06.684051 9427 raft_consensus.cc:359] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.687783 9427 raft_consensus.cc:385] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.687933 9427 raft_consensus.cc:740] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.688266 9427 consensus_queue.cc:260] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.689251 9435 tablet_bootstrap.cc:654] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.690685 9427 ts_tablet_manager.cc:1434] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20251215 14:55:06.691073 9427 tablet_bootstrap.cc:492] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:06.694053 9807 raft_consensus.cc:493] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.694232 9807 raft_consensus.cc:515] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.694666 9427 tablet_bootstrap.cc:654] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.694849 9807 leader_election.cc:290] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:06.695466 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ea4fbf5ff164c90b5b8f6dab05b9764" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:06.695703 9180 raft_consensus.cc:2468] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:06.696221 9249 leader_election.cc:304] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:06.696595 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 924c9dd0cd9d40189bfe1457040f3d37
I20251215 14:55:06.696605 9807 raft_consensus.cc:2804] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.696693 9807 raft_consensus.cc:493] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.696784 9807 raft_consensus.cc:3060] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.697712 9615 raft_consensus.cc:493] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.697858 9615 raft_consensus.cc:515] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.698500 9615 leader_election.cc:290] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.699179 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcd7d00fa01f4a9cbdf0d505684dab0e" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.699360 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ea4fbf5ff164c90b5b8f6dab05b9764" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.699565 9042 raft_consensus.cc:2468] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:06.699548 9807 raft_consensus.cc:515] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.700176 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcd7d00fa01f4a9cbdf0d505684dab0e" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.700426 9042 raft_consensus.cc:2393] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:06.700703 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ea4fbf5ff164c90b5b8f6dab05b9764" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:06.700855 9112 leader_election.cc:304] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:06.700909 9180 raft_consensus.cc:3060] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.701251 9615 raft_consensus.cc:3060] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.704083 9180 raft_consensus.cc:2468] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:06.704834 9249 leader_election.cc:304] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.705157 9675 raft_consensus.cc:2804] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.705277 9675 raft_consensus.cc:697] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:06.705417 9617 raft_consensus.cc:493] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.705554 9617 raft_consensus.cc:515] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.705562 9675 consensus_queue.cc:237] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.706131 9617 leader_election.cc:290] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.706775 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32432afc6e8d458bb7ed7abc42fb3dde" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.707185 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32432afc6e8d458bb7ed7abc42fb3dde" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.707391 9313 raft_consensus.cc:2468] T 32432afc6e8d458bb7ed7abc42fb3dde P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:06.707597 9807 leader_election.cc:290] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:06.707650 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ea4fbf5ff164c90b5b8f6dab05b9764" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.707846 9042 raft_consensus.cc:3060] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.707999 9115 leader_election.cc:304] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.708348 9617 raft_consensus.cc:2804] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.708446 9617 raft_consensus.cc:493] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.708513 9617 raft_consensus.cc:3060] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.710458 9042 raft_consensus.cc:2468] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:06.710924 9617 raft_consensus.cc:515] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:06.711584 9112 leader_election.cc:343] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.713099 9615 raft_consensus.cc:2749] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:06.714025 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32432afc6e8d458bb7ed7abc42fb3dde" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:06.714227 9313 raft_consensus.cc:3060] T 32432afc6e8d458bb7ed7abc42fb3dde P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.717069 9313 raft_consensus.cc:2468] T 32432afc6e8d458bb7ed7abc42fb3dde P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:06.717785 9115 leader_election.cc:304] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.718443 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32432afc6e8d458bb7ed7abc42fb3dde" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.718659 9617 leader_election.cc:290] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.718853 9615 raft_consensus.cc:2804] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.719121 9615 raft_consensus.cc:697] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:06.719980 9615 consensus_queue.cc:237] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.719658 9227 heartbeater.cc:499] Master 127.8.121.189:45723 was elected leader, sending a full tablet report...
W20251215 14:55:06.718950 9112 leader_election.cc:343] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.731113 8869 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 1 LEADER]: Stepping down as leader of term 1
I20251215 14:55:06.731309 8869 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f310d741d8247488792985606a1c19e, State: Running, Role: LEADER
I20251215 14:55:06.731616 8869 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 364, Committed index: 364, Last appended: 1.375, Last appended by leader: 375, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:06.732230 8869 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:06.732445 9435 tablet_bootstrap.cc:492] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.732625 9435 ts_tablet_manager.cc:1403] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.003s
I20251215 14:55:06.733572 9435 raft_consensus.cc:359] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.733764 9435 raft_consensus.cc:385] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.733850 9435 raft_consensus.cc:740] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.734109 9435 consensus_queue.cc:260] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.734647 9435 ts_tablet_manager.cc:1434] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:06.735481 8869 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Refusing update from remote peer 40747def373e4b19abfa5d21ba0a4315: Log matching property violated. Preceding OpId in replica: term: 1 index: 375. Preceding OpId from leader: term: 2 index: 365. (term mismatch)
I20251215 14:55:06.735605 8869 pending_rounds.cc:85] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Aborting all ops after (but not including) 364
I20251215 14:55:06.735620 9435 tablet_bootstrap.cc:492] T 18cd1f63d51e4565bb8c55be13e3e099 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.735734 8869 pending_rounds.cc:107] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Aborting uncommitted WRITE_OP operation due to leader change: 1.365
W20251215 14:55:06.736203 8914 catalog_manager.cc:6482] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
E20251215 14:55:06.736318 8914 catalog_manager.cc:846] Error processing tables/tablets deletions: Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
I20251215 14:55:06.736956 8869 pending_rounds.cc:107] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Aborting uncommitted WRITE_OP operation due to leader change: 1.366
W20251215 14:55:06.737285 8859 catalog_manager.cc:6689] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
I20251215 14:55:06.737380 9435 tablet_bootstrap.cc:654] T 18cd1f63d51e4565bb8c55be13e3e099 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.737555 8859 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:34038 (request call id 309) took 1320 ms. Trace:
I20251215 14:55:06.737650 8859 rpcz_store.cc:276] 1215 14:55:05.417260 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:05.420037 (+ 2777us) service_pool.cc:225] Handling call
1215 14:55:06.737502 (+1317465us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:05.519954 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 14:55:05.520110 (+ 156us) write_op.cc:432] Acquiring schema lock in shared mode
1215 14:55:05.520116 (+ 6us) write_op.cc:435] Acquired schema lock
1215 14:55:05.520137 (+ 21us) tablet.cc:660] Decoding operations
1215 14:55:05.520279 (+ 142us) write_op.cc:620] Acquiring the partition lock for write op
1215 14:55:05.520289 (+ 10us) write_op.cc:641] Partition lock acquired for write op
1215 14:55:05.520293 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
1215 14:55:05.520405 (+ 112us) tablet.cc:699] Row locks acquired
1215 14:55:05.520408 (+ 3us) write_op.cc:260] PREPARE: finished
1215 14:55:05.520458 (+ 50us) write_op.cc:270] Start()
1215 14:55:05.520484 (+ 26us) write_op.cc:276] Timestamp: P: 1765810505520376 usec, L: 0
1215 14:55:05.520488 (+ 4us) op_driver.cc:348] REPLICATION: starting
1215 14:55:05.520725 (+ 237us) log.cc:844] Serialized 628 byte log entry
1215 14:55:06.737129 (+1216404us) op_driver.cc:464] REPLICATION: finished
1215 14:55:06.737138 (+ 9us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
1215 14:55:06.737143 (+ 5us) write_op.cc:489] Releasing partition, row and schema locks
1215 14:55:06.737176 (+ 33us) write_op.cc:454] Released schema lock
1215 14:55:06.737183 (+ 7us) write_op.cc:335] FINISH: Op aborted
Metrics: {"spinlock_wait_cycles":1934592,"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":98010,"prepare.run_cpu_time_us":737,"prepare.run_wall_time_us":1231,"raft.queue_time_us":49,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":4,"replication_time_us":1216593}]]}
W20251215 14:55:06.739135 8859 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.8.121.130:55071 (request call id 68) took 1158 ms (client timeout 1000 ms). Trace:
W20251215 14:55:06.739246 8859 rpcz_store.cc:269] 1215 14:55:05.580469 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:06.738936 (+1158467us) service_pool.cc:212] Skipping call since client already timed out
1215 14:55:06.739087 (+ 151us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20251215 14:55:06.739537 8859 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.8.121.131:34335 (request call id 70) took 1151 ms (client timeout 1000 ms). Trace:
W20251215 14:55:06.739616 8859 rpcz_store.cc:269] 1215 14:55:05.588450 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:06.739433 (+1150983us) service_pool.cc:212] Skipping call since client already timed out
1215 14:55:06.739487 (+ 54us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20251215 14:55:06.739352 9427 tablet_bootstrap.cc:492] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:06.740051 9427 ts_tablet_manager.cc:1403] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.049s user 0.007s sys 0.000s
I20251215 14:55:06.740875 9427 raft_consensus.cc:359] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.741034 9427 raft_consensus.cc:385] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.741102 9427 raft_consensus.cc:740] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
W20251215 14:55:06.741851 9367 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.8.121.188:43131)
I20251215 14:55:06.745025 8869 pending_rounds.cc:107] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Aborting uncommitted WRITE_OP operation due to leader change: 1.367
W20251215 14:55:06.745965 8851 catalog_manager.cc:2202] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
I20251215 14:55:06.746277 8851 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34038 (request call id 310) took 1258 ms. Trace:
I20251215 14:55:06.746376 8851 rpcz_store.cc:276] 1215 14:55:05.487674 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:05.487988 (+ 314us) service_pool.cc:225] Handling call
1215 14:55:05.488877 (+ 889us) catalog_manager.cc:2101] Acquired catalog manager lock
1215 14:55:05.489328 (+ 451us) catalog_manager.cc:2147] Created new table and tablet info
1215 14:55:06.746245 (+1256917us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:05.521204 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 14:55:05.521329 (+ 125us) write_op.cc:432] Acquiring schema lock in shared mode
1215 14:55:05.521335 (+ 6us) write_op.cc:435] Acquired schema lock
1215 14:55:05.521337 (+ 2us) tablet.cc:660] Decoding operations
1215 14:55:05.521433 (+ 96us) write_op.cc:620] Acquiring the partition lock for write op
1215 14:55:05.521462 (+ 29us) write_op.cc:641] Partition lock acquired for write op
1215 14:55:05.521466 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
1215 14:55:05.521547 (+ 81us) tablet.cc:699] Row locks acquired
1215 14:55:05.521550 (+ 3us) write_op.cc:260] PREPARE: finished
1215 14:55:05.521599 (+ 49us) write_op.cc:270] Start()
1215 14:55:05.521625 (+ 26us) write_op.cc:276] Timestamp: P: 1765810505521536 usec, L: 0
1215 14:55:05.521628 (+ 3us) op_driver.cc:348] REPLICATION: starting
1215 14:55:05.521821 (+ 193us) log.cc:844] Serialized 433 byte log entry
1215 14:55:06.745449 (+1223628us) op_driver.cc:464] REPLICATION: finished
1215 14:55:06.745459 (+ 10us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
1215 14:55:06.745465 (+ 6us) write_op.cc:489] Releasing partition, row and schema locks
1215 14:55:06.745517 (+ 52us) write_op.cc:454] Released schema lock
1215 14:55:06.745524 (+ 7us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":31372,"prepare.run_cpu_time_us":622,"prepare.run_wall_time_us":1079,"raft.queue_time_us":48,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":1223764}]]}
I20251215 14:55:06.748594 8869 pending_rounds.cc:107] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Aborting uncommitted WRITE_OP operation due to leader change: 1.368
W20251215 14:55:06.749205 8857 catalog_manager.cc:3922] Aborted: an error occurred while updating the sys-catalog: Op aborted by new leader
I20251215 14:55:06.749444 8857 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:34038 (request call id 311) took 1261 ms. Trace:
I20251215 14:55:06.749537 8857 rpcz_store.cc:276] 1215 14:55:05.487876 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:05.489844 (+ 1968us) service_pool.cc:225] Handling call
1215 14:55:05.490175 (+ 331us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1215 14:55:05.490368 (+ 193us) catalog_manager.cc:3708] Apply alter schema
1215 14:55:05.490555 (+ 187us) catalog_manager.cc:3740] Acquired catalog manager lock
1215 14:55:05.490616 (+ 61us) catalog_manager.cc:3898] Updating metadata on disk
1215 14:55:06.749413 (+1258797us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:05.522310 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 14:55:05.527270 (+ 4960us) write_op.cc:432] Acquiring schema lock in shared mode
1215 14:55:05.527277 (+ 7us) write_op.cc:435] Acquired schema lock
1215 14:55:05.527280 (+ 3us) tablet.cc:660] Decoding operations
1215 14:55:05.527470 (+ 190us) write_op.cc:620] Acquiring the partition lock for write op
1215 14:55:05.527481 (+ 11us) write_op.cc:641] Partition lock acquired for write op
1215 14:55:05.527486 (+ 5us) tablet.cc:683] Acquiring locks for 1 operations
1215 14:55:05.527597 (+ 111us) tablet.cc:699] Row locks acquired
1215 14:55:05.527600 (+ 3us) write_op.cc:260] PREPARE: finished
1215 14:55:05.527657 (+ 57us) write_op.cc:270] Start()
1215 14:55:05.527713 (+ 56us) write_op.cc:276] Timestamp: P: 1765810505527592 usec, L: 0
1215 14:55:05.527717 (+ 4us) op_driver.cc:348] REPLICATION: starting
1215 14:55:05.528523 (+ 806us) log.cc:844] Serialized 405 byte log entry
1215 14:55:06.748859 (+1220336us) op_driver.cc:464] REPLICATION: finished
1215 14:55:06.748868 (+ 9us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
1215 14:55:06.748874 (+ 6us) write_op.cc:489] Releasing partition, row and schema locks
1215 14:55:06.748913 (+ 39us) write_op.cc:454] Released schema lock
1215 14:55:06.748920 (+ 7us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{"num_ops":1,"prepare.queue_time_us":31265,"prepare.run_cpu_time_us":948,"prepare.run_wall_time_us":6877,"raft.queue_time_us":122,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":7,"replication_time_us":1221088}]]}
I20251215 14:55:06.750684 8869 pending_rounds.cc:107] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Aborting uncommitted WRITE_OP operation due to leader change: 1.369
W20251215 14:55:06.751462 8855 catalog_manager.cc:2848] Aborted: an error occurred while updating the sys-catalog: Op aborted by new leader
I20251215 14:55:06.751706 8855 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:34038 (request call id 312) took 1254 ms. Trace:
I20251215 14:55:06.751784 8855 rpcz_store.cc:276] 1215 14:55:05.497718 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:05.503361 (+ 5643us) service_pool.cc:225] Handling call
1215 14:55:05.503797 (+ 436us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1215 14:55:05.503930 (+ 133us) catalog_manager.cc:2815] Modifying in-memory table state
1215 14:55:05.504000 (+ 70us) catalog_manager.cc:2824] Locking tablets
1215 14:55:05.504126 (+ 126us) catalog_manager.cc:2838] Removing table and tablets from system table
1215 14:55:06.751659 (+1247533us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:05.529281 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 14:55:05.529674 (+ 393us) write_op.cc:432] Acquiring schema lock in shared mode
1215 14:55:05.529680 (+ 6us) write_op.cc:435] Acquired schema lock
1215 14:55:05.529683 (+ 3us) tablet.cc:660] Decoding operations
1215 14:55:05.530064 (+ 381us) write_op.cc:620] Acquiring the partition lock for write op
1215 14:55:05.530076 (+ 12us) write_op.cc:641] Partition lock acquired for write op
1215 14:55:05.530081 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
1215 14:55:05.530463 (+ 382us) tablet.cc:699] Row locks acquired
1215 14:55:05.530466 (+ 3us) write_op.cc:260] PREPARE: finished
1215 14:55:05.530656 (+ 190us) write_op.cc:270] Start()
1215 14:55:05.530847 (+ 191us) write_op.cc:276] Timestamp: P: 1765810505530438 usec, L: 0
1215 14:55:05.530852 (+ 5us) op_driver.cc:348] REPLICATION: starting
1215 14:55:05.531599 (+ 747us) log.cc:844] Serialized 737 byte log entry
1215 14:55:06.751095 (+1219496us) op_driver.cc:464] REPLICATION: finished
1215 14:55:06.751103 (+ 8us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
1215 14:55:06.751108 (+ 5us) write_op.cc:489] Releasing partition, row and schema locks
1215 14:55:06.751150 (+ 42us) write_op.cc:454] Released schema lock
1215 14:55:06.751156 (+ 6us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":24444,"prepare.run_cpu_time_us":944,"prepare.run_wall_time_us":3058,"raft.queue_time_us":124,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":7,"replication_time_us":1220198}]]}
I20251215 14:55:06.752885 8869 pending_rounds.cc:107] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Aborting uncommitted WRITE_OP operation due to leader change: 1.370
I20251215 14:55:06.753284 9427 consensus_queue.cc:260] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:06.753742 8852 catalog_manager.cc:2202] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
I20251215 14:55:06.754030 8852 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34038 (request call id 314) took 1231 ms. Trace:
I20251215 14:55:06.754060 9427 ts_tablet_manager.cc:1434] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20251215 14:55:06.754416 9427 tablet_bootstrap.cc:492] T 32432afc6e8d458bb7ed7abc42fb3dde P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:06.754120 8852 rpcz_store.cc:276] 1215 14:55:05.522324 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:05.522425 (+ 101us) service_pool.cc:225] Handling call
1215 14:55:05.523402 (+ 977us) catalog_manager.cc:2101] Acquired catalog manager lock
1215 14:55:05.523835 (+ 433us) catalog_manager.cc:2147] Created new table and tablet info
1215 14:55:06.753983 (+1230148us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:05.532381 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 14:55:05.533776 (+ 1395us) write_op.cc:432] Acquiring schema lock in shared mode
1215 14:55:05.533783 (+ 7us) write_op.cc:435] Acquired schema lock
1215 14:55:05.533786 (+ 3us) tablet.cc:660] Decoding operations
1215 14:55:05.534125 (+ 339us) write_op.cc:620] Acquiring the partition lock for write op
1215 14:55:05.534135 (+ 10us) write_op.cc:641] Partition lock acquired for write op
1215 14:55:05.534228 (+ 93us) tablet.cc:683] Acquiring locks for 2 operations
1215 14:55:05.534579 (+ 351us) tablet.cc:699] Row locks acquired
1215 14:55:05.534582 (+ 3us) write_op.cc:260] PREPARE: finished
1215 14:55:05.534780 (+ 198us) write_op.cc:270] Start()
1215 14:55:05.535044 (+ 264us) write_op.cc:276] Timestamp: P: 1765810505534710 usec, L: 0
1215 14:55:05.535049 (+ 5us) op_driver.cc:348] REPLICATION: starting
1215 14:55:05.535940 (+ 891us) log.cc:844] Serialized 433 byte log entry
1215 14:55:06.753389 (+1217449us) op_driver.cc:464] REPLICATION: finished
1215 14:55:06.753398 (+ 9us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
1215 14:55:06.753404 (+ 6us) write_op.cc:489] Releasing partition, row and schema locks
1215 14:55:06.753445 (+ 41us) write_op.cc:454] Released schema lock
1215 14:55:06.753451 (+ 6us) write_op.cc:335] FINISH: Op aborted
Metrics: {"spinlock_wait_cycles":153344,"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":8005,"prepare.run_cpu_time_us":986,"prepare.run_wall_time_us":4357,"raft.queue_time_us":33,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":1218291}]]}
I20251215 14:55:06.754693 8852 master_service.cc:954] ReplaceTablet: received request to replace tablet f080b56cff244a46bfb73d05d3127f31 from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:06.755321 8869 pending_rounds.cc:107] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Aborting uncommitted WRITE_OP operation due to leader change: 1.371
W20251215 14:55:06.756165 8850 catalog_manager.cc:2202] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
W20251215 14:55:06.756400 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 30c5c795ea4a4fe591cdf63320ec2521
I20251215 14:55:06.756394 8850 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34038 (request call id 313) took 1234 ms. Trace:
W20251215 14:55:06.756484 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 2d75636265f14a428aae592438064ea2
W20251215 14:55:06.756606 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet df70bebdc8ad4f8186ba427e840799cf
I20251215 14:55:06.756606 9427 tablet_bootstrap.cc:654] T 32432afc6e8d458bb7ed7abc42fb3dde P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:06.756655 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet fab39532fe6a403683952057c5ccabd9
W20251215 14:55:06.756731 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 9425749d471f4f95bbae030977e278e4
W20251215 14:55:06.756796 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 813cfeea5399457e91623fb3abf9fd32
W20251215 14:55:06.756857 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 26648bf286c94b2495e565969f945858
W20251215 14:55:06.756899 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet bdfc164128a6413a83d83d05b69fb74a
I20251215 14:55:06.756486 8850 rpcz_store.cc:276] 1215 14:55:05.522170 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:05.522395 (+ 225us) service_pool.cc:225] Handling call
1215 14:55:05.524593 (+ 2198us) catalog_manager.cc:2101] Acquired catalog manager lock
1215 14:55:05.524991 (+ 398us) catalog_manager.cc:2147] Created new table and tablet info
1215 14:55:06.756363 (+1231372us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:05.536767 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 14:55:05.537151 (+ 384us) write_op.cc:432] Acquiring schema lock in shared mode
1215 14:55:05.537156 (+ 5us) write_op.cc:435] Acquired schema lock
1215 14:55:05.537159 (+ 3us) tablet.cc:660] Decoding operations
1215 14:55:05.537550 (+ 391us) write_op.cc:620] Acquiring the partition lock for write op
1215 14:55:05.537560 (+ 10us) write_op.cc:641] Partition lock acquired for write op
1215 14:55:05.537566 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
1215 14:55:05.537834 (+ 268us) tablet.cc:699] Row locks acquired
1215 14:55:05.537838 (+ 4us) write_op.cc:260] PREPARE: finished
1215 14:55:05.537962 (+ 124us) write_op.cc:270] Start()
1215 14:55:05.538082 (+ 120us) write_op.cc:276] Timestamp: P: 1765810505537895 usec, L: 0
1215 14:55:05.538086 (+ 4us) op_driver.cc:348] REPLICATION: starting
1215 14:55:05.538603 (+ 517us) log.cc:844] Serialized 433 byte log entry
1215 14:55:06.755872 (+1217269us) op_driver.cc:464] REPLICATION: finished
1215 14:55:06.755881 (+ 9us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
1215 14:55:06.755888 (+ 7us) write_op.cc:489] Releasing partition, row and schema locks
1215 14:55:06.755922 (+ 34us) write_op.cc:454] Released schema lock
1215 14:55:06.755928 (+ 6us) write_op.cc:335] FINISH: Op aborted
Metrics: {"spinlock_wait_cycles":3328,"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":11318,"prepare.run_cpu_time_us":847,"prepare.run_wall_time_us":2469,"raft.queue_time_us":120,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":1217563}]]}
W20251215 14:55:06.756994 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:06.758096 8869 pending_rounds.cc:107] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Aborting uncommitted WRITE_OP operation due to leader change: 1.372
W20251215 14:55:06.758950 8854 catalog_manager.cc:2848] Aborted: an error occurred while updating the sys-catalog: Op aborted by new leader
I20251215 14:55:06.759152 8854 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:34038 (request call id 315) took 1212 ms. Trace:
I20251215 14:55:06.759263 8854 rpcz_store.cc:276] 1215 14:55:05.546814 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:05.546873 (+ 59us) service_pool.cc:225] Handling call
1215 14:55:05.547319 (+ 446us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1215 14:55:05.547471 (+ 152us) catalog_manager.cc:2815] Modifying in-memory table state
1215 14:55:05.547535 (+ 64us) catalog_manager.cc:2824] Locking tablets
1215 14:55:05.547665 (+ 130us) catalog_manager.cc:2838] Removing table and tablets from system table
1215 14:55:06.759123 (+1211458us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:05.548455 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 14:55:05.548664 (+ 209us) write_op.cc:432] Acquiring schema lock in shared mode
1215 14:55:05.548670 (+ 6us) write_op.cc:435] Acquired schema lock
1215 14:55:05.548673 (+ 3us) tablet.cc:660] Decoding operations
1215 14:55:05.548891 (+ 218us) write_op.cc:620] Acquiring the partition lock for write op
1215 14:55:05.548902 (+ 11us) write_op.cc:641] Partition lock acquired for write op
1215 14:55:05.548907 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
1215 14:55:05.549046 (+ 139us) tablet.cc:699] Row locks acquired
1215 14:55:05.549048 (+ 2us) write_op.cc:260] PREPARE: finished
1215 14:55:05.549106 (+ 58us) write_op.cc:270] Start()
1215 14:55:05.549160 (+ 54us) write_op.cc:276] Timestamp: P: 1765810505549036 usec, L: 0
1215 14:55:05.549164 (+ 4us) op_driver.cc:348] REPLICATION: starting
1215 14:55:05.549435 (+ 271us) log.cc:844] Serialized 731 byte log entry
1215 14:55:06.758559 (+1209124us) op_driver.cc:464] REPLICATION: finished
1215 14:55:06.758568 (+ 9us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
1215 14:55:06.758574 (+ 6us) write_op.cc:489] Releasing partition, row and schema locks
1215 14:55:06.758614 (+ 40us) write_op.cc:454] Released schema lock
1215 14:55:06.758620 (+ 6us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":163,"prepare.run_cpu_time_us":862,"prepare.run_wall_time_us":1520,"raft.queue_time_us":49,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":6,"replication_time_us":1209339}]]}
I20251215 14:55:06.760376 8869 pending_rounds.cc:107] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Aborting uncommitted WRITE_OP operation due to leader change: 1.373
I20251215 14:55:06.760684 9782 consensus_queue.cc:1048] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:06.761127 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 16309efc14e747d09ce6e5de4f3c2784
W20251215 14:55:06.761191 8856 catalog_manager.cc:2848] Aborted: an error occurred while updating the sys-catalog: Op aborted by new leader
W20251215 14:55:06.761233 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bd8d964650a49b08093608abf3e31fa
W20251215 14:55:06.761284 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 37181f50142f4d8bb88713221a755d50
W20251215 14:55:06.761343 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet e6aad8bed15a416a925ae8c8870d4e51
W20251215 14:55:06.761384 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 44bd51f9bf77492b8890fc7c8411c887
I20251215 14:55:06.761372 8856 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:34038 (request call id 317) took 1197 ms. Trace:
W20251215 14:55:06.761437 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 80d4c9b533ac4facb4205aff84903134
W20251215 14:55:06.761498 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet cb2f4fc179744458bc7db2f6c7197ec5
W20251215 14:55:06.761566 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 924c9dd0cd9d40189bfe1457040f3d37
W20251215 14:55:06.761631 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet b329b0abcad742ff94c1a62a72d1b673
W20251215 14:55:06.761695 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 1141b9a4cf3e4aa78529bed7f0375ff8
W20251215 14:55:06.761751 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 11a5a6a0895c49648c910fa2ea3ca373
I20251215 14:55:06.761461 8856 rpcz_store.cc:276] 1215 14:55:05.564029 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:05.564083 (+ 54us) service_pool.cc:225] Handling call
1215 14:55:05.564816 (+ 733us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1215 14:55:05.564993 (+ 177us) catalog_manager.cc:2815] Modifying in-memory table state
1215 14:55:05.565076 (+ 83us) catalog_manager.cc:2824] Locking tablets
1215 14:55:05.565240 (+ 164us) catalog_manager.cc:2838] Removing table and tablets from system table
1215 14:55:06.761345 (+1196105us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:05.566181 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 14:55:05.566335 (+ 154us) write_op.cc:432] Acquiring schema lock in shared mode
1215 14:55:05.566342 (+ 7us) write_op.cc:435] Acquired schema lock
1215 14:55:05.566345 (+ 3us) tablet.cc:660] Decoding operations
1215 14:55:05.566474 (+ 129us) write_op.cc:620] Acquiring the partition lock for write op
1215 14:55:05.566486 (+ 12us) write_op.cc:641] Partition lock acquired for write op
1215 14:55:05.566491 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
1215 14:55:05.566605 (+ 114us) tablet.cc:699] Row locks acquired
1215 14:55:05.566608 (+ 3us) write_op.cc:260] PREPARE: finished
1215 14:55:05.566648 (+ 40us) write_op.cc:270] Start()
1215 14:55:05.566685 (+ 37us) write_op.cc:276] Timestamp: P: 1765810505566575 usec, L: 0
1215 14:55:05.566688 (+ 3us) op_driver.cc:348] REPLICATION: starting
1215 14:55:05.566886 (+ 198us) log.cc:844] Serialized 771 byte log entry
1215 14:55:06.760825 (+1193939us) op_driver.cc:464] REPLICATION: finished
1215 14:55:06.760834 (+ 9us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
1215 14:55:06.760840 (+ 6us) write_op.cc:489] Releasing partition, row and schema locks
1215 14:55:06.760873 (+ 33us) write_op.cc:454] Released schema lock
1215 14:55:06.760878 (+ 5us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":61,"prepare.run_cpu_time_us":806,"prepare.run_wall_time_us":808,"raft.queue_time_us":1031,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":14,"replication_time_us":1194070}]]}
W20251215 14:55:06.761821 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet fc9bda52c73e4aa6b7e2eb008c63391b
W20251215 14:55:06.761866 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet ce0154b24522401b9cc0e37fa502532f
W20251215 14:55:06.761968 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 4f1f902cbcb643b9b98fa3d72babba79
I20251215 14:55:06.762080 9777 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.762224 9777 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.762555 8869 pending_rounds.cc:107] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Aborting uncommitted WRITE_OP operation due to leader change: 1.374
I20251215 14:55:06.762830 9777 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.762790 9782 consensus_queue.cc:1048] T bdfc164128a6413a83d83d05b69fb74a P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:06.763187 8858 catalog_manager.cc:2202] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
I20251215 14:55:06.763422 8858 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34038 (request call id 318) took 1195 ms. Trace:
I20251215 14:55:06.763578 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0215ff355fce46b5a4cf1bf4bd7164f3" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.763803 9314 raft_consensus.cc:2393] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:06.763540 8858 rpcz_store.cc:276] 1215 14:55:05.567975 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:05.568047 (+ 72us) service_pool.cc:225] Handling call
1215 14:55:05.568938 (+ 891us) catalog_manager.cc:2101] Acquired catalog manager lock
1215 14:55:05.569423 (+ 485us) catalog_manager.cc:2147] Created new table and tablet info
1215 14:55:06.763392 (+1193969us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:05.570084 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 14:55:05.570175 (+ 91us) write_op.cc:432] Acquiring schema lock in shared mode
1215 14:55:05.570182 (+ 7us) write_op.cc:435] Acquired schema lock
1215 14:55:05.570184 (+ 2us) tablet.cc:660] Decoding operations
1215 14:55:05.570260 (+ 76us) write_op.cc:620] Acquiring the partition lock for write op
1215 14:55:05.570270 (+ 10us) write_op.cc:641] Partition lock acquired for write op
1215 14:55:05.570274 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
1215 14:55:05.570343 (+ 69us) tablet.cc:699] Row locks acquired
1215 14:55:05.570346 (+ 3us) write_op.cc:260] PREPARE: finished
1215 14:55:05.570379 (+ 33us) write_op.cc:270] Start()
1215 14:55:05.570420 (+ 41us) write_op.cc:276] Timestamp: P: 1765810505570306 usec, L: 0
1215 14:55:05.570424 (+ 4us) op_driver.cc:348] REPLICATION: starting
1215 14:55:05.570590 (+ 166us) log.cc:844] Serialized 433 byte log entry
1215 14:55:06.762665 (+1192075us) op_driver.cc:464] REPLICATION: finished
1215 14:55:06.762673 (+ 8us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
1215 14:55:06.762678 (+ 5us) write_op.cc:489] Releasing partition, row and schema locks
1215 14:55:06.762718 (+ 40us) write_op.cc:454] Released schema lock
1215 14:55:06.762724 (+ 6us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":222,"prepare.run_cpu_time_us":602,"prepare.run_wall_time_us":601,"raft.queue_time_us":67,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":6,"replication_time_us":1192201}]]}
I20251215 14:55:06.764474 8869 pending_rounds.cc:107] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: Aborting uncommitted WRITE_OP operation due to leader change: 1.375
W20251215 14:55:06.765154 8853 catalog_manager.cc:2848] Aborted: an error occurred while updating the sys-catalog: Op aborted by new leader
I20251215 14:55:06.765354 8853 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:34038 (request call id 319) took 1188 ms. Trace:
I20251215 14:55:06.765590 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0215ff355fce46b5a4cf1bf4bd7164f3" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:06.765429 8853 rpcz_store.cc:276] 1215 14:55:05.576838 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:05.577022 (+ 184us) service_pool.cc:225] Handling call
1215 14:55:05.577548 (+ 526us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1215 14:55:05.577701 (+ 153us) catalog_manager.cc:2815] Modifying in-memory table state
1215 14:55:05.577779 (+ 78us) catalog_manager.cc:2824] Locking tablets
1215 14:55:05.577894 (+ 115us) catalog_manager.cc:2838] Removing table and tablets from system table
1215 14:55:06.765310 (+1187416us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:05.578496 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 14:55:05.578602 (+ 106us) write_op.cc:432] Acquiring schema lock in shared mode
1215 14:55:05.578608 (+ 6us) write_op.cc:435] Acquired schema lock
1215 14:55:05.578611 (+ 3us) tablet.cc:660] Decoding operations
1215 14:55:05.578716 (+ 105us) write_op.cc:620] Acquiring the partition lock for write op
1215 14:55:05.578727 (+ 11us) write_op.cc:641] Partition lock acquired for write op
1215 14:55:05.578731 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
1215 14:55:05.578803 (+ 72us) tablet.cc:699] Row locks acquired
1215 14:55:05.578805 (+ 2us) write_op.cc:260] PREPARE: finished
1215 14:55:05.578841 (+ 36us) write_op.cc:270] Start()
1215 14:55:05.578873 (+ 32us) write_op.cc:276] Timestamp: P: 1765810505578765 usec, L: 0
1215 14:55:05.578877 (+ 4us) op_driver.cc:348] REPLICATION: starting
1215 14:55:05.579042 (+ 165us) log.cc:844] Serialized 533 byte log entry
1215 14:55:06.764570 (+1185528us) op_driver.cc:464] REPLICATION: finished
1215 14:55:06.764578 (+ 8us) op_driver.cc:389] HandleFailure(Aborted: Op aborted by new leader)
1215 14:55:06.764583 (+ 5us) write_op.cc:489] Releasing partition, row and schema locks
1215 14:55:06.764613 (+ 30us) write_op.cc:454] Released schema lock
1215 14:55:06.764619 (+ 6us) write_op.cc:335] FINISH: Op aborted
Metrics: {"child_traces":[["op",{"num_ops":2,"prepare.queue_time_us":49,"prepare.run_cpu_time_us":636,"prepare.run_wall_time_us":637,"raft.queue_time_us":422,"raft.run_cpu_time_us":5,"raft.run_wall_time_us":7,"replication_time_us":1185650}]]}
I20251215 14:55:06.765966 8853 master_service.cc:954] ReplaceTablet: received request to replace tablet 61aef86a30e842f2a90f9f1c88c84f4d from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:06.766337 9782 raft_consensus.cc:493] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.766393 8976 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:06.766500 9782 raft_consensus.cc:515] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.766840 9777 raft_consensus.cc:3060] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.767107 9782 leader_election.cc:290] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.767679 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a974e3265a4c88aa6d5005ffa04dc8" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.767868 9314 raft_consensus.cc:2468] T 15a974e3265a4c88aa6d5005ffa04dc8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:06.768390 8978 leader_election.cc:304] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.769228 9782 raft_consensus.cc:2804] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.769322 9782 raft_consensus.cc:493] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.769416 9782 raft_consensus.cc:3060] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.769603 9777 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:06.770105 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a974e3265a4c88aa6d5005ffa04dc8" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:06.770670 8976 leader_election.cc:343] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.772253 9782 raft_consensus.cc:515] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.773229 9782 leader_election.cc:290] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.773530 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a974e3265a4c88aa6d5005ffa04dc8" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:06.773715 9314 raft_consensus.cc:3060] T 15a974e3265a4c88aa6d5005ffa04dc8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.775457 8857 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:34038 (request call id 320) took 1188 ms. Trace:
I20251215 14:55:06.775571 8857 rpcz_store.cc:276] 1215 14:55:05.586714 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:06.750130 (+1163416us) service_pool.cc:225] Handling call
1215 14:55:06.775237 (+ 25107us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x616000041254. stack: 00007f31a341bee6 00007f31a341bca0 00007f31a23f73ad 0000000000984f94 0000000000984f5d 00007f31b27416bd 00007f31b27417b3 00007f31af308521 00007f31b6fc796d 00007f31b71551b6 00007f31adc60486 00007f31adc601b5 00007f31aa3da56e 00007f31aa3d944e 00007f31aa3df685 00007f31aa3dffaf
1215 14:55:06.775419 (+ 182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":57158912}
I20251215 14:55:06.775857 8857 master_service.cc:954] ReplaceTablet: received request to replace tablet 16edd0bfd67848e688fa12d9c679fdac from {username='slave'} at 127.0.0.1:34038
I20251215 14:55:06.776158 8857 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:34038 (request call id 328) took 1110 ms. Trace:
I20251215 14:55:06.776235 8857 rpcz_store.cc:276] 1215 14:55:05.665860 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:06.775805 (+1109945us) service_pool.cc:225] Handling call
1215 14:55:06.776114 (+ 309us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 14:55:06.776319 9314 raft_consensus.cc:2468] T 15a974e3265a4c88aa6d5005ffa04dc8 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:06.776669 8857 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34038 (request call id 329) took 1110 ms. Trace:
I20251215 14:55:06.776788 8857 rpcz_store.cc:276] 1215 14:55:05.666560 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:06.776372 (+1109812us) service_pool.cc:225] Handling call
1215 14:55:06.776621 (+ 249us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 14:55:06.776939 8978 leader_election.cc:304] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.777232 8857 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:34038 (request call id 330) took 1104 ms. Trace:
I20251215 14:55:06.777309 8857 rpcz_store.cc:276] 1215 14:55:05.672332 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:06.776947 (+1104615us) service_pool.cc:225] Handling call
1215 14:55:06.777189 (+ 242us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 14:55:06.777599 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15a974e3265a4c88aa6d5005ffa04dc8" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:06.777724 8857 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:34038 (request call id 331) took 1100 ms. Trace:
I20251215 14:55:06.777809 8857 rpcz_store.cc:276] 1215 14:55:05.676999 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:06.777463 (+1100464us) service_pool.cc:225] Handling call
1215 14:55:06.777679 (+ 216us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20251215 14:55:06.778103 8976 leader_election.cc:343] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.778195 8857 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:34038 (request call id 332) took 1092 ms. Trace:
I20251215 14:55:06.778268 8857 rpcz_store.cc:276] 1215 14:55:05.685325 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:06.777929 (+1092604us) service_pool.cc:225] Handling call
1215 14:55:06.778153 (+ 224us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 14:55:06.778865 8854 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34038 (request call id 324) took 1167 ms. Trace:
I20251215 14:55:06.778961 8854 rpcz_store.cc:276] 1215 14:55:05.611209 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:06.759758 (+1148549us) service_pool.cc:225] Handling call
1215 14:55:06.778691 (+ 18933us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x616000041254. stack: 00007f31a341bee6 00007f31a341bca0 00007f31a23f73ad 0000000000984f94 0000000000984f5d 00007f31b27416bd 00007f31b27417b3 00007f31af308521 00007f31b6fc796d 00007f31b71541c3 00007f31adc5e7c6 00007f31adc5e4f5 00007f31aa3da56e 00007f31aa3d944e 00007f31aa3df685 00007f31aa3dffaf
1215 14:55:06.778835 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":42935680}
I20251215 14:55:06.779232 8854 master_service.cc:954] ReplaceTablet: received request to replace tablet cb2f4fc179744458bc7db2f6c7197ec5 from {username='slave'} at 127.0.0.1:34038
W20251215 14:55:06.779397 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 4816503e4fa1459dbb311997be85f64a
W20251215 14:55:06.779570 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 2df2138e41844e9f897e57264b62cc9d
W20251215 14:55:06.779628 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet c0d0022e48f04b83ac1c998a83fe3f55
W20251215 14:55:06.779682 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 92e21a77ad074572a57b836743903a0b
W20251215 14:55:06.779819 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 26876cdffd7e4664bc8f7efb74885776
W20251215 14:55:06.779883 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet f2aae2798eee4775afaa3afc59e98a6c
W20251215 14:55:06.780021 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 32432afc6e8d458bb7ed7abc42fb3dde
W20251215 14:55:06.780237 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 194bb745ecb849cb9092fee1afb7dbe6
W20251215 14:55:06.780279 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 95583eee8a5041b1ade97e8f8f0db271
W20251215 14:55:06.780354 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 062a482917794ae5a67ec685a2491ba2
W20251215 14:55:06.780395 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet f9411030d08d40aabbdee6670ba95821
W20251215 14:55:06.780447 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 018bd6ac8a534a6abc461b57b89b93eb
W20251215 14:55:06.780486 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet f9695d47e35448fdad95ff3f24bafd03
W20251215 14:55:06.780582 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 188eb879e7c3479ea71c5b1864400243
W20251215 14:55:06.780624 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 0db6246dee2643d98094408410618259
W20251215 14:55:06.780676 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 15a974e3265a4c88aa6d5005ffa04dc8
W20251215 14:55:06.780714 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 5f03dfdd546c492185c6c31866a090a5
W20251215 14:55:06.780797 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet f32a6e8df31d482fa9b9686e002d81ff
W20251215 14:55:06.782542 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 034fec793ae74fcda0c73f1cea291311
W20251215 14:55:06.782644 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 4a6846144c8c409cad340e99374a38c6
W20251215 14:55:06.783453 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 5e80ac7bd98a46119a30bd5d2f3de2f9
I20251215 14:55:06.786471 9615 raft_consensus.cc:493] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.786669 9615 raft_consensus.cc:515] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.787436 9615 leader_election.cc:290] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.787747 9675 raft_consensus.cc:493] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.787942 9675 raft_consensus.cc:515] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.788069 8856 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34038 (request call id 325) took 1139 ms. Trace:
I20251215 14:55:06.788185 8856 rpcz_store.cc:276] 1215 14:55:05.648465 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:06.761919 (+1113454us) service_pool.cc:225] Handling call
1215 14:55:06.787818 (+ 25899us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x616000041254. stack: 00007f31a341bee6 00007f31a341bca0 00007f31a23f73ad 0000000000984f94 0000000000984f5d 00007f31b27416bd 00007f31b27417b3 00007f31af308521 00007f31b6fc796d 00007f31b71541c3 00007f31adc5e7c6 00007f31adc5e4f5 00007f31aa3da56e 00007f31aa3d944e 00007f31aa3df685 00007f31aa3dffaf
1215 14:55:06.788023 (+ 205us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":58869504}
I20251215 14:55:06.788619 9675 leader_election.cc:290] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:06.789166 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1141b9a4cf3e4aa78529bed7f0375ff8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:06.789260 8853 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:34038 (request call id 327) took 1129 ms. Trace:
I20251215 14:55:06.789345 9178 raft_consensus.cc:2468] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:06.789376 8853 rpcz_store.cc:276] 1215 14:55:05.659880 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:06.765891 (+1106011us) service_pool.cc:225] Handling call
1215 14:55:06.789066 (+ 23175us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x616000041254. stack: 00007f31a341bee6 00007f31a341bca0 00007f31a23f73ad 0000000000984f94 0000000000984f5d 00007f31b27416bd 00007f31b27417b3 00007f31af308521 00007f31b6fc796d 00007f31b7160f0b 00007f31adc6b107 00007f31adc6ae35 00007f31aa3da56e 00007f31aa3d944e 00007f31aa3df685 00007f31aa3dffaf
1215 14:55:06.789230 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":52524800}
I20251215 14:55:06.789744 9249 leader_election.cc:304] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.790026 8858 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34038 (request call id 326) took 1136 ms. Trace:
I20251215 14:55:06.790122 8858 rpcz_store.cc:276] 1215 14:55:05.653630 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:06.764010 (+1110380us) service_pool.cc:225] Handling call
1215 14:55:06.789855 (+ 25845us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x616000041254. stack: 00007f31a341bee6 00007f31a341bca0 00007f31a23f73ad 0000000000984f94 0000000000984f5d 00007f31b27416bd 00007f31b27417b3 00007f31af308521 00007f31b6fc796d 00007f31b71541c3 00007f31adc5e7c6 00007f31adc5e4f5 00007f31aa3da56e 00007f31aa3d944e 00007f31aa3df685 00007f31aa3dffaf
1215 14:55:06.789994 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":58860800}
I20251215 14:55:06.790342 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1141b9a4cf3e4aa78529bed7f0375ff8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.790568 9042 raft_consensus.cc:2468] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:06.790647 8855 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34038 (request call id 321) took 1199 ms. Trace:
I20251215 14:55:06.790717 8855 rpcz_store.cc:276] 1215 14:55:05.591038 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:06.752300 (+1161262us) service_pool.cc:225] Handling call
1215 14:55:06.790476 (+ 38176us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x616000041254. stack: 00007f31a341bee6 00007f31a341bca0 00007f31a23f73ad 0000000000984f94 0000000000984f5d 00007f31b27416bd 00007f31b27417b3 00007f31af308521 00007f31b6fc796d 00007f31b71541c3 00007f31adc5e7c6 00007f31adc5e4f5 00007f31aa3da56e 00007f31aa3d944e 00007f31aa3df685 00007f31aa3dffaf
1215 14:55:06.790603 (+ 127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":87253376}
I20251215 14:55:06.791195 8850 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:34038 (request call id 322) took 1183 ms. Trace:
I20251215 14:55:06.791220 9675 raft_consensus.cc:2804] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.791321 9675 raft_consensus.cc:493] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.791291 8850 rpcz_store.cc:276] 1215 14:55:05.608102 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:06.757002 (+1148900us) service_pool.cc:225] Handling call
1215 14:55:06.791011 (+ 34009us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x616000041254. stack: 00007f31a341bee6 00007f31a341bca0 00007f31a23f73ad 0000000000984f94 0000000000984f5d 00007f31b27416bd 00007f31b27417b3 00007f31af308521 00007f31b6fc796d 00007f31b71541c3 00007f31adc5e7c6 00007f31adc5e4f5 00007f31aa3da56e 00007f31aa3d944e 00007f31aa3df685 00007f31aa3dffaf
1215 14:55:06.791144 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":77666048}
I20251215 14:55:06.791407 9675 raft_consensus.cc:3060] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.791818 8852 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:34038 (request call id 323) took 1183 ms. Trace:
I20251215 14:55:06.791916 8852 rpcz_store.cc:276] 1215 14:55:05.608712 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:06.754623 (+1145911us) service_pool.cc:225] Handling call
1215 14:55:06.791643 (+ 37020us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x616000041254. stack: 00007f31a341bee6 00007f31a341bca0 00007f31a23f73ad 0000000000984f94 0000000000984f5d 00007f31b27416bd 00007f31b27417b3 00007f31af308521 00007f31b6fc796d 00007f31b7160f0b 00007f31adc6b107 00007f31adc6ae35 00007f31aa3da56e 00007f31aa3d944e 00007f31aa3df685 00007f31aa3dffaf
1215 14:55:06.791788 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":84445952}
I20251215 14:55:06.794142 9675 raft_consensus.cc:515] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.795218 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1141b9a4cf3e4aa78529bed7f0375ff8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.795475 9042 raft_consensus.cc:3060] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.795614 8857 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:34038 (request call id 333) took 1101 ms. Trace:
I20251215 14:55:06.795703 8857 rpcz_store.cc:276] 1215 14:55:05.694166 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:06.778383 (+1084217us) service_pool.cc:225] Handling call
1215 14:55:06.795560 (+ 17177us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 14:55:06.798264 9042 raft_consensus.cc:2468] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:06.798475 8914 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251215 14:55:06.798672 9782 raft_consensus.cc:2804] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.798782 9615 raft_consensus.cc:493] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.798938 9782 raft_consensus.cc:697] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:06.798952 9615 raft_consensus.cc:515] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.799258 9248 leader_election.cc:304] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.799351 9782 consensus_queue.cc:237] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.799563 9807 raft_consensus.cc:2804] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.799646 9615 leader_election.cc:290] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.799733 9807 raft_consensus.cc:697] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:06.799996 9807 consensus_queue.cc:237] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.801134 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9b39c879d444172871f43349978dc86" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.801309 9041 raft_consensus.cc:2468] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:06.801620 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9b39c879d444172871f43349978dc86" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.801792 9313 raft_consensus.cc:2468] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:06.801872 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1141b9a4cf3e4aa78529bed7f0375ff8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:06.802027 9178 raft_consensus.cc:3060] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.802211 9115 leader_election.cc:304] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.802489 9615 raft_consensus.cc:2804] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.802587 9615 raft_consensus.cc:493] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.802685 9615 raft_consensus.cc:3060] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.804893 9178 raft_consensus.cc:2468] T 1141b9a4cf3e4aa78529bed7f0375ff8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:06.805197 9615 raft_consensus.cc:515] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.806181 9310 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9b39c879d444172871f43349978dc86" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:06.806377 9310 raft_consensus.cc:3060] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.807179 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9b39c879d444172871f43349978dc86" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.807334 9041 raft_consensus.cc:3060] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.808940 9310 raft_consensus.cc:2468] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:06.809300 8785 master_service.cc:954] ReplaceTablet: received request to replace tablet 18cd1f63d51e4565bb8c55be13e3e099 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:06.809517 9115 leader_election.cc:304] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.809803 9041 raft_consensus.cc:2468] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:06.810061 9617 raft_consensus.cc:2804] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.810182 9617 raft_consensus.cc:697] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:06.810483 9615 leader_election.cc:290] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.810459 9617 consensus_queue.cc:237] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.812724 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f080b56cff244a46bfb73d05d3127f31" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:06.813213 9112 leader_election.cc:343] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.813524 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f080b56cff244a46bfb73d05d3127f31" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.813824 9314 raft_consensus.cc:2468] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:06.814291 9115 leader_election.cc:304] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:06.814606 9675 leader_election.cc:290] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:06.814947 9615 raft_consensus.cc:2804] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.815119 9615 raft_consensus.cc:493] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.815277 9615 raft_consensus.cc:3060] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.818279 9615 raft_consensus.cc:515] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.819844 9615 leader_election.cc:290] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.820349 9907 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.820588 9907 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:06.821281 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f080b56cff244a46bfb73d05d3127f31" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
W20251215 14:55:06.821898 9112 leader_election.cc:343] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:06.822288 9367 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.8.121.189:45723)
W20251215 14:55:06.822778 9367 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.8.121.189:45723)
W20251215 14:55:06.823124 9367 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.8.121.189:45723)
I20251215 14:55:06.824424 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f080b56cff244a46bfb73d05d3127f31" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:06.824723 9314 raft_consensus.cc:3060] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.828907 9314 raft_consensus.cc:2468] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:06.832779 9435 tablet_bootstrap.cc:492] T 18cd1f63d51e4565bb8c55be13e3e099 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.833084 9115 leader_election.cc:304] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:06.833691 9615 raft_consensus.cc:2804] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.834093 9615 raft_consensus.cc:697] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:06.834528 9615 consensus_queue.cc:237] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.835873 9675 consensus_queue.cc:1048] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:06.836519 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_83a4b5504c4e4edbb77b41a026d2e0eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:06.838402 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_83a4b5504c4e4edbb77b41a026d2e0eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:06.840658 9435 ts_tablet_manager.cc:1403] T 18cd1f63d51e4565bb8c55be13e3e099 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.105s user 0.002s sys 0.006s
I20251215 14:55:06.841531 9896 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 365, Last known committed idx: 364, Time since last communication: 0.000s
I20251215 14:55:06.842425 9435 raft_consensus.cc:359] T 18cd1f63d51e4565bb8c55be13e3e099 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.843019 9435 raft_consensus.cc:385] T 18cd1f63d51e4565bb8c55be13e3e099 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.843533 9435 raft_consensus.cc:740] T 18cd1f63d51e4565bb8c55be13e3e099 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.845513 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:55:06.846685 9714 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Refusing update from remote peer 40747def373e4b19abfa5d21ba0a4315: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 2 index: 365. (index mismatch)
I20251215 14:55:06.846629 8783 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_fb8fb745144644eea96b20d598f52fa2" } new_table_name: "default.Table_99268441afd84c5fbfbd1080deabb144" modify_external_catalogs: true
I20251215 14:55:06.848610 9676 consensus_queue.cc:1048] T fc9bda52c73e4aa6b7e2eb008c63391b P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:06.848946 9435 consensus_queue.cc:260] T 18cd1f63d51e4565bb8c55be13e3e099 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.849308 8782 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ae411cdd8f1740839d5490d643672e18" } modify_external_catalogs: true
I20251215 14:55:06.849568 9435 ts_tablet_manager.cc:1434] T 18cd1f63d51e4565bb8c55be13e3e099 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20251215 14:55:06.849524 8782 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ae411cdd8f1740839d5490d643672e18" } modify_external_catalogs: true
I20251215 14:55:06.849988 9435 tablet_bootstrap.cc:492] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.850498 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_9b34c87957f84ac085d807b10a2eec83"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:06.851195 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_68741bcb63154f56abf551a2c960108c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:06.851616 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b34c87957f84ac085d807b10a2eec83 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:06.851851 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_68741bcb63154f56abf551a2c960108c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:06.853498 8779 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_b84b10eece664a31b983b31c90986bda" } modify_external_catalogs: true
I20251215 14:55:06.853742 8779 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_b84b10eece664a31b983b31c90986bda" } modify_external_catalogs: true
I20251215 14:55:06.857666 9435 tablet_bootstrap.cc:654] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.858253 9426 tablet_bootstrap.cc:492] T 062a482917794ae5a67ec685a2491ba2 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.858456 9426 ts_tablet_manager.cc:1403] T 062a482917794ae5a67ec685a2491ba2 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.191s user 0.004s sys 0.004s
I20251215 14:55:06.864725 9426 raft_consensus.cc:359] T 062a482917794ae5a67ec685a2491ba2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.856714 9896 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 365, Last known committed idx: 15, Time since last communication: 0.001s
I20251215 14:55:06.865120 9426 raft_consensus.cc:385] T 062a482917794ae5a67ec685a2491ba2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.865806 9426 raft_consensus.cc:740] T 062a482917794ae5a67ec685a2491ba2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.877082 9435 tablet_bootstrap.cc:492] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.877250 9435 ts_tablet_manager.cc:1403] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.003s
I20251215 14:55:06.878058 9435 raft_consensus.cc:359] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.878247 9435 raft_consensus.cc:385] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.878348 9435 raft_consensus.cc:740] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.878553 9435 consensus_queue.cc:260] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.879287 9435 ts_tablet_manager.cc:1434] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:06.868074 9426 consensus_queue.cc:260] T 062a482917794ae5a67ec685a2491ba2 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.879570 9435 tablet_bootstrap.cc:492] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.879989 9426 ts_tablet_manager.cc:1434] T 062a482917794ae5a67ec685a2491ba2 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20251215 14:55:06.881632 9435 tablet_bootstrap.cc:654] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.890120 9907 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:06.891603 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:06.894656 9435 tablet_bootstrap.cc:492] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.894846 9435 ts_tablet_manager.cc:1403] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.003s
I20251215 14:55:06.895746 9435 raft_consensus.cc:359] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.895948 9435 raft_consensus.cc:385] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.896020 9435 raft_consensus.cc:740] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.880606 9426 tablet_bootstrap.cc:492] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:06.897430 9435 consensus_queue.cc:260] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.898011 9435 ts_tablet_manager.cc:1434] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:06.898346 9435 tablet_bootstrap.cc:492] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.903359 9435 tablet_bootstrap.cc:654] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.905328 9912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40747def373e4b19abfa5d21ba0a4315. Latest consensus state: current_term: 2 leader_uuid: "40747def373e4b19abfa5d21ba0a4315" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:55:06.905611 9912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [sys.catalog]: This master's current role is: FOLLOWER
I20251215 14:55:06.893546 9591 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:55:06.914834 9435 tablet_bootstrap.cc:492] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:06.915001 9435 ts_tablet_manager.cc:1403] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.006s
I20251215 14:55:06.915861 9435 raft_consensus.cc:359] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.916086 9435 raft_consensus.cc:385] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.916184 9435 raft_consensus.cc:740] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.916433 9435 consensus_queue.cc:260] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.917645 9435 ts_tablet_manager.cc:1434] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20251215 14:55:06.917964 9435 tablet_bootstrap.cc:492] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:06.919541 9907 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 14:55:06.919903 9435 tablet_bootstrap.cc:654] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.924799 9426 tablet_bootstrap.cc:654] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.926118 9626 raft_consensus.cc:493] T df70bebdc8ad4f8186ba427e840799cf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.926283 9626 raft_consensus.cc:515] T df70bebdc8ad4f8186ba427e840799cf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.926936 9626 leader_election.cc:290] T df70bebdc8ad4f8186ba427e840799cf P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:06.927672 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df70bebdc8ad4f8186ba427e840799cf" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:06.928254 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df70bebdc8ad4f8186ba427e840799cf" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:06.928575 9311 raft_consensus.cc:2393] T df70bebdc8ad4f8186ba427e840799cf P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:06.929103 8978 leader_election.cc:304] T df70bebdc8ad4f8186ba427e840799cf P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:06.929741 9626 raft_consensus.cc:3060] T df70bebdc8ad4f8186ba427e840799cf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.932817 9626 raft_consensus.cc:2749] T df70bebdc8ad4f8186ba427e840799cf P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:06.935930 9427 tablet_bootstrap.cc:492] T 32432afc6e8d458bb7ed7abc42fb3dde P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:06.936210 9427 ts_tablet_manager.cc:1403] T 32432afc6e8d458bb7ed7abc42fb3dde P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.182s user 0.009s sys 0.011s
I20251215 14:55:06.937301 9905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "40747def373e4b19abfa5d21ba0a4315" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:55:06.937795 9905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [sys.catalog]: This master's current role is: LEADER
I20251215 14:55:06.939261 9675 consensus_queue.cc:1048] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:06.939153 8787 catalog_manager.cc:5654] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e89303a500544272b601d7c29be802b4 (127.8.121.131). New cstate: current_term: 1 leader_uuid: "e89303a500544272b601d7c29be802b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: HEALTHY } } }
I20251215 14:55:06.940099 8787 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 (table default.Table_0593d9b93de9400ba29718af1b328262 [id=50a94314f5ba46e3a75b5a15e7362299]). Expected version 1 got 0
I20251215 14:55:06.940215 8784 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_20d2c5b358444df59324e21800508f8d" } modify_external_catalogs: true
I20251215 14:55:06.940433 8784 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_20d2c5b358444df59324e21800508f8d" } modify_external_catalogs: true
I20251215 14:55:06.942840 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet c00aecc23c6541cbae4abd7cb1b3077b (table default.Table_4372b5372fdf4a0d991207a20dcbca19 [id=640d70bd78554e92823dc104e06227d3]). Expected version 2 got 0
W20251215 14:55:06.942875 8976 consensus_peers.cc:597] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20251215 14:55:06.943931 8788 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet c00aecc23c6541cbae4abd7cb1b3077b (table default.Table_4372b5372fdf4a0d991207a20dcbca19 [id=640d70bd78554e92823dc104e06227d3], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet c00aecc23c6541cbae4abd7cb1b3077b consensus state has no leader
I20251215 14:55:06.944482 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_07a3e98683664565943371f2c3fb4d65"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:06.945089 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07a3e98683664565943371f2c3fb4d65 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:06.947014 9089 heartbeater.cc:499] Master 127.8.121.189:45723 was elected leader, sending a full tablet report...
I20251215 14:55:06.949419 9675 raft_consensus.cc:493] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.949666 9675 raft_consensus.cc:515] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.950397 9675 leader_election.cc:290] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:06.951011 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c00aecc23c6541cbae4abd7cb1b3077b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:06.951094 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c00aecc23c6541cbae4abd7cb1b3077b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:06.951292 9041 raft_consensus.cc:2468] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:06.951339 9180 raft_consensus.cc:2468] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:06.952358 9248 leader_election.cc:304] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.952904 9675 raft_consensus.cc:2804] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:06.953009 9675 raft_consensus.cc:493] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:06.953110 9675 raft_consensus.cc:3060] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.955932 9675 raft_consensus.cc:515] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.957206 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c00aecc23c6541cbae4abd7cb1b3077b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:06.957453 9041 raft_consensus.cc:3060] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.959128 9427 raft_consensus.cc:359] T 32432afc6e8d458bb7ed7abc42fb3dde P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.959358 9427 raft_consensus.cc:385] T 32432afc6e8d458bb7ed7abc42fb3dde P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.959436 9427 raft_consensus.cc:740] T 32432afc6e8d458bb7ed7abc42fb3dde P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.960150 9041 raft_consensus.cc:2468] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:06.962193 9912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "40747def373e4b19abfa5d21ba0a4315" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:55:06.962437 9912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [sys.catalog]: This master's current role is: FOLLOWER
I20251215 14:55:06.971031 8781 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_a88c3e4ed8414aaeb07e01a30cc69f50" } modify_external_catalogs: true
I20251215 14:55:06.971323 8781 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_a88c3e4ed8414aaeb07e01a30cc69f50" } modify_external_catalogs: true
I20251215 14:55:06.972267 8780 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_6ee288ff34ea426582a74cc4cf626490" } modify_external_catalogs: true
I20251215 14:55:06.972479 8780 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_6ee288ff34ea426582a74cc4cf626490" } modify_external_catalogs: true
W20251215 14:55:06.974558 8775 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet c00aecc23c6541cbae4abd7cb1b3077b (table default.Table_4372b5372fdf4a0d991207a20dcbca19 [id=640d70bd78554e92823dc104e06227d3], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet c00aecc23c6541cbae4abd7cb1b3077b consensus state has no leader
I20251215 14:55:06.975756 9426 tablet_bootstrap.cc:492] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:06.975998 9426 ts_tablet_manager.cc:1403] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.096s user 0.003s sys 0.003s
I20251215 14:55:06.976809 9426 raft_consensus.cc:359] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.977313 9426 raft_consensus.cc:385] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:06.981992 9427 consensus_queue.cc:260] T 32432afc6e8d458bb7ed7abc42fb3dde P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.982959 9427 ts_tablet_manager.cc:1434] T 32432afc6e8d458bb7ed7abc42fb3dde P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.047s user 0.002s sys 0.000s
I20251215 14:55:06.983371 9427 tablet_bootstrap.cc:492] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:06.978003 9426 raft_consensus.cc:740] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:06.985153 9427 tablet_bootstrap.cc:654] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:06.985242 9248 leader_election.cc:304] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:06.985579 9807 raft_consensus.cc:493] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:06.985725 9807 raft_consensus.cc:515] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.986002 9675 leader_election.cc:290] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:06.986176 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:06.986307 9807 leader_election.cc:290] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:06.986729 9807 raft_consensus.cc:2804] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:06.986877 9807 raft_consensus.cc:697] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:06.987118 9807 consensus_queue.cc:237] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.987613 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e70b4070b6437e9b934af4e6b93f6a" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:06.987632 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c00aecc23c6541cbae4abd7cb1b3077b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:06.989614 9180 raft_consensus.cc:3060] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:06.993587 9180 raft_consensus.cc:2468] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
W20251215 14:55:06.995487 9249 leader_election.cc:343] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:06.996367 9426 consensus_queue.cc:260] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:06.998643 9426 ts_tablet_manager.cc:1434] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20251215 14:55:07.000490 9426 tablet_bootstrap.cc:492] T ce0154b24522401b9cc0e37fa502532f P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:07.015105 9615 consensus_queue.cc:1048] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:06.994155 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e70b4070b6437e9b934af4e6b93f6a" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:07.027110 9426 tablet_bootstrap.cc:654] T ce0154b24522401b9cc0e37fa502532f P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:07.031044 9435 tablet_bootstrap.cc:492] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:07.031294 9435 ts_tablet_manager.cc:1403] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.113s user 0.021s sys 0.016s
I20251215 14:55:07.033741 9435 raft_consensus.cc:359] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.034004 9435 raft_consensus.cc:385] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:07.034097 9435 raft_consensus.cc:740] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
W20251215 14:55:07.035211 9248 leader_election.cc:343] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:07.035481 9248 leader_election.cc:304] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:07.035851 9807 raft_consensus.cc:2749] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:07.035868 8787 master_service.cc:954] ReplaceTablet: received request to replace tablet 16edd0bfd67848e688fa12d9c679fdac from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:07.036444 9435 consensus_queue.cc:260] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.036711 8785 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 18cd1f63d51e4565bb8c55be13e3e099
I20251215 14:55:07.037544 8785 catalog_manager.cc:6724] ReplaceTablet: tablet 18cd1f63d51e4565bb8c55be13e3e099 deleted and replaced by tablet b0b80d0919774ae3ab892d0e29b19b16
I20251215 14:55:07.038424 9435 ts_tablet_manager.cc:1434] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20251215 14:55:07.040679 9435 tablet_bootstrap.cc:492] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:07.042764 9180 raft_consensus.cc:3060] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:07.042812 9362 heartbeater.cc:499] Master 127.8.121.189:45723 was elected leader, sending a full tablet report...
I20251215 14:55:07.044317 9435 tablet_bootstrap.cc:654] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:07.049643 9807 raft_consensus.cc:493] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:07.049814 9807 raft_consensus.cc:515] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.050390 9807 leader_election.cc:290] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:07.051081 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4af4cf6ec825467383349098eda661c6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:07.051631 9248 leader_election.cc:343] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:07.053805 9676 consensus_queue.cc:1048] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:07.054237 9427 tablet_bootstrap.cc:492] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:07.054220 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4af4cf6ec825467383349098eda661c6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:07.054376 9427 ts_tablet_manager.cc:1403] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.000s
I20251215 14:55:07.054814 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 15b8a2a337e54321afd67f7562c412a0 (DEFAULT_TABLE table=default.Table_1ea29a2534e24318a5604a9a1c93fbe0 [id=cfc66f0ad54746d78dd5ad5a6054f3f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.055248 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b8a2a337e54321afd67f7562c412a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.055258 9427 raft_consensus.cc:359] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.055435 9427 raft_consensus.cc:385] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:07.055524 9427 raft_consensus.cc:740] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:07.055733 9427 consensus_queue.cc:260] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.056438 9427 ts_tablet_manager.cc:1434] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:07.056748 9427 tablet_bootstrap.cc:492] T f080b56cff244a46bfb73d05d3127f31 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:07.059245 9676 raft_consensus.cc:493] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:07.059384 9676 raft_consensus.cc:515] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.059993 9676 leader_election.cc:290] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:07.060773 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "062a482917794ae5a67ec685a2491ba2" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:07.060989 9042 raft_consensus.cc:2468] T 062a482917794ae5a67ec685a2491ba2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:07.061441 9248 leader_election.cc:304] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:07.061717 9676 raft_consensus.cc:2804] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:07.061832 9676 raft_consensus.cc:493] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:07.061908 9676 raft_consensus.cc:3060] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:07.062072 9427 tablet_bootstrap.cc:654] T f080b56cff244a46bfb73d05d3127f31 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:07.062765 9150 tablet_service.cc:1505] Processing CreateTablet for tablet 050260e67b924f13847b9550a91e274b (DEFAULT_TABLE table=default.Table_f3914f2c87834e22a1e6ee9dd86ec86c [id=b402450af7c34bcfbc766b88beb217bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.063118 9150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050260e67b924f13847b9550a91e274b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.064345 9676 raft_consensus.cc:515] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.065258 9676 leader_election.cc:290] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:07.065786 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "062a482917794ae5a67ec685a2491ba2" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:07.066033 9042 raft_consensus.cc:3060] T 062a482917794ae5a67ec685a2491ba2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:07.068018 9154 tablet_service.cc:1505] Processing CreateTablet for tablet 78b3f18a62d544b38a0682bf3bc00977 (DEFAULT_TABLE table=default.Table_ad8e8a5df4ec4b53a051977d42d10a17 [id=f87a4d1335e64e9f9234807ded6cc7d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.068384 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b3f18a62d544b38a0682bf3bc00977. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.068702 9042 raft_consensus.cc:2468] T 062a482917794ae5a67ec685a2491ba2 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:07.069099 9248 leader_election.cc:304] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:07.069380 9676 raft_consensus.cc:2804] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:07.070029 9291 tablet_service.cc:1505] Processing CreateTablet for tablet 15b8a2a337e54321afd67f7562c412a0 (DEFAULT_TABLE table=default.Table_1ea29a2534e24318a5604a9a1c93fbe0 [id=cfc66f0ad54746d78dd5ad5a6054f3f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.070428 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b8a2a337e54321afd67f7562c412a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.071992 9151 tablet_service.cc:1505] Processing CreateTablet for tablet d4cff0ed3782446397dbae8a2da52ed7 (DEFAULT_TABLE table=default.Table_a68d34f520064abe9fb31e83e0162483 [id=c0d22f90a4f046feaf4e5b11515a6b2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.072377 9151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4cff0ed3782446397dbae8a2da52ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.075762 9287 tablet_service.cc:1505] Processing CreateTablet for tablet 21a98ce868924690b8a5715f4103c360 (DEFAULT_TABLE table=default.Table_a1ec14c414a94c868fbbfe74faf0872e [id=cb60f7deb1c34398b39508393cc4cefd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.075907 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 050260e67b924f13847b9550a91e274b (DEFAULT_TABLE table=default.Table_f3914f2c87834e22a1e6ee9dd86ec86c [id=b402450af7c34bcfbc766b88beb217bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.076169 9287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a98ce868924690b8a5715f4103c360. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.076330 9145 tablet_service.cc:1552] Processing DeleteTablet for tablet 18cd1f63d51e4565bb8c55be13e3e099 with delete_type TABLET_DATA_DELETED (replaced by tablet b0b80d0919774ae3ab892d0e29b19b16) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.076437 9144 tablet_service.cc:1505] Processing CreateTablet for tablet 6ec16a234222470bb9cf8c29db536cc1 (DEFAULT_TABLE table=default.Table_8f94c89c96d2444e82c9681f3a6ef372 [id=c6a51393c76f4e7a83480bcca232e954]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.076769 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec16a234222470bb9cf8c29db536cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.076988 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050260e67b924f13847b9550a91e274b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.079622 9615 raft_consensus.cc:493] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:07.079784 9615 raft_consensus.cc:515] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.079823 9149 tablet_service.cc:1505] Processing CreateTablet for tablet 7634179e7bef4b95ae6e06b4581888e7 (DEFAULT_TABLE table=default.Table_d88499634e6e47fd84ec1fdb6d93c314 [id=968fae72cb884ec9acb262fdfd5c7f74]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.079947 9143 tablet_service.cc:1505] Processing CreateTablet for tablet 58926ab073974e2c8b725d5061a544d5 (DEFAULT_TABLE table=default.Table_f26de8048da94ed5b0c969a20720fa76 [id=906e2eb92abb4483bd96e56f6f0fe474]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.079994 9156 tablet_service.cc:1505] Processing CreateTablet for tablet 35326e99d413431583b25d11269d09dc (DEFAULT_TABLE table=default.Table_eecf0f0bdeea4f46bede829df928cd8c [id=41f7f84b468f4860b54a4544d236cecc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.080178 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7634179e7bef4b95ae6e06b4581888e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.080476 9615 leader_election.cc:290] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:07.080956 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a597fd6c7c044228ffb2a5a5f924e70" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:07.081212 9156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35326e99d413431583b25d11269d09dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.081200 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a597fd6c7c044228ffb2a5a5f924e70" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:07.081328 9160 tablet_service.cc:1505] Processing CreateTablet for tablet 79f3a7a065d243c98b465a984bd2b1f9 (DEFAULT_TABLE table=default.Table_548eacdf412e49fa9b698d79892c65dd [id=3715f4772ae646fca209a8bebfbb0586]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.081429 9041 raft_consensus.cc:2468] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:07.081676 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f3a7a065d243c98b465a984bd2b1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.081954 9112 leader_election.cc:304] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:07.082290 9615 raft_consensus.cc:2804] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 14:55:07.082389 9615 raft_consensus.cc:493] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:07.082509 9615 raft_consensus.cc:3060] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:07.085476 9615 raft_consensus.cc:515] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.086457 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a597fd6c7c044228ffb2a5a5f924e70" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:07.086606 9143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58926ab073974e2c8b725d5061a544d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.086678 9041 raft_consensus.cc:3060] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:07.089323 9041 raft_consensus.cc:2468] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 2.
I20251215 14:55:07.092483 9676 raft_consensus.cc:697] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:07.094000 9284 tablet_service.cc:1505] Processing CreateTablet for tablet 35326e99d413431583b25d11269d09dc (DEFAULT_TABLE table=default.Table_eecf0f0bdeea4f46bede829df928cd8c [id=41f7f84b468f4860b54a4544d236cecc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.095321 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet 18cd1f63d51e4565bb8c55be13e3e099 with delete_type TABLET_DATA_DELETED (replaced by tablet b0b80d0919774ae3ab892d0e29b19b16) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:07.095908 9286 tablet_service.cc:1505] Processing CreateTablet for tablet 78b3f18a62d544b38a0682bf3bc00977 (DEFAULT_TABLE table=default.Table_ad8e8a5df4ec4b53a051977d42d10a17 [id=f87a4d1335e64e9f9234807ded6cc7d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.096519 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 6ec16a234222470bb9cf8c29db536cc1 (DEFAULT_TABLE table=default.Table_8f94c89c96d2444e82c9681f3a6ef372 [id=c6a51393c76f4e7a83480bcca232e954]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.096665 9294 tablet_service.cc:1505] Processing CreateTablet for tablet 7634179e7bef4b95ae6e06b4581888e7 (DEFAULT_TABLE table=default.Table_d88499634e6e47fd84ec1fdb6d93c314 [id=968fae72cb884ec9acb262fdfd5c7f74]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.097048 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35326e99d413431583b25d11269d09dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.096997 9279 tablet_service.cc:1505] Processing CreateTablet for tablet 58926ab073974e2c8b725d5061a544d5 (DEFAULT_TABLE table=default.Table_f26de8048da94ed5b0c969a20720fa76 [id=906e2eb92abb4483bd96e56f6f0fe474]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.097390 9279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58926ab073974e2c8b725d5061a544d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.101039 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec16a234222470bb9cf8c29db536cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.101567 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7634179e7bef4b95ae6e06b4581888e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.106959 9290 tablet_service.cc:1505] Processing CreateTablet for tablet 123361ef48714d859ee5ac85c3c37d08 (DEFAULT_TABLE table=default.Table_152b267c68cb4172a6257b9978784879 [id=78e6675d27304f3abebf11d1634f5440]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.107420 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123361ef48714d859ee5ac85c3c37d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.107362 9283 tablet_service.cc:1505] Processing CreateTablet for tablet d4cff0ed3782446397dbae8a2da52ed7 (DEFAULT_TABLE table=default.Table_a68d34f520064abe9fb31e83e0162483 [id=c0d22f90a4f046feaf4e5b11515a6b2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.107779 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4cff0ed3782446397dbae8a2da52ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.107790 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 79f3a7a065d243c98b465a984bd2b1f9 (DEFAULT_TABLE table=default.Table_548eacdf412e49fa9b698d79892c65dd [id=3715f4772ae646fca209a8bebfbb0586]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.108230 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f3a7a065d243c98b465a984bd2b1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.096951 9944 tablet_replica.cc:333] T 18cd1f63d51e4565bb8c55be13e3e099 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:07.110540 9285 tablet_service.cc:1505] Processing CreateTablet for tablet 35ade4502ed7497a82b362d38c65244a (DEFAULT_TABLE table=default.Table_cd6f9353272f406f866b8aea97b47b52 [id=40a32fedadfe44bca3c1013ceb2b84c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.111335 9286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b3f18a62d544b38a0682bf3bc00977. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.111729 9112 leader_election.cc:304] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:07.113272 9285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ade4502ed7497a82b362d38c65244a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.113416 9944 raft_consensus.cc:2243] T 18cd1f63d51e4565bb8c55be13e3e099 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:07.116112 9812 raft_consensus.cc:2804] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 14:55:07.116686 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 21a98ce868924690b8a5715f4103c360 (DEFAULT_TABLE table=default.Table_a1ec14c414a94c868fbbfe74faf0872e [id=cb60f7deb1c34398b39508393cc4cefd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.118185 9615 leader_election.cc:290] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 2 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:07.118534 9812 raft_consensus.cc:697] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:07.118851 9812 consensus_queue.cc:237] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.120169 9152 tablet_service.cc:1505] Processing CreateTablet for tablet 123361ef48714d859ee5ac85c3c37d08 (DEFAULT_TABLE table=default.Table_152b267c68cb4172a6257b9978784879 [id=78e6675d27304f3abebf11d1634f5440]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.122243 9295 tablet_service.cc:1505] Processing CreateTablet for tablet e48a6b6dfe094c34b30b8d3a44c66435 (DEFAULT_TABLE table=default.Table_a1f54fa8891f477eac38ebab96c6df39 [id=00e923cf937e4af19387ece153f163ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.125221 9042 raft_consensus.cc:1275] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Refusing update from remote peer e89303a500544272b601d7c29be802b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 14:55:07.132061 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a98ce868924690b8a5715f4103c360. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.133912 9150 tablet_service.cc:1505] Processing CreateTablet for tablet fc50995f6d934b58ab5f6f6f370cb7e5 (DEFAULT_TABLE table=default.Table_1209e44783914fd0875ebeca6528fa3b [id=60fd0f030f204325bf52f45926de8151]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.137768 9021 tablet_service.cc:1505] Processing CreateTablet for tablet 15b8a2a337e54321afd67f7562c412a0 (DEFAULT_TABLE table=default.Table_1ea29a2534e24318a5604a9a1c93fbe0 [id=cfc66f0ad54746d78dd5ad5a6054f3f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.138170 9021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15b8a2a337e54321afd67f7562c412a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.138546 9018 tablet_service.cc:1505] Processing CreateTablet for tablet 58926ab073974e2c8b725d5061a544d5 (DEFAULT_TABLE table=default.Table_f26de8048da94ed5b0c969a20720fa76 [id=906e2eb92abb4483bd96e56f6f0fe474]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.138904 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58926ab073974e2c8b725d5061a544d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.139364 9006 tablet_service.cc:1505] Processing CreateTablet for tablet 35326e99d413431583b25d11269d09dc (DEFAULT_TABLE table=default.Table_eecf0f0bdeea4f46bede829df928cd8c [id=41f7f84b468f4860b54a4544d236cecc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.139711 9006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35326e99d413431583b25d11269d09dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.140833 9017 tablet_service.cc:1505] Processing CreateTablet for tablet 79f3a7a065d243c98b465a984bd2b1f9 (DEFAULT_TABLE table=default.Table_548eacdf412e49fa9b698d79892c65dd [id=3715f4772ae646fca209a8bebfbb0586]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.141172 9017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79f3a7a065d243c98b465a984bd2b1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.141172 9008 tablet_service.cc:1505] Processing CreateTablet for tablet fc50995f6d934b58ab5f6f6f370cb7e5 (DEFAULT_TABLE table=default.Table_1209e44783914fd0875ebeca6528fa3b [id=60fd0f030f204325bf52f45926de8151]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.141528 9008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc50995f6d934b58ab5f6f6f370cb7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.143443 9011 tablet_service.cc:1505] Processing CreateTablet for tablet 21a98ce868924690b8a5715f4103c360 (DEFAULT_TABLE table=default.Table_a1ec14c414a94c868fbbfe74faf0872e [id=cb60f7deb1c34398b39508393cc4cefd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.143810 9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a98ce868924690b8a5715f4103c360. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.145417 9007 tablet_service.cc:1505] Processing CreateTablet for tablet 050260e67b924f13847b9550a91e274b (DEFAULT_TABLE table=default.Table_f3914f2c87834e22a1e6ee9dd86ec86c [id=b402450af7c34bcfbc766b88beb217bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.145759 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050260e67b924f13847b9550a91e274b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.125701 9676 consensus_queue.cc:237] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.151404 9016 tablet_service.cc:1505] Processing CreateTablet for tablet 78b3f18a62d544b38a0682bf3bc00977 (DEFAULT_TABLE table=default.Table_ad8e8a5df4ec4b53a051977d42d10a17 [id=f87a4d1335e64e9f9234807ded6cc7d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.151760 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78b3f18a62d544b38a0682bf3bc00977. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.152380 9005 tablet_service.cc:1505] Processing CreateTablet for tablet e48a6b6dfe094c34b30b8d3a44c66435 (DEFAULT_TABLE table=default.Table_a1f54fa8891f477eac38ebab96c6df39 [id=00e923cf937e4af19387ece153f163ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.152725 9005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48a6b6dfe094c34b30b8d3a44c66435. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.155438 9020 tablet_service.cc:1505] Processing CreateTablet for tablet d4cff0ed3782446397dbae8a2da52ed7 (DEFAULT_TABLE table=default.Table_a68d34f520064abe9fb31e83e0162483 [id=c0d22f90a4f046feaf4e5b11515a6b2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.155771 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4cff0ed3782446397dbae8a2da52ed7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.156679 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a597fd6c7c044228ffb2a5a5f924e70" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:07.157498 9287 tablet_service.cc:1505] Processing CreateTablet for tablet 3c274c9002544af4947aa4ee76a705ce (DEFAULT_TABLE table=default.Table_e06edd0b78e6468ebf09728e684489da [id=08069854f54c40f7be88313791a1de21]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.158483 9010 tablet_service.cc:1552] Processing DeleteTablet for tablet 18cd1f63d51e4565bb8c55be13e3e099 with delete_type TABLET_DATA_DELETED (replaced by tablet b0b80d0919774ae3ab892d0e29b19b16) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:07.158993 9012 tablet_service.cc:1505] Processing CreateTablet for tablet 6ec16a234222470bb9cf8c29db536cc1 (DEFAULT_TABLE table=default.Table_8f94c89c96d2444e82c9681f3a6ef372 [id=c6a51393c76f4e7a83480bcca232e954]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.159046 9005 tablet_service.cc:1505] Processing CreateTablet for tablet 3c274c9002544af4947aa4ee76a705ce (DEFAULT_TABLE table=default.Table_e06edd0b78e6468ebf09728e684489da [id=08069854f54c40f7be88313791a1de21]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.159382 9012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec16a234222470bb9cf8c29db536cc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.159767 9018 tablet_service.cc:1505] Processing CreateTablet for tablet 682cafa003a64138a01024be2573fe34 (DEFAULT_TABLE table=default.Table_9c3c46c55b45498cbd336827286a69aa [id=527d4e360777473fa1c70305b2ddebef]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.160650 9005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c274c9002544af4947aa4ee76a705ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.160892 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682cafa003a64138a01024be2573fe34. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.161206 9008 tablet_service.cc:1505] Processing CreateTablet for tablet 3af4f753a04b429a857e018f201ae6ed (DEFAULT_TABLE table=default.Table_bdb881513410499d96d921c275f0bd61 [id=78a9312f35ba4cc9a76448c917cdd81a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.161513 9008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3af4f753a04b429a857e018f201ae6ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.162407 9944 raft_consensus.cc:2272] T 18cd1f63d51e4565bb8c55be13e3e099 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:07.165360 9944 ts_tablet_manager.cc:1916] T 18cd1f63d51e4565bb8c55be13e3e099 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:07.179023 9291 tablet_service.cc:1505] Processing CreateTablet for tablet fc50995f6d934b58ab5f6f6f370cb7e5 (DEFAULT_TABLE table=default.Table_1209e44783914fd0875ebeca6528fa3b [id=60fd0f030f204325bf52f45926de8151]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.179919 9426 tablet_bootstrap.cc:492] T ce0154b24522401b9cc0e37fa502532f P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:07.180078 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48a6b6dfe094c34b30b8d3a44c66435. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.180145 9426 ts_tablet_manager.cc:1403] T ce0154b24522401b9cc0e37fa502532f P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.180s user 0.003s sys 0.003s
I20251215 14:55:07.180226 9294 tablet_service.cc:1505] Processing CreateTablet for tablet 682cafa003a64138a01024be2573fe34 (DEFAULT_TABLE table=default.Table_9c3c46c55b45498cbd336827286a69aa [id=527d4e360777473fa1c70305b2ddebef]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:07.180411 9934 log.cc:927] Time spent T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4: Append to log took a long time: real 0.118s user 0.000s sys 0.000s
I20251215 14:55:07.180897 9807 raft_consensus.cc:493] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:07.181062 9807 raft_consensus.cc:515] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.181200 9287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c274c9002544af4947aa4ee76a705ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.181170 9426 raft_consensus.cc:359] T ce0154b24522401b9cc0e37fa502532f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.181331 9426 raft_consensus.cc:385] T ce0154b24522401b9cc0e37fa502532f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:07.181412 9426 raft_consensus.cc:740] T ce0154b24522401b9cc0e37fa502532f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:07.181825 9807 leader_election.cc:290] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:07.182714 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682cafa003a64138a01024be2573fe34. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.183285 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc50995f6d934b58ab5f6f6f370cb7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.184403 9812 raft_consensus.cc:493] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:07.184557 9812 raft_consensus.cc:515] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.188767 9283 tablet_service.cc:1505] Processing CreateTablet for tablet 804ad50f38314be3bf9e118eee9fe748 (DEFAULT_TABLE table=default.Table_8517e4afab414864a30f6afa1d656b2d [id=dfb1938060a24761aae3e9d919ed5464]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.189007 9285 tablet_service.cc:1505] Processing CreateTablet for tablet 3af4f753a04b429a857e018f201ae6ed (DEFAULT_TABLE table=default.Table_bdb881513410499d96d921c275f0bd61 [id=78a9312f35ba4cc9a76448c917cdd81a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.189173 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804ad50f38314be3bf9e118eee9fe748. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.189154 9807 consensus_queue.cc:1048] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:07.189464 9285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3af4f753a04b429a857e018f201ae6ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.188767 9290 tablet_service.cc:1505] Processing CreateTablet for tablet 66f2c74e55f04a6fa4b2c238c0a6b901 (DEFAULT_TABLE table=default.Table_4137cdbc5dba456588ab4ce7aa1382a4 [id=5d35eeea3abd4b59911dd31745a9e54a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.194991 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_2cd6053e07df4b11bbd32c56cde0cf9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:07.195487 9014 tablet_service.cc:1505] Processing CreateTablet for tablet 35ade4502ed7497a82b362d38c65244a (DEFAULT_TABLE table=default.Table_cd6f9353272f406f866b8aea97b47b52 [id=40a32fedadfe44bca3c1013ceb2b84c6]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:07.195679 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2cd6053e07df4b11bbd32c56cde0cf9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:07.195964 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ade4502ed7497a82b362d38c65244a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.198335 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66f2c74e55f04a6fa4b2c238c0a6b901. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.201462 9015 tablet_service.cc:1505] Processing CreateTablet for tablet 7634179e7bef4b95ae6e06b4581888e7 (DEFAULT_TABLE table=default.Table_d88499634e6e47fd84ec1fdb6d93c314 [id=968fae72cb884ec9acb262fdfd5c7f74]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.203518 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae8a49b9a3bf4845943b1ad8e318ccbb" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:07.203714 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet bb3b95d32c7044bd8a4451381c19aeba (table default.Table_d27029eebe7b40ad85ba792bad6d92c5 [id=7ec65d77d89d4e40a60b716f721e2940]). Expected version 3 got 0
I20251215 14:55:07.204274 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet ae8a49b9a3bf4845943b1ad8e318ccbb (table default.Table_fb8fb745144644eea96b20d598f52fa2 [id=02a2b4848c874afe8f9860eee9bc6ce7]). Expected version 1 got 0
I20251215 14:55:07.204586 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 96b2d20fd2304e7a9995206a043b7944 (table default.Table_42e5c1011ba64c0b9602eed064c8ecbd [id=4343a6c3acc545d7be8d3b7ec617da90]). Expected version 1 got 0
I20251215 14:55:07.204825 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet e2104a3530264fa982b20aed20afb0b4 (table default.Table_6bd7eee6a17d43f4baf1db824203acab [id=d916193804f94519b84d259c0420e1a1]). Expected version 1 got 0
I20251215 14:55:07.205096 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d [id=066e8ae14004436cb8b4f3f740b45b19]). Expected version 3 got 0
I20251215 14:55:07.205392 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet c00aecc23c6541cbae4abd7cb1b3077b (table default.Table_4372b5372fdf4a0d991207a20dcbca19 [id=640d70bd78554e92823dc104e06227d3]). Expected version 2 got 0
I20251215 14:55:07.205914 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 (table default.Table_0593d9b93de9400ba29718af1b328262 [id=50a94314f5ba46e3a75b5a15e7362299]). Expected version 1 got 0
I20251215 14:55:07.206179 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_3f190fdaff1446908955f4b5957a8084 [id=cbafb4499c90447d8f185928d3e58b20]). Expected version 1 got 0
W20251215 14:55:07.206717 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet fab39532fe6a403683952057c5ccabd9
W20251215 14:55:07.206871 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 9425749d471f4f95bbae030977e278e4
W20251215 14:55:07.206952 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 813cfeea5399457e91623fb3abf9fd32
W20251215 14:55:07.207021 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 26648bf286c94b2495e565969f945858
I20251215 14:55:07.206760 8786 catalog_manager.cc:5654] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130). New cstate: current_term: 1 leader_uuid: "3ea5306c36594ef4a62211f2bd6669a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
W20251215 14:55:07.207109 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet e6aad8bed15a416a925ae8c8870d4e51
I20251215 14:55:07.207247 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 3cdfcddd91fe47de8fd14dc718f421a6 (table default.Table_aba7a90daaf544eb972bd7349f27ae63 [id=2bd880b71b174f528054fbc22143c01f]). Expected version 3 got 0
I20251215 14:55:07.207449 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet b9b39c879d444172871f43349978dc86 (table default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b [id=472c67fefad54383b4ebac7e3c77d325]). Expected version 1 got 0
I20251215 14:55:07.207660 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1]). Expected version 1 got 0
I20251215 14:55:07.207789 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet f121a14828e6443695960c0e540ae573 (table default.Table_f416fea67a974ab084b7b48a60426131 [id=0e3677e1f3d048ecad508d50304ee56a]). Expected version 1 got 0
I20251215 14:55:07.207926 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet f080b56cff244a46bfb73d05d3127f31 (table default.Table_371fb0a76bea4b17b74b0eb7dc573f00 [id=a81a53d1daa84a799510d1f4224eb1e1]). Expected version 3 got 0
I20251215 14:55:07.208055 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 5dc81eb40614463cb5017475b378eea6 (table default.Table_76a8f78ec8a74aadaf69142df6990dc8 [id=94ddd629cb1e4f5eb0061100187f4202]). Expected version 1 got 0
I20251215 14:55:07.208216 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 5560a21e16bb43c7903c1fc66429ecdf (table default.Table_20d3d5a89e4a447ebcd9f4062e6b477b [id=5f7704a7da85406cb20243ca8c50962d]). Expected version 1 got 0
W20251215 14:55:07.208293 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 44bd51f9bf77492b8890fc7c8411c887
I20251215 14:55:07.208473 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 7f38c44dbc884d74a61c7ed98deaf6aa (table default.Table_74cef17050464ec6968b0d9dce366720 [id=bec2dd63f0aa4a05961adb6a70fbfd94]). Expected version 1 got 0
W20251215 14:55:07.208612 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet bdfc164128a6413a83d83d05b69fb74a
W20251215 14:55:07.208824 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 16309efc14e747d09ce6e5de4f3c2784
W20251215 14:55:07.208954 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bd8d964650a49b08093608abf3e31fa
W20251215 14:55:07.209052 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 37181f50142f4d8bb88713221a755d50
W20251215 14:55:07.209131 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 80d4c9b533ac4facb4205aff84903134
W20251215 14:55:07.209251 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 924c9dd0cd9d40189bfe1457040f3d37
W20251215 14:55:07.209332 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet b329b0abcad742ff94c1a62a72d1b673
W20251215 14:55:07.209425 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 1141b9a4cf3e4aa78529bed7f0375ff8
W20251215 14:55:07.209506 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 2d75636265f14a428aae592438064ea2
W20251215 14:55:07.209595 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 11a5a6a0895c49648c910fa2ea3ca373
W20251215 14:55:07.209673 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet fc9bda52c73e4aa6b7e2eb008c63391b
W20251215 14:55:07.209769 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet ce0154b24522401b9cc0e37fa502532f
W20251215 14:55:07.209914 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 4f1f902cbcb643b9b98fa3d72babba79
W20251215 14:55:07.210007 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet cb2f4fc179744458bc7db2f6c7197ec5
W20251215 14:55:07.210083 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
W20251215 14:55:07.210171 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 30c5c795ea4a4fe591cdf63320ec2521
W20251215 14:55:07.210304 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 4816503e4fa1459dbb311997be85f64a
W20251215 14:55:07.210477 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet f32a6e8df31d482fa9b9686e002d81ff
W20251215 14:55:07.210572 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 2df2138e41844e9f897e57264b62cc9d
W20251215 14:55:07.210667 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet c0d0022e48f04b83ac1c998a83fe3f55
W20251215 14:55:07.210744 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 92e21a77ad074572a57b836743903a0b
W20251215 14:55:07.210892 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet f2aae2798eee4775afaa3afc59e98a6c
W20251215 14:55:07.210987 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 26876cdffd7e4664bc8f7efb74885776
W20251215 14:55:07.211237 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet f9411030d08d40aabbdee6670ba95821
W20251215 14:55:07.211340 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 062a482917794ae5a67ec685a2491ba2
W20251215 14:55:07.211440 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet df70bebdc8ad4f8186ba427e840799cf
W20251215 14:55:07.211548 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 194bb745ecb849cb9092fee1afb7dbe6
W20251215 14:55:07.211848 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 32432afc6e8d458bb7ed7abc42fb3dde
W20251215 14:55:07.212019 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 95583eee8a5041b1ade97e8f8f0db271
W20251215 14:55:07.212244 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 188eb879e7c3479ea71c5b1864400243
W20251215 14:55:07.212358 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 0db6246dee2643d98094408410618259
W20251215 14:55:07.212651 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 15a974e3265a4c88aa6d5005ffa04dc8
W20251215 14:55:07.212874 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 5f03dfdd546c492185c6c31866a090a5
W20251215 14:55:07.213020 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 018bd6ac8a534a6abc461b57b89b93eb
W20251215 14:55:07.213114 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet f9695d47e35448fdad95ff3f24bafd03
I20251215 14:55:07.213558 9152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123361ef48714d859ee5ac85c3c37d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.214183 9154 tablet_service.cc:1505] Processing CreateTablet for tablet 3c274c9002544af4947aa4ee76a705ce (DEFAULT_TABLE table=default.Table_e06edd0b78e6468ebf09728e684489da [id=08069854f54c40f7be88313791a1de21]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.215514 9009 tablet_service.cc:1505] Processing CreateTablet for tablet 123361ef48714d859ee5ac85c3c37d08 (DEFAULT_TABLE table=default.Table_152b267c68cb4172a6257b9978784879 [id=78e6675d27304f3abebf11d1634f5440]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.215860 9006 tablet_service.cc:1505] Processing CreateTablet for tablet 804ad50f38314be3bf9e118eee9fe748 (DEFAULT_TABLE table=default.Table_8517e4afab414864a30f6afa1d656b2d [id=dfb1938060a24761aae3e9d919ed5464]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:07.216817 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 5e80ac7bd98a46119a30bd5d2f3de2f9
W20251215 14:55:07.217176 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 4a6846144c8c409cad340e99374a38c6
I20251215 14:55:07.217386 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0154b24522401b9cc0e37fa502532f" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:07.217465 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 034fec793ae74fcda0c73f1cea291311
I20251215 14:55:07.218168 9040 raft_consensus.cc:1240] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Rejecting Update request from peer e89303a500544272b601d7c29be802b4 for earlier term 1. Current term is 2. Ops: []
I20251215 14:55:07.218276 8785 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_a1ec14c414a94c868fbbfe74faf0872e" } new_table_name: "default.Table_b83bf47931314e5b82bb09f7d6cd2ec8" modify_external_catalogs: true
I20251215 14:55:07.217881 9007 tablet_service.cc:1505] Processing CreateTablet for tablet 66f2c74e55f04a6fa4b2c238c0a6b901 (DEFAULT_TABLE table=default.Table_4137cdbc5dba456588ab4ce7aa1382a4 [id=5d35eeea3abd4b59911dd31745a9e54a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.219521 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7634179e7bef4b95ae6e06b4581888e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.208803 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 0a597fd6c7c044228ffb2a5a5f924e70 (table default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f]). Expected version 1 got 0
I20251215 14:55:07.222509 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781]). Expected version 2 got 0
I20251215 14:55:07.223456 9009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 123361ef48714d859ee5ac85c3c37d08. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:07.229918 9248 leader_election.cc:343] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:07.230777 9006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804ad50f38314be3bf9e118eee9fe748. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.230727 9807 consensus_queue.cc:1059] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 14:55:07.231019 9678 consensus_queue.cc:1048] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 14:55:07.231024 9675 raft_consensus.cc:3055] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 14:55:07.231563 9675 raft_consensus.cc:740] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:07.231875 9675 consensus_queue.cc:260] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.234550 9777 raft_consensus.cc:493] T 32432afc6e8d458bb7ed7abc42fb3dde P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:07.234699 9777 raft_consensus.cc:515] T 32432afc6e8d458bb7ed7abc42fb3dde P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.235796 9777 leader_election.cc:290] T 32432afc6e8d458bb7ed7abc42fb3dde P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:07.235783 9675 raft_consensus.cc:3060] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:07.236413 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66f2c74e55f04a6fa4b2c238c0a6b901. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.237457 9435 tablet_bootstrap.cc:492] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:07.181648 9426 consensus_queue.cc:260] T ce0154b24522401b9cc0e37fa502532f P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.238394 9160 tablet_service.cc:1505] Processing CreateTablet for tablet e48a6b6dfe094c34b30b8d3a44c66435 (DEFAULT_TABLE table=default.Table_a1f54fa8891f477eac38ebab96c6df39 [id=00e923cf937e4af19387ece153f163ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.242331 9812 leader_election.cc:290] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:07.245965 9149 tablet_service.cc:1505] Processing CreateTablet for tablet 35ade4502ed7497a82b362d38c65244a (DEFAULT_TABLE table=default.Table_cd6f9353272f406f866b8aea97b47b52 [id=40a32fedadfe44bca3c1013ceb2b84c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.247553 9435 ts_tablet_manager.cc:1403] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.197s user 0.003s sys 0.010s
I20251215 14:55:07.248005 9150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc50995f6d934b58ab5f6f6f370cb7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.249609 9426 ts_tablet_manager.cc:1434] T ce0154b24522401b9cc0e37fa502532f P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.068s user 0.001s sys 0.001s
I20251215 14:55:07.249941 9426 tablet_bootstrap.cc:492] T f9411030d08d40aabbdee6670ba95821 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:07.250113 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35ade4502ed7497a82b362d38c65244a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.250077 9144 tablet_service.cc:1505] Processing CreateTablet for tablet 682cafa003a64138a01024be2573fe34 (DEFAULT_TABLE table=default.Table_9c3c46c55b45498cbd336827286a69aa [id=527d4e360777473fa1c70305b2ddebef]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.250413 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 682cafa003a64138a01024be2573fe34. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:07.250504 9945 log.cc:927] Time spent T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3: Append to log took a long time: real 0.068s user 0.000s sys 0.000s
I20251215 14:55:07.259330 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c274c9002544af4947aa4ee76a705ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.263311 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48a6b6dfe094c34b30b8d3a44c66435. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.267001 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 16edd0bfd67848e688fa12d9c679fdac
I20251215 14:55:07.267544 8787 catalog_manager.cc:6724] ReplaceTablet: tablet 16edd0bfd67848e688fa12d9c679fdac deleted and replaced by tablet df30b9f793bf4232ba848f569100a747
I20251215 14:55:07.267599 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32432afc6e8d458bb7ed7abc42fb3dde" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:07.267876 8787 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_802c7f03a650477cb59c4e574f25e862" } new_table_name: "default.Table_fb7c599f0ead4abcae0d87e1accda7ab" modify_external_catalogs: true
I20251215 14:55:07.270812 9615 raft_consensus.cc:493] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:07.274232 9615 raft_consensus.cc:515] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.274355 9179 raft_consensus.cc:1240] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 LEADER]: Rejecting Update request from peer e89303a500544272b601d7c29be802b4 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20251215 14:55:07.274379 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "32432afc6e8d458bb7ed7abc42fb3dde" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:07.277258 9615 leader_election.cc:290] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:07.275527 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "062a482917794ae5a67ec685a2491ba2" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:07.278764 9177 raft_consensus.cc:2468] T 062a482917794ae5a67ec685a2491ba2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:07.280349 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 96b2d20fd2304e7a9995206a043b7944 (table default.Table_42e5c1011ba64c0b9602eed064c8ecbd [id=4343a6c3acc545d7be8d3b7ec617da90]). Expected version 1 got 0
I20251215 14:55:07.283114 9156 tablet_service.cc:1552] Processing DeleteTablet for tablet 16edd0bfd67848e688fa12d9c679fdac with delete_type TABLET_DATA_DELETED (replaced by tablet df30b9f793bf4232ba848f569100a747) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.280917 8788 catalog_manager.cc:5654] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129). New cstate: current_term: 1 leader_uuid: "67978ac4539d4b289e53f4eedd9a8156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:07.283478 9149 tablet_service.cc:1505] Processing CreateTablet for tablet 66f2c74e55f04a6fa4b2c238c0a6b901 (DEFAULT_TABLE table=default.Table_4137cdbc5dba456588ab4ce7aa1382a4 [id=5d35eeea3abd4b59911dd31745a9e54a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.283983 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet ae8a49b9a3bf4845943b1ad8e318ccbb (table default.Table_fb8fb745144644eea96b20d598f52fa2 [id=02a2b4848c874afe8f9860eee9bc6ce7]). Expected version 1 got 0
I20251215 14:55:07.284462 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0154b24522401b9cc0e37fa502532f" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:07.284565 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66f2c74e55f04a6fa4b2c238c0a6b901. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.284612 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet bb3b95d32c7044bd8a4451381c19aeba (table default.Table_d27029eebe7b40ad85ba792bad6d92c5 [id=7ec65d77d89d4e40a60b716f721e2940]). Expected version 3 got 0
I20251215 14:55:07.284703 9178 raft_consensus.cc:2468] T ce0154b24522401b9cc0e37fa502532f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:07.284950 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d [id=066e8ae14004436cb8b4f3f740b45b19]). Expected version 3 got 0
I20251215 14:55:07.285192 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet e2104a3530264fa982b20aed20afb0b4 (table default.Table_6bd7eee6a17d43f4baf1db824203acab [id=d916193804f94519b84d259c0420e1a1]). Expected version 1 got 0
I20251215 14:55:07.285408 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 5dc81eb40614463cb5017475b378eea6 (table default.Table_76a8f78ec8a74aadaf69142df6990dc8 [id=94ddd629cb1e4f5eb0061100187f4202]). Expected version 1 got 0
I20251215 14:55:07.285600 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet f080b56cff244a46bfb73d05d3127f31 (table default.Table_371fb0a76bea4b17b74b0eb7dc573f00 [id=a81a53d1daa84a799510d1f4224eb1e1]). Expected version 3 got 0
I20251215 14:55:07.285974 8788 catalog_manager.cc:5654] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129). New cstate: current_term: 1 leader_uuid: "67978ac4539d4b289e53f4eedd9a8156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:07.288033 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 7f38c44dbc884d74a61c7ed98deaf6aa (table default.Table_74cef17050464ec6968b0d9dce366720 [id=bec2dd63f0aa4a05961adb6a70fbfd94]). Expected version 1 got 0
I20251215 14:55:07.288316 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet c00aecc23c6541cbae4abd7cb1b3077b (table default.Table_4372b5372fdf4a0d991207a20dcbca19 [id=640d70bd78554e92823dc104e06227d3]). Expected version 2 got 0
I20251215 14:55:07.288337 9179 raft_consensus.cc:1275] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Refusing update from remote peer e89303a500544272b601d7c29be802b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 14:55:07.288573 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_3f190fdaff1446908955f4b5957a8084 [id=cbafb4499c90447d8f185928d3e58b20]). Expected version 1 got 0
I20251215 14:55:07.288964 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "062a482917794ae5a67ec685a2491ba2" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:07.289149 9177 raft_consensus.cc:3060] T 062a482917794ae5a67ec685a2491ba2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:07.289460 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 (table default.Table_0593d9b93de9400ba29718af1b328262 [id=50a94314f5ba46e3a75b5a15e7362299]). Expected version 1 got 0
I20251215 14:55:07.289881 9151 tablet_service.cc:1505] Processing CreateTablet for tablet 3af4f753a04b429a857e018f201ae6ed (DEFAULT_TABLE table=default.Table_bdb881513410499d96d921c275f0bd61 [id=78a9312f35ba4cc9a76448c917cdd81a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.290239 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 0a597fd6c7c044228ffb2a5a5f924e70 (table default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f]). Expected version 1 got 0
I20251215 14:55:07.290309 9151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3af4f753a04b429a857e018f201ae6ed. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:07.290480 9249 leader_election.cc:343] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:07.290537 9155 tablet_service.cc:1505] Processing CreateTablet for tablet 9beef04f876d40d89dac5970ac6828e9 (DEFAULT_TABLE table=default.Table_a88c3e4ed8414aaeb07e01a30cc69f50 [id=6f8c6c9e7f754c2885cfa19070c5af16]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.290727 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1]). Expected version 1 got 0
I20251215 14:55:07.291554 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet f121a14828e6443695960c0e540ae573 (table default.Table_f416fea67a974ab084b7b48a60426131 [id=0e3677e1f3d048ecad508d50304ee56a]). Expected version 1 got 0
I20251215 14:55:07.295014 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 5560a21e16bb43c7903c1fc66429ecdf (table default.Table_20d3d5a89e4a447ebcd9f4062e6b477b [id=5f7704a7da85406cb20243ca8c50962d]). Expected version 1 got 0
I20251215 14:55:07.295401 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 3cdfcddd91fe47de8fd14dc718f421a6 (table default.Table_aba7a90daaf544eb972bd7349f27ae63 [id=2bd880b71b174f528054fbc22143c01f]). Expected version 3 got 0
I20251215 14:55:07.295599 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet b9b39c879d444172871f43349978dc86 (table default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b [id=472c67fefad54383b4ebac7e3c77d325]). Expected version 1 got 0
I20251215 14:55:07.295820 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781]). Expected version 2 got 0
I20251215 14:55:07.296242 8780 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet b0b80d0919774ae3ab892d0e29b19b16
W20251215 14:55:07.296388 8783 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ae8a49b9a3bf4845943b1ad8e318ccbb consensus state has no leader
I20251215 14:55:07.296919 8780 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_eecf0f0bdeea4f46bede829df928cd8c" } new_table_name: "default.Table_7624bbb38e9c499390f53c92673ed169" modify_external_catalogs: true
I20251215 14:55:07.297313 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c96b5d2bf6ac4d3fa984f8047f2f6d30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:07.298149 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c96b5d2bf6ac4d3fa984f8047f2f6d30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:07.298343 8779 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet f830b4af355e480bbe75d6060585529e
I20251215 14:55:07.300169 8779 master_service.cc:954] ReplaceTablet: received request to replace tablet cb2f4fc179744458bc7db2f6c7197ec5 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:07.300607 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_6a398e13d9004d1a9f157e19e8a20496"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:07.301102 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a398e13d9004d1a9f157e19e8a20496 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:07.306985 8782 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 90c0254840b442a3817171b06f2726c8
I20251215 14:55:07.307024 8784 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 429c0b2d7cb2428c8de6b02acde36044
I20251215 14:55:07.307648 8782 master_service.cc:954] ReplaceTablet: received request to replace tablet 61aef86a30e842f2a90f9f1c88c84f4d from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:07.307790 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_b7af23e2b15b483b86f9bc4b3b65802b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:07.308337 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7af23e2b15b483b86f9bc4b3b65802b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:07.308946 8780 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 35326e99d413431583b25d11269d09dc consensus state has no leader
I20251215 14:55:07.309307 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c15ea76b3b6f41419688ef6bc1f667cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:07.309799 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c15ea76b3b6f41419688ef6bc1f667cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:07.307052 8785 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 21a98ce868924690b8a5715f4103c360 consensus state has no leader
I20251215 14:55:07.310498 9426 tablet_bootstrap.cc:654] T f9411030d08d40aabbdee6670ba95821 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:07.310493 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_642fc0a3b7ac49d6843e4dcefe43650e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:07.311107 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_642fc0a3b7ac49d6843e4dcefe43650e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:07.312009 8787 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
I20251215 14:55:07.312997 8787 master_service.cc:954] ReplaceTablet: received request to replace tablet f080b56cff244a46bfb73d05d3127f31 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:07.315058 9156 tablet_service.cc:1552] Processing DeleteTablet for tablet 429c0b2d7cb2428c8de6b02acde36044 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:06 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.316123 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9beef04f876d40d89dac5970ac6828e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.319674 9016 tablet_service.cc:1552] Processing DeleteTablet for tablet 16edd0bfd67848e688fa12d9c679fdac with delete_type TABLET_DATA_DELETED (replaced by tablet df30b9f793bf4232ba848f569100a747) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:07.320924 9678 raft_consensus.cc:493] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:07.320875 8783 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_1ea29a2534e24318a5604a9a1c93fbe0" } new_table_name: "default.Table_04da4393e19048d79af321a03c1c7a12" modify_external_catalogs: true
I20251215 14:55:07.322312 8781 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 9beef04f876d40d89dac5970ac6828e9
I20251215 14:55:07.323104 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_6a2c679c707b486c9d57cc2900b26575"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:07.323731 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a2c679c707b486c9d57cc2900b26575 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:07.323995 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c6d8ee8140464d86871ee6cc6141fce3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:07.324482 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6d8ee8140464d86871ee6cc6141fce3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:07.327410 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_6f9a4bda466c4244b9c239e6b4bd7fe0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:07.327906 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f9a4bda466c4244b9c239e6b4bd7fe0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:07.330508 8786 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet bb3b95d32c7044bd8a4451381c19aeba (table default.Table_d27029eebe7b40ad85ba792bad6d92c5 [id=7ec65d77d89d4e40a60b716f721e2940], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet bb3b95d32c7044bd8a4451381c19aeba consensus state has no leader
W20251215 14:55:07.330796 8786 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet 96b2d20fd2304e7a9995206a043b7944 (table default.Table_42e5c1011ba64c0b9602eed064c8ecbd [id=4343a6c3acc545d7be8d3b7ec617da90], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 96b2d20fd2304e7a9995206a043b7944 consensus state has no leader
W20251215 14:55:07.330968 8786 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet e2104a3530264fa982b20aed20afb0b4 (table default.Table_6bd7eee6a17d43f4baf1db824203acab [id=d916193804f94519b84d259c0420e1a1], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet e2104a3530264fa982b20aed20afb0b4 consensus state has no leader
W20251215 14:55:07.331418 8786 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d [id=066e8ae14004436cb8b4f3f740b45b19], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet bafc5063058a469bb9c9b3e5345eb1be consensus state has no leader
W20251215 14:55:07.332852 8786 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_3f190fdaff1446908955f4b5957a8084 [id=cbafb4499c90447d8f185928d3e58b20], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 26754a74483c4c9580df93aae10e7de1 consensus state has no leader
I20251215 14:55:07.350421 9156 tablet_service.cc:1552] Processing DeleteTablet for tablet f7af1f66c4f04f649379758ff1b3e387 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:07.351341 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 58926ab073974e2c8b725d5061a544d5 (table default.Table_f26de8048da94ed5b0c969a20720fa76 [id=906e2eb92abb4483bd96e56f6f0fe474], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 58926ab073974e2c8b725d5061a544d5 has no consensus state
I20251215 14:55:07.340332 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae8a49b9a3bf4845943b1ad8e318ccbb" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
W20251215 14:55:07.334081 8786 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet b9b39c879d444172871f43349978dc86 (table default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b [id=472c67fefad54383b4ebac7e3c77d325], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet b9b39c879d444172871f43349978dc86 consensus state has no leader
W20251215 14:55:07.352851 8783 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 15b8a2a337e54321afd67f7562c412a0 consensus state has no leader
I20251215 14:55:07.353435 9016 tablet_service.cc:1505] Processing CreateTablet for tablet 9beef04f876d40d89dac5970ac6828e9 (DEFAULT_TABLE table=default.Table_a88c3e4ed8414aaeb07e01a30cc69f50 [id=6f8c6c9e7f754c2885cfa19070c5af16]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.353936 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9beef04f876d40d89dac5970ac6828e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.355096 9148 tablet_service.cc:1552] Processing DeleteTablet for tablet 90c0254840b442a3817171b06f2726c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:06 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.357708 9314 raft_consensus.cc:2393] T 32432afc6e8d458bb7ed7abc42fb3dde P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:07.358078 9284 tablet_service.cc:1505] Processing CreateTablet for tablet 9beef04f876d40d89dac5970ac6828e9 (DEFAULT_TABLE table=default.Table_a88c3e4ed8414aaeb07e01a30cc69f50 [id=6f8c6c9e7f754c2885cfa19070c5af16]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.358903 8782 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:55:07.359396 8782 catalog_manager.cc:6724] ReplaceTablet: tablet 61aef86a30e842f2a90f9f1c88c84f4d deleted and replaced by tablet ec3d52299b7945cdbedbc89be7f174c5
I20251215 14:55:07.362131 9145 tablet_service.cc:1505] Processing CreateTablet for tablet 804ad50f38314be3bf9e118eee9fe748 (DEFAULT_TABLE table=default.Table_8517e4afab414864a30f6afa1d656b2d [id=dfb1938060a24761aae3e9d919ed5464]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.362440 9154 tablet_service.cc:1552] Processing DeleteTablet for tablet 9beef04f876d40d89dac5970ac6828e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:06 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.362689 9019 tablet_service.cc:1552] Processing DeleteTablet for tablet f830b4af355e480bbe75d6060585529e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:06 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:07.363106 9427 tablet_bootstrap.cc:492] T f080b56cff244a46bfb73d05d3127f31 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:07.363685 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet 9bf4a899338f4bcfac099b5099a22f05 with delete_type TABLET_DATA_DELETED (replaced by tablet 78b3f18a62d544b38a0682bf3bc00977) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.364487 9143 tablet_service.cc:1505] Processing CreateTablet for tablet 6229b8bc8d3d446c944c819670b10d54 (DEFAULT_TABLE table=default.Table_baa5664946144147bafee4511b30105f [id=15ddee7fbd5047caad852f1a4c453515]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.364639 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet f080b56cff244a46bfb73d05d3127f31
I20251215 14:55:07.365113 8787 catalog_manager.cc:6724] ReplaceTablet: tablet f080b56cff244a46bfb73d05d3127f31 deleted and replaced by tablet 377c3e08df404b75a6a53dd2ef6e5f78
I20251215 14:55:07.367429 9288 tablet_service.cc:1505] Processing CreateTablet for tablet 5830296559264b609909486aa15c9e2e (DEFAULT_TABLE table=default.Table_2dd806808b064dadbe81feaae5862a89 [id=cfa97744d0364459ba63ed1d52dc15db]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.362583 9812 consensus_queue.cc:1048] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20251215 14:55:07.364641 9148 tablet_service.cc:1552] Processing DeleteTablet for tablet ff4508c5a110427eb4d9d2eaaadace0b with delete_type TABLET_DATA_DELETED (replaced by tablet 15b8a2a337e54321afd67f7562c412a0) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.369019 9150 tablet_service.cc:1552] Processing DeleteTablet for tablet f830b4af355e480bbe75d6060585529e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:06 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.369225 9277 tablet_service.cc:1505] Processing CreateTablet for tablet 6229b8bc8d3d446c944c819670b10d54 (DEFAULT_TABLE table=default.Table_baa5664946144147bafee4511b30105f [id=15ddee7fbd5047caad852f1a4c453515]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.371358 9249 leader_election.cc:304] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:07.372840 9041 raft_consensus.cc:3060] T 92e21a77ad074572a57b836743903a0b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:07.373919 8786 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 consensus state has no leader
I20251215 14:55:07.373979 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95583eee8a5041b1ade97e8f8f0db271" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:07.374511 8786 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet f121a14828e6443695960c0e540ae573 (table default.Table_f416fea67a974ab084b7b48a60426131 [id=0e3677e1f3d048ecad508d50304ee56a], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet f121a14828e6443695960c0e540ae573 consensus state has no leader
W20251215 14:55:07.374815 8786 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet f080b56cff244a46bfb73d05d3127f31 (table default.Table_371fb0a76bea4b17b74b0eb7dc573f00 [id=a81a53d1daa84a799510d1f4224eb1e1], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet f080b56cff244a46bfb73d05d3127f31 consensus state has no leader
W20251215 14:55:07.375011 8786 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet 5dc81eb40614463cb5017475b378eea6 (table default.Table_76a8f78ec8a74aadaf69142df6990dc8 [id=94ddd629cb1e4f5eb0061100187f4202], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5dc81eb40614463cb5017475b378eea6 consensus state has no leader
I20251215 14:55:07.375087 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 90c0254840b442a3817171b06f2726c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:06 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:07.373134 9144 tablet_service.cc:1505] Processing CreateTablet for tablet 5830296559264b609909486aa15c9e2e (DEFAULT_TABLE table=default.Table_2dd806808b064dadbe81feaae5862a89 [id=cfa97744d0364459ba63ed1d52dc15db]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.375731 9943 tablet_replica.cc:333] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:07.375950 9943 raft_consensus.cc:2243] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:07.376188 9943 raft_consensus.cc:2272] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:07.376732 9943 ts_tablet_manager.cc:1916] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:07.378247 9156 tablet_service.cc:1552] Processing DeleteTablet for tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.379027 9177 raft_consensus.cc:2468] T 062a482917794ae5a67ec685a2491ba2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:07.379140 9143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6229b8bc8d3d446c944c819670b10d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.379189 9012 tablet_service.cc:1552] Processing DeleteTablet for tablet f080b56cff244a46bfb73d05d3127f31 with delete_type TABLET_DATA_DELETED (replaced by tablet 377c3e08df404b75a6a53dd2ef6e5f78) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:07.379952 9777 raft_consensus.cc:493] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:07.380975 9003 tablet_service.cc:1505] Processing CreateTablet for tablet 5830296559264b609909486aa15c9e2e (DEFAULT_TABLE table=default.Table_2dd806808b064dadbe81feaae5862a89 [id=cfa97744d0364459ba63ed1d52dc15db]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.381361 9003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5830296559264b609909486aa15c9e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.382244 9004 tablet_service.cc:1552] Processing DeleteTablet for tablet 9beef04f876d40d89dac5970ac6828e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:06 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:07.383149 9782 consensus_queue.cc:1048] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20251215 14:55:07.383906 9427 ts_tablet_manager.cc:1403] T f080b56cff244a46bfb73d05d3127f31 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.307s user 0.008s sys 0.001s
I20251215 14:55:07.384212 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 6229b8bc8d3d446c944c819670b10d54 (DEFAULT_TABLE table=default.Table_baa5664946144147bafee4511b30105f [id=15ddee7fbd5047caad852f1a4c453515]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:07.384358 9283 tablet_service.cc:1552] Processing DeleteTablet for tablet 16edd0bfd67848e688fa12d9c679fdac with delete_type TABLET_DATA_DELETED (replaced by tablet df30b9f793bf4232ba848f569100a747) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:07.384583 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6229b8bc8d3d446c944c819670b10d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.385099 8978 leader_election.cc:304] T 32432afc6e8d458bb7ed7abc42fb3dde P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:07.385142 9777 raft_consensus.cc:515] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.385772 9777 leader_election.cc:290] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:07.385939 9777 raft_consensus.cc:3060] T 32432afc6e8d458bb7ed7abc42fb3dde P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:07.386276 9040 raft_consensus.cc:2468] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:07.386778 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet 429c0b2d7cb2428c8de6b02acde36044 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:06 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:07.387948 9112 leader_election.cc:304] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:07.388662 9812 raft_consensus.cc:2804] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:07.388764 9812 raft_consensus.cc:493] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251215 14:55:07.389251 8786 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet 5560a21e16bb43c7903c1fc66429ecdf (table default.Table_20d3d5a89e4a447ebcd9f4062e6b477b [id=5f7704a7da85406cb20243ca8c50962d], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5560a21e16bb43c7903c1fc66429ecdf consensus state has no leader
I20251215 14:55:07.389927 9145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 804ad50f38314be3bf9e118eee9fe748. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.392949 9812 raft_consensus.cc:3060] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:07.397234 9812 raft_consensus.cc:515] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.398051 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5830296559264b609909486aa15c9e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.400312 9150 tablet_service.cc:1552] Processing DeleteTablet for tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 with delete_type TABLET_DATA_DELETED (replaced by tablet 21a98ce868924690b8a5715f4103c360) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.402575 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95583eee8a5041b1ade97e8f8f0db271" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:07.402813 9179 raft_consensus.cc:2393] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
W20251215 14:55:07.408928 8786 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet 0a597fd6c7c044228ffb2a5a5f924e70 (table default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 0a597fd6c7c044228ffb2a5a5f924e70 consensus state has no leader
I20251215 14:55:07.409261 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_2f5058c288b24e0d9c61a68e43de4680"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:07.410017 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f5058c288b24e0d9c61a68e43de4680 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:07.410693 9156 tablet_service.cc:1552] Processing DeleteTablet for tablet 61aef86a30e842f2a90f9f1c88c84f4d with delete_type TABLET_DATA_DELETED (replaced by tablet ec3d52299b7945cdbedbc89be7f174c5) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:07.411439 8786 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 05e70b4070b6437e9b934af4e6b93f6a consensus state has no leader
I20251215 14:55:07.419132 8782 master_service.cc:954] ReplaceTablet: received request to replace tablet 3c6cfff573434fbcb18feaf6a8e6a153 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:07.420825 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_faa710b3964c433ea2f7227c3724659b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:07.421392 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_faa710b3964c433ea2f7227c3724659b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:07.422407 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet d922d7b24dbd474cbee47c72f2779a07 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.422763 9150 tablet_service.cc:1552] Processing DeleteTablet for tablet f080b56cff244a46bfb73d05d3127f31 with delete_type TABLET_DATA_DELETED (replaced by tablet 377c3e08df404b75a6a53dd2ef6e5f78) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.429222 8782 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 3c6cfff573434fbcb18feaf6a8e6a153
I20251215 14:55:07.429725 8782 catalog_manager.cc:6724] ReplaceTablet: tablet 3c6cfff573434fbcb18feaf6a8e6a153 deleted and replaced by tablet ca2bba36b0f54aadb3980aa41dfd0eb0
I20251215 14:55:07.431260 9812 leader_election.cc:290] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:07.431510 9507 raft_consensus.cc:493] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:07.432381 9507 raft_consensus.cc:515] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.468569 9145 tablet_service.cc:1552] Processing DeleteTablet for tablet 0215ff355fce46b5a4cf1bf4bd7164f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.469823 9145 tablet_service.cc:1552] Processing DeleteTablet for tablet a0a74645593d46fcbc0235ec6a4670d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.470244 9144 tablet_service.cc:1552] Processing DeleteTablet for tablet 3c6cfff573434fbcb18feaf6a8e6a153 with delete_type TABLET_DATA_DELETED (replaced by tablet ca2bba36b0f54aadb3980aa41dfd0eb0) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:07.471333 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 92e21a77ad074572a57b836743903a0b
W20251215 14:55:07.471427 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet ce0154b24522401b9cc0e37fa502532f
W20251215 14:55:07.471472 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 11a5a6a0895c49648c910fa2ea3ca373
W20251215 14:55:07.471593 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 2df2138e41844e9f897e57264b62cc9d
W20251215 14:55:07.471647 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 062a482917794ae5a67ec685a2491ba2
W20251215 14:55:07.471735 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet fc9bda52c73e4aa6b7e2eb008c63391b
W20251215 14:55:07.471824 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet bdfc164128a6413a83d83d05b69fb74a
W20251215 14:55:07.471901 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 44bd51f9bf77492b8890fc7c8411c887
I20251215 14:55:07.472527 8785 catalog_manager.cc:5654] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 reported cstate change: term changed from 0 to 2, leader changed from <none> to 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130). New cstate: current_term: 2 leader_uuid: "3ea5306c36594ef4a62211f2bd6669a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:07.472945 8785 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 0a597fd6c7c044228ffb2a5a5f924e70 (table default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f]). Expected version 1 got 0
I20251215 14:55:07.473194 8785 catalog_manager.cc:5654] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130). New cstate: current_term: 1 leader_uuid: "3ea5306c36594ef4a62211f2bd6669a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:07.473549 8785 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet b9b39c879d444172871f43349978dc86 (table default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b [id=472c67fefad54383b4ebac7e3c77d325]). Expected version 1 got 0
I20251215 14:55:07.473734 8785 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet ae8a49b9a3bf4845943b1ad8e318ccbb (table default.Table_99268441afd84c5fbfbd1080deabb144 [id=02a2b4848c874afe8f9860eee9bc6ce7]). Expected version 2 got 0
I20251215 14:55:07.482686 9507 leader_election.cc:290] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:07.483410 9426 tablet_bootstrap.cc:492] T f9411030d08d40aabbdee6670ba95821 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:07.483770 9426 ts_tablet_manager.cc:1403] T f9411030d08d40aabbdee6670ba95821 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.234s user 0.009s sys 0.004s
W20251215 14:55:07.483850 8976 consensus_peers.cc:597] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20251215 14:55:07.483976 8976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 84738us
I20251215 14:55:07.484594 9426 raft_consensus.cc:359] T f9411030d08d40aabbdee6670ba95821 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.484799 9426 raft_consensus.cc:385] T f9411030d08d40aabbdee6670ba95821 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:07.484874 9426 raft_consensus.cc:740] T f9411030d08d40aabbdee6670ba95821 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:07.485097 9426 consensus_queue.cc:260] T f9411030d08d40aabbdee6670ba95821 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.382783 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 61aef86a30e842f2a90f9f1c88c84f4d with delete_type TABLET_DATA_DELETED (replaced by tablet ec3d52299b7945cdbedbc89be7f174c5) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:07.485584 9426 ts_tablet_manager.cc:1434] T f9411030d08d40aabbdee6670ba95821 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:07.485915 9426 tablet_bootstrap.cc:492] T 15a974e3265a4c88aa6d5005ffa04dc8 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:07.487512 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:07.489851 9426 tablet_bootstrap.cc:654] T 15a974e3265a4c88aa6d5005ffa04dc8 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:07.493839 9015 tablet_service.cc:1552] Processing DeleteTablet for tablet 3c6cfff573434fbcb18feaf6a8e6a153 with delete_type TABLET_DATA_DELETED (replaced by tablet ca2bba36b0f54aadb3980aa41dfd0eb0) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:07.494108 9039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95583eee8a5041b1ade97e8f8f0db271" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:07.497882 9943 ts_tablet_manager.cc:1929] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:07.499259 9943 log.cc:1199] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/16edd0bfd67848e688fa12d9c679fdac
I20251215 14:55:07.504565 9036 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9425749d471f4f95bbae030977e278e4" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:07.504817 9943 ts_tablet_manager.cc:1950] T 16edd0bfd67848e688fa12d9c679fdac P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:07.504871 9036 raft_consensus.cc:2468] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:07.505136 8782 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_2f5058c288b24e0d9c61a68e43de4680" } new_table_name: "default.Table_ca2a9c1da0264e1eb4e1b13acfed1ece" modify_external_catalogs: true
I20251215 14:55:07.506202 9112 leader_election.cc:304] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:07.506603 8786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_1209e44783914fd0875ebeca6528fa3b" } modify_external_catalogs: true
I20251215 14:55:07.506588 9615 consensus_queue.cc:1048] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:07.506780 8786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_1209e44783914fd0875ebeca6528fa3b" } modify_external_catalogs: true
I20251215 14:55:07.507211 9617 raft_consensus.cc:2804] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:07.507258 9615 consensus_queue.cc:1048] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:07.507326 9617 raft_consensus.cc:493] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:07.507421 9617 raft_consensus.cc:3060] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:07.510382 9617 raft_consensus.cc:515] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.511125 9617 leader_election.cc:290] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:07.514245 9943 tablet_replica.cc:333] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:07.516098 9943 raft_consensus.cc:2243] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:07.517505 8787 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_04da4393e19048d79af321a03c1c7a12" } modify_external_catalogs: true
I20251215 14:55:07.517676 9039 raft_consensus.cc:3060] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:07.517737 8787 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_04da4393e19048d79af321a03c1c7a12" } modify_external_catalogs: true
I20251215 14:55:07.519076 8784 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_bdb881513410499d96d921c275f0bd61" } modify_external_catalogs: true
I20251215 14:55:07.519268 8784 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_bdb881513410499d96d921c275f0bd61" } modify_external_catalogs: true
I20251215 14:55:07.520522 8779 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d27029eebe7b40ad85ba792bad6d92c5" } new_table_name: "default.Table_7cbbdace45d641d4a9c5b95389d76554" modify_external_catalogs: true
I20251215 14:55:07.521790 8781 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_4372b5372fdf4a0d991207a20dcbca19" } new_table_name: "default.Table_b527fedbc2c14bb3861289fe2b27fd43" modify_external_catalogs: true
I20251215 14:55:07.521934 8785 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f26de8048da94ed5b0c969a20720fa76" } modify_external_catalogs: true
I20251215 14:55:07.522455 8785 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f26de8048da94ed5b0c969a20720fa76" } modify_external_catalogs: true
I20251215 14:55:07.522804 8783 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_fb7c599f0ead4abcae0d87e1accda7ab" } new_table_name: "default.Table_93ee270c113a4a51ab4e5fe5f80117b0" modify_external_catalogs: true
I20251215 14:55:07.523133 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_b7e8e496ff654bdea9558a04abb32447"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:07.523674 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7e8e496ff654bdea9558a04abb32447 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:07.523924 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 16edd0bfd67848e688fa12d9c679fdac (table default.Table_c1335c74e0f740b08e701ac0246125f0 [id=a4fa8fe05f924de6b14bcc04e80479ce]) successfully deleted
I20251215 14:55:07.541960 9036 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9425749d471f4f95bbae030977e278e4" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:07.542145 9036 raft_consensus.cc:3060] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:07.538371 9812 consensus_queue.cc:1048] T 92e21a77ad074572a57b836743903a0b P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:07.542481 9617 consensus_queue.cc:1048] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:07.544224 9040 raft_consensus.cc:1275] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Refusing update from remote peer 3ea5306c36594ef4a62211f2bd6669a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 14:55:07.544278 9943 raft_consensus.cc:2272] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:07.544713 9036 raft_consensus.cc:2468] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:07.544874 9943 ts_tablet_manager.cc:1916] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:07.545116 9617 consensus_queue.cc:1048] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:07.545540 9427 raft_consensus.cc:359] T f080b56cff244a46bfb73d05d3127f31 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.546300 9112 leader_election.cc:304] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:07.546789 9812 raft_consensus.cc:2804] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:07.547190 9812 raft_consensus.cc:697] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:07.547523 9812 consensus_queue.cc:237] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.550261 9777 raft_consensus.cc:2749] T 32432afc6e8d458bb7ed7abc42fb3dde P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:07.552942 9907 sys_catalog.cc:455] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40747def373e4b19abfa5d21ba0a4315. Latest consensus state: current_term: 2 leader_uuid: "40747def373e4b19abfa5d21ba0a4315" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:55:07.553172 9907 sys_catalog.cc:458] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: This master's current role is: FOLLOWER
I20251215 14:55:07.553313 9907 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40747def373e4b19abfa5d21ba0a4315)
I20251215 14:55:07.553431 9907 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:07.554085 9907 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:07.558245 8869 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 367 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:07.575232 9286 tablet_service.cc:1552] Processing DeleteTablet for tablet 9beef04f876d40d89dac5970ac6828e9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:06 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:07.575495 9279 tablet_service.cc:1552] Processing DeleteTablet for tablet 90c0254840b442a3817171b06f2726c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:06 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:07.575708 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet f830b4af355e480bbe75d6060585529e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:06 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:07.575866 9311 raft_consensus.cc:2393] T ae8a49b9a3bf4845943b1ad8e318ccbb P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:07.576104 9289 tablet_service.cc:1552] Processing DeleteTablet for tablet 429c0b2d7cb2428c8de6b02acde36044 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:06 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:07.576267 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95583eee8a5041b1ade97e8f8f0db271" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:07.576459 9313 raft_consensus.cc:2468] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:07.576663 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9beef04f876d40d89dac5970ac6828e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.576925 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6229b8bc8d3d446c944c819670b10d54. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.577153 9288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5830296559264b609909486aa15c9e2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:07.577102 9435 raft_consensus.cc:359] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.577304 9435 raft_consensus.cc:385] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:07.577394 9435 raft_consensus.cc:740] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:07.577652 9435 consensus_queue.cc:260] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.578094 9287 tablet_service.cc:1552] Processing DeleteTablet for tablet f080b56cff244a46bfb73d05d3127f31 with delete_type TABLET_DATA_DELETED (replaced by tablet 377c3e08df404b75a6a53dd2ef6e5f78) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:07.582477 9617 consensus_queue.cc:1048] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:07.585049 9812 consensus_queue.cc:1048] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20251215 14:55:07.592232 9889 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "40747def373e4b19abfa5d21ba0a4315" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:55:07.592530 9889 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [sys.catalog]: This master's current role is: LEADER
I20251215 14:55:07.593740 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 367 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
W20251215 14:55:07.607656 8782 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e9353aff4c0742c191b37d3a412ed411 has no consensus state
W20251215 14:55:07.609503 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet f9411030d08d40aabbdee6670ba95821
I20251215 14:55:07.611774 8782 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e06edd0b78e6468ebf09728e684489da" } modify_external_catalogs: true
I20251215 14:55:07.612018 8782 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e06edd0b78e6468ebf09728e684489da" } modify_external_catalogs: true
I20251215 14:55:07.633266 9613 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:55:07.633692 9960 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 14:55:07.562708 9036 raft_consensus.cc:1275] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Refusing update from remote peer 3ea5306c36594ef4a62211f2bd6669a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251215 14:55:07.641350 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 15b8a2a337e54321afd67f7562c412a0
I20251215 14:55:07.641379 8786 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet fc50995f6d934b58ab5f6f6f370cb7e5
I20251215 14:55:07.642212 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_cee40c41a2f74ddfb19f74f8be3ae220"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:07.642282 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_8ee3cade1b94484b8cdf7579a865f570"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:07.642848 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cee40c41a2f74ddfb19f74f8be3ae220 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:07.644759 9144 tablet_service.cc:1552] Processing DeleteTablet for tablet fc50995f6d934b58ab5f6f6f370cb7e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:07.642844 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ee3cade1b94484b8cdf7579a865f570 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:07.646772 9426 tablet_bootstrap.cc:492] T 15a974e3265a4c88aa6d5005ffa04dc8 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:07.647452 9426 ts_tablet_manager.cc:1403] T 15a974e3265a4c88aa6d5005ffa04dc8 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.162s user 0.002s sys 0.008s
I20251215 14:55:07.647888 9145 tablet_service.cc:1552] Processing DeleteTablet for tablet 15b8a2a337e54321afd67f7562c412a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.648238 9426 raft_consensus.cc:359] T 15a974e3265a4c88aa6d5005ffa04dc8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.648411 9426 raft_consensus.cc:385] T 15a974e3265a4c88aa6d5005ffa04dc8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:07.648486 9426 raft_consensus.cc:740] T 15a974e3265a4c88aa6d5005ffa04dc8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:07.648702 9426 consensus_queue.cc:260] T 15a974e3265a4c88aa6d5005ffa04dc8 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.649204 9426 ts_tablet_manager.cc:1434] T 15a974e3265a4c88aa6d5005ffa04dc8 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:07.647140 9812 raft_consensus.cc:493] T f9411030d08d40aabbdee6670ba95821 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:07.649389 9812 raft_consensus.cc:515] T f9411030d08d40aabbdee6670ba95821 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.650048 9812 leader_election.cc:290] T f9411030d08d40aabbdee6670ba95821 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:07.650223 9943 ts_tablet_manager.cc:1929] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:07.650409 9426 tablet_bootstrap.cc:492] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:07.655881 9943 log.cc:1199] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/429c0b2d7cb2428c8de6b02acde36044
I20251215 14:55:07.661119 9426 tablet_bootstrap.cc:654] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:07.665355 9943 ts_tablet_manager.cc:1950] T 429c0b2d7cb2428c8de6b02acde36044 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:07.666352 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 429c0b2d7cb2428c8de6b02acde36044 (table default.Table_20d2c5b358444df59324e21800508f8d [id=c421ca23de494f4ba674e4cc86bac3da]) successfully deleted
W20251215 14:55:07.668241 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet f7af1f66c4f04f649379758ff1b3e387 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7af1f66c4f04f649379758ff1b3e387 already in progress: creating tablet
W20251215 14:55:07.669590 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 90c0254840b442a3817171b06f2726c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90c0254840b442a3817171b06f2726c8 already in progress: creating tablet
W20251215 14:55:07.670884 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 9beef04f876d40d89dac5970ac6828e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9beef04f876d40d89dac5970ac6828e9 already in progress: creating tablet
W20251215 14:55:07.671998 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 9bf4a899338f4bcfac099b5099a22f05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bf4a899338f4bcfac099b5099a22f05 already in progress: creating tablet
W20251215 14:55:07.674307 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 already in progress: creating tablet
W20251215 14:55:07.676405 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet f830b4af355e480bbe75d6060585529e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f830b4af355e480bbe75d6060585529e already in progress: creating tablet
I20251215 14:55:07.677131 9427 raft_consensus.cc:385] T f080b56cff244a46bfb73d05d3127f31 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251215 14:55:07.678254 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 already in progress: creating tablet
I20251215 14:55:07.679327 9426 tablet_bootstrap.cc:492] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
W20251215 14:55:07.680023 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 61aef86a30e842f2a90f9f1c88c84f4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61aef86a30e842f2a90f9f1c88c84f4d already in progress: creating tablet
I20251215 14:55:07.680413 9943 tablet_replica.cc:333] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:07.681506 9943 raft_consensus.cc:2243] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:07.680948 9426 ts_tablet_manager.cc:1403] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.002s
I20251215 14:55:07.683414 9943 pending_rounds.cc:70] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3: Trying to abort 1 pending ops.
I20251215 14:55:07.683880 9943 pending_rounds.cc:77] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232759833384177664 op_type: NO_OP noop_request { }
I20251215 14:55:07.684412 9943 raft_consensus.cc:2889] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 14:55:07.685390 9943 raft_consensus.cc:2272] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:07.685092 9426 raft_consensus.cc:359] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.687217 9426 raft_consensus.cc:385] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:07.688046 9426 raft_consensus.cc:740] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:07.688678 9426 consensus_queue.cc:260] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.690388 9426 ts_tablet_manager.cc:1434] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.008s user 0.000s sys 0.001s
I20251215 14:55:07.687917 9943 ts_tablet_manager.cc:1916] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:07.694474 9426 tablet_bootstrap.cc:492] T 188eb879e7c3479ea71c5b1864400243 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:07.695209 9777 consensus_queue.cc:1048] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20251215 14:55:07.697556 9427 raft_consensus.cc:740] T f080b56cff244a46bfb73d05d3127f31 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:07.700660 9782 consensus_queue.cc:1048] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20251215 14:55:07.708266 9960 sys_catalog.cc:455] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "40747def373e4b19abfa5d21ba0a4315" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:55:07.708604 9960 sys_catalog.cc:458] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: This master's current role is: FOLLOWER
I20251215 14:55:07.709968 9008 tablet_service.cc:1552] Processing DeleteTablet for tablet 15b8a2a337e54321afd67f7562c412a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:07.712352 9947 tablet_replica.cc:333] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:07.715884 9039 raft_consensus.cc:2468] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:07.716537 9427 consensus_queue.cc:260] T f080b56cff244a46bfb73d05d3127f31 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.717119 9427 ts_tablet_manager.cc:1434] T f080b56cff244a46bfb73d05d3127f31 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.333s user 0.002s sys 0.000s
I20251215 14:55:07.717463 9427 tablet_bootstrap.cc:492] T ce0154b24522401b9cc0e37fa502532f P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:07.720707 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9411030d08d40aabbdee6670ba95821" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:07.721131 9037 raft_consensus.cc:2393] T f9411030d08d40aabbdee6670ba95821 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:07.722879 9947 raft_consensus.cc:2243] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:07.733244 9009 tablet_service.cc:1552] Processing DeleteTablet for tablet fc50995f6d934b58ab5f6f6f370cb7e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:07.756053 8784 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 3af4f753a04b429a857e018f201ae6ed
W20251215 14:55:07.758930 8779 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb3b95d32c7044bd8a4451381c19aeba consensus state has no leader
W20251215 14:55:07.760748 8781 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c00aecc23c6541cbae4abd7cb1b3077b consensus state has no leader
W20251215 14:55:07.762300 8783 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
I20251215 14:55:07.764317 8785 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 58926ab073974e2c8b725d5061a544d5
I20251215 14:55:07.766994 8782 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 3c274c9002544af4947aa4ee76a705ce
I20251215 14:55:07.769232 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_0e8139618d4747388370f15f67fc9fa2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:07.769804 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e8139618d4747388370f15f67fc9fa2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:07.770936 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_59a89434b3b24db2905384e5da65e1a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:07.771200 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_000f958eb97a4a8a93fb9520a90c485c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:07.771734 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_000f958eb97a4a8a93fb9520a90c485c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:07.771961 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ad3fc7fcf00c4744994fffb8a98202ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:07.772743 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_599d7b1173e24bda8ca827394b97ada0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:07.772825 8781 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_77da0b679b494783bb486ac3e8887892" } new_table_name: "default.Table_99ea47285b994715a5fae3cfb669d229" modify_external_catalogs: true
W20251215 14:55:07.773769 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 9425749d471f4f95bbae030977e278e4
W20251215 14:55:07.774029 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59a89434b3b24db2905384e5da65e1a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:07.774188 8784 master_service.cc:954] ReplaceTablet: received request to replace tablet 062a482917794ae5a67ec685a2491ba2 from {username='slave'} at 127.0.0.1:49790
W20251215 14:55:07.774435 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad3fc7fcf00c4744994fffb8a98202ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:07.775347 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_599d7b1173e24bda8ca827394b97ada0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:07.778812 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ddea9e06b72a43758693e2b1f32c1b15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:07.779417 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddea9e06b72a43758693e2b1f32c1b15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:07.781139 8787 master_service.cc:954] ReplaceTablet: received request to replace tablet 35ade4502ed7497a82b362d38c65244a from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:07.783049 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_942e1382bd0c457b88e70fd2cbb19872"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:07.783633 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_942e1382bd0c457b88e70fd2cbb19872 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:07.806187 9427 tablet_bootstrap.cc:654] T ce0154b24522401b9cc0e37fa502532f P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:07.806496 9009 tablet_service.cc:1552] Processing DeleteTablet for tablet 3af4f753a04b429a857e018f201ae6ed with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:07.809012 9947 pending_rounds.cc:70] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156: Trying to abort 1 pending ops.
I20251215 14:55:07.812426 9947 pending_rounds.cc:77] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232759834528419840 op_type: NO_OP noop_request { }
I20251215 14:55:07.813521 9947 raft_consensus.cc:2889] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 14:55:07.813733 9947 raft_consensus.cc:2272] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:07.814596 9947 ts_tablet_manager.cc:1916] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:07.820581 9427 tablet_bootstrap.cc:492] T ce0154b24522401b9cc0e37fa502532f P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:07.820770 9427 ts_tablet_manager.cc:1403] T ce0154b24522401b9cc0e37fa502532f P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.103s user 0.002s sys 0.002s
I20251215 14:55:07.821964 9427 raft_consensus.cc:359] T ce0154b24522401b9cc0e37fa502532f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.822198 9427 raft_consensus.cc:385] T ce0154b24522401b9cc0e37fa502532f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:07.822333 9427 raft_consensus.cc:740] T ce0154b24522401b9cc0e37fa502532f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:07.822629 9427 consensus_queue.cc:260] T ce0154b24522401b9cc0e37fa502532f P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.823294 9427 ts_tablet_manager.cc:1434] T ce0154b24522401b9cc0e37fa502532f P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:07.823621 9427 tablet_bootstrap.cc:492] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:07.823714 9617 consensus_queue.cc:1048] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.119s
I20251215 14:55:07.824115 9615 consensus_queue.cc:1048] T f32a6e8df31d482fa9b9686e002d81ff P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.120s
W20251215 14:55:07.824425 9112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 118978us
I20251215 14:55:07.824803 9112 leader_election.cc:304] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:07.825593 9427 tablet_bootstrap.cc:654] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:07.825704 9145 tablet_service.cc:1552] Processing DeleteTablet for tablet 58926ab073974e2c8b725d5061a544d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.825932 9144 tablet_service.cc:1552] Processing DeleteTablet for tablet 3c274c9002544af4947aa4ee76a705ce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.827066 9615 raft_consensus.cc:2804] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:07.827198 9615 raft_consensus.cc:697] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:07.827468 9615 consensus_queue.cc:237] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.830344 9143 tablet_service.cc:1552] Processing DeleteTablet for tablet 3af4f753a04b429a857e018f201ae6ed with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:07.832727 9947 ts_tablet_manager.cc:1929] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:07.832850 9947 log.cc:1199] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/16edd0bfd67848e688fa12d9c679fdac
I20251215 14:55:07.833106 9426 tablet_bootstrap.cc:654] T 188eb879e7c3479ea71c5b1864400243 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:07.833199 9947 ts_tablet_manager.cc:1950] T 16edd0bfd67848e688fa12d9c679fdac P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:07.833951 9947 tablet_replica.cc:333] T f080b56cff244a46bfb73d05d3127f31 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:07.834121 9947 raft_consensus.cc:2243] T f080b56cff244a46bfb73d05d3127f31 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:07.834282 9947 raft_consensus.cc:2272] T f080b56cff244a46bfb73d05d3127f31 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:07.834960 9943 ts_tablet_manager.cc:1929] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:07.835100 9943 log.cc:1199] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/d922d7b24dbd474cbee47c72f2779a07
I20251215 14:55:07.835440 9427 tablet_bootstrap.cc:492] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:07.835572 9427 ts_tablet_manager.cc:1403] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20251215 14:55:07.835827 9943 ts_tablet_manager.cc:1950] T d922d7b24dbd474cbee47c72f2779a07 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:07.836331 9427 raft_consensus.cc:359] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.836834 9943 tablet_replica.cc:333] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:07.837181 9943 raft_consensus.cc:2243] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:07.837765 9427 raft_consensus.cc:385] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:07.837775 9943 pending_rounds.cc:70] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3: Trying to abort 1 pending ops.
I20251215 14:55:07.838001 9427 raft_consensus.cc:740] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:07.837898 9943 pending_rounds.cc:77] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232759835997405184 op_type: NO_OP noop_request { }
I20251215 14:55:07.838326 9943 raft_consensus.cc:2889] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 14:55:07.838424 9427 consensus_queue.cc:260] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.838650 9943 raft_consensus.cc:2272] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:07.839733 9984 tablet.cc:1722] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:07.842610 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet d922d7b24dbd474cbee47c72f2779a07 (table default.Table_5d032dd330df4c33aa8ef50ce62c8d08 [id=977e2ac089d545278d13e59908bad89e]) successfully deleted
I20251215 14:55:07.854282 9427 ts_tablet_manager.cc:1434] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20251215 14:55:07.854601 9427 tablet_bootstrap.cc:492] T c8af1d0b67424bec90b59863a975254e P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:07.857945 9947 ts_tablet_manager.cc:1916] T f080b56cff244a46bfb73d05d3127f31 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:07.859759 9427 tablet_bootstrap.cc:654] T c8af1d0b67424bec90b59863a975254e P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:07.869587 9988 tablet.cc:1722] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:07.870514 9812 consensus_queue.cc:1048] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:07.871985 9014 tablet_service.cc:1552] Processing DeleteTablet for tablet 3c274c9002544af4947aa4ee76a705ce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:07.872290 9016 tablet_service.cc:1552] Processing DeleteTablet for tablet 58926ab073974e2c8b725d5061a544d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:07.873191 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 16edd0bfd67848e688fa12d9c679fdac (table default.Table_c1335c74e0f740b08e701ac0246125f0 [id=a4fa8fe05f924de6b14bcc04e80479ce]) successfully deleted
W20251215 14:55:07.873451 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet f830b4af355e480bbe75d6060585529e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f830b4af355e480bbe75d6060585529e already in progress: creating tablet
W20251215 14:55:07.873641 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 90c0254840b442a3817171b06f2726c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90c0254840b442a3817171b06f2726c8 already in progress: creating tablet
I20251215 14:55:07.885089 9179 raft_consensus.cc:3060] T 15a974e3265a4c88aa6d5005ffa04dc8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:07.897188 9943 ts_tablet_manager.cc:1916] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:07.919679 9782 consensus_queue.cc:1048] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20251215 14:55:07.922479 9988 tablet.cc:1722] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:07.923566 9981 consensus_queue.cc:1048] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:07.935619 9427 tablet_bootstrap.cc:492] T c8af1d0b67424bec90b59863a975254e P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:07.935946 9427 ts_tablet_manager.cc:1403] T c8af1d0b67424bec90b59863a975254e P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.081s user 0.016s sys 0.003s
I20251215 14:55:07.937626 9947 ts_tablet_manager.cc:1929] T f080b56cff244a46bfb73d05d3127f31 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:07.938107 9947 log.cc:1199] T f080b56cff244a46bfb73d05d3127f31 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/f080b56cff244a46bfb73d05d3127f31
I20251215 14:55:07.938583 9947 ts_tablet_manager.cc:1950] T f080b56cff244a46bfb73d05d3127f31 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:07.939623 9947 tablet_replica.cc:333] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:07.939908 9947 raft_consensus.cc:2243] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:07.940143 9947 raft_consensus.cc:2272] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:07.940899 9947 ts_tablet_manager.cc:1916] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251215 14:55:07.952068 9675 consensus_meta.cc:287] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4: Time spent flushing consensus metadata: real 0.716s user 0.003s sys 0.000s
I20251215 14:55:07.878656 9678 raft_consensus.cc:515] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:07.959707 9283 tablet_service.cc:1552] Processing DeleteTablet for tablet 61aef86a30e842f2a90f9f1c88c84f4d with delete_type TABLET_DATA_DELETED (replaced by tablet ec3d52299b7945cdbedbc89be7f174c5) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:07.959935 9287 tablet_service.cc:1552] Processing DeleteTablet for tablet 3c6cfff573434fbcb18feaf6a8e6a153 with delete_type TABLET_DATA_DELETED (replaced by tablet ca2bba36b0f54aadb3980aa41dfd0eb0) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:07.967413 9676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.800s user 0.058s sys 0.081s
I20251215 14:55:07.967646 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95583eee8a5041b1ade97e8f8f0db271" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:07.969918 9678 leader_election.cc:290] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:07.979892 9311 raft_consensus.cc:2468] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:07.981539 9678 raft_consensus.cc:2749] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:07.982542 9676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s user 0.058s sys 0.081s
W20251215 14:55:07.986112 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet bb3b95d32c7044bd8a4451381c19aeba (table default.Table_7cbbdace45d641d4a9c5b95389d76554 [id=7ec65d77d89d4e40a60b716f721e2940], current schema version=4) failed: Not found: failed to reset TS proxy: No leader found: Tablet bb3b95d32c7044bd8a4451381c19aeba consensus state has no leader
I20251215 14:55:07.986702 9984 tablet.cc:1722] T 7f38c44dbc884d74a61c7ed98deaf6aa P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251215 14:55:07.990480 9807 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s user 0.033s sys 0.041s
I20251215 14:55:07.993182 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet f080b56cff244a46bfb73d05d3127f31 (table default.Table_371fb0a76bea4b17b74b0eb7dc573f00 [id=a81a53d1daa84a799510d1f4224eb1e1]) successfully deleted
W20251215 14:55:07.993530 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 9beef04f876d40d89dac5970ac6828e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9beef04f876d40d89dac5970ac6828e9 already in progress: creating tablet
I20251215 14:55:07.999590 9952 raft_consensus.cc:493] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:08.000641 9249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s user 0.026s sys 0.091s
W20251215 14:55:08.001390 9807 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s user 0.033s sys 0.041s
I20251215 14:55:08.001914 9952 raft_consensus.cc:515] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.004129 9782 raft_consensus.cc:493] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:08.007720 9947 ts_tablet_manager.cc:1929] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:08.019551 9287 tablet_service.cc:1552] Processing DeleteTablet for tablet fc50995f6d934b58ab5f6f6f370cb7e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:08.019553 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 58926ab073974e2c8b725d5061a544d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:08.022171 9295 consensus_meta.cc:287] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4: Time spent flushing consensus metadata: real 0.688s user 0.003s sys 0.001s
I20251215 14:55:08.022372 9289 tablet_service.cc:1552] Processing DeleteTablet for tablet 3af4f753a04b429a857e018f201ae6ed with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:08.022718 9249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s user 0.027s sys 0.091s
W20251215 14:55:08.027733 9291 consensus_meta.cc:287] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4: Time spent flushing consensus metadata: real 0.809s user 0.002s sys 0.001s
I20251215 14:55:08.029244 9953 consensus_queue.cc:1048] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:08.030014 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:08.032207 9249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 783873us
I20251215 14:55:08.032835 9952 leader_election.cc:290] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:08.034685 9294 consensus_meta.cc:287] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4: Time spent flushing consensus metadata: real 0.614s user 0.003s sys 0.000s
I20251215 14:55:08.035203 9953 consensus_queue.cc:1048] T fab39532fe6a403683952057c5ccabd9 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20251215 14:55:08.036093 9283 tablet_service.cc:1552] Processing DeleteTablet for tablet 15b8a2a337e54321afd67f7562c412a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:08.036273 9285 tablet_service.cc:1552] Processing DeleteTablet for tablet 3c274c9002544af4947aa4ee76a705ce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:08.036547 9435 ts_tablet_manager.cc:1434] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.744s user 0.005s sys 0.007s
I20251215 14:55:08.036522 9249 leader_election.cc:304] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:08.035951 9777 consensus_queue.cc:1048] T 37181f50142f4d8bb88713221a755d50 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20251215 14:55:08.039952 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16309efc14e747d09ce6e5de4f3c2784" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:08.040352 9177 raft_consensus.cc:3060] T f9411030d08d40aabbdee6670ba95821 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.040453 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfead52afe8040a88ba0d826f482b1bd" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:08.040741 9310 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95583eee8a5041b1ade97e8f8f0db271" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
W20251215 14:55:08.044916 9435 ts_tablet_manager.cc:1467] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4: Tablet startup took 789ms
I20251215 14:55:08.045128 9952 consensus_queue.cc:1048] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20251215 14:55:08.045948 9678 raft_consensus.cc:493] T 9425749d471f4f95bbae030977e278e4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:08.046139 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9425749d471f4f95bbae030977e278e4" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:08.048640 9971 raft_consensus.cc:493] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:08.049832 9310 raft_consensus.cc:3060] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.051029 9953 raft_consensus.cc:2804] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:08.051527 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9425749d471f4f95bbae030977e278e4" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:08.054773 9971 raft_consensus.cc:515] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.059777 9953 raft_consensus.cc:493] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:08.059790 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfead52afe8040a88ba0d826f482b1bd" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:08.064586 9310 raft_consensus.cc:2468] T 95583eee8a5041b1ade97e8f8f0db271 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:08.065428 9678 raft_consensus.cc:515] T 9425749d471f4f95bbae030977e278e4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.066797 9311 raft_consensus.cc:1275] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Refusing update from remote peer 3ea5306c36594ef4a62211f2bd6669a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251215 14:55:08.067065 9248 leader_election.cc:343] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:08.067750 9435 ts_tablet_manager.cc:1469] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4: Trace:
1215 14:55:03.955310 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:04.110654 (+155344us) service_pool.cc:225] Handling call
1215 14:55:04.119657 (+ 9003us) ts_tablet_manager.cc:669] Acquired tablet manager lock
1215 14:55:04.119691 (+ 34us) ts_tablet_manager.cc:682] Creating new metadata...
1215 14:55:04.141240 (+ 21549us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:04.143915 (+ 2675us) tablet_replica.cc:206] Creating consensus instance
1215 14:55:04.144065 (+ 150us) inbound_call.cc:173] Queueing success response
1215 14:55:07.040528 (+2896463us) ts_tablet_manager.cc:1379] Bootstrapping tablet
1215 14:55:07.247872 (+207344us) ts_tablet_manager.cc:1435] Starting tablet replica
1215 14:55:07.370505 (+122633us) tablet_replica.cc:261] Starting instrumentation
1215 14:55:07.370668 (+ 163us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":404075,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":53,"tablet-open.queue_time_us":2896496,"thread_start_us":407768,"threads_started":1}
I20251215 14:55:08.069052 9971 leader_election.cc:290] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:08.069363 9971 consensus_queue.cc:1048] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:08.085512 9953 raft_consensus.cc:3060] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.086078 9678 leader_election.cc:290] T 9425749d471f4f95bbae030977e278e4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:08.086472 9310 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9411030d08d40aabbdee6670ba95821" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:08.088300 9943 ts_tablet_manager.cc:1929] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:08.092689 9943 log.cc:1199] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/f080b56cff244a46bfb73d05d3127f31
I20251215 14:55:08.095322 9617 consensus_queue.cc:1048] T e6aad8bed15a416a925ae8c8870d4e51 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:08.096990 9115 leader_election.cc:304] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:08.099820 9943 ts_tablet_manager.cc:1950] T f080b56cff244a46bfb73d05d3127f31 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:08.100076 9507 raft_consensus.cc:3060] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.100324 9943 tablet_replica.cc:333] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:08.100548 9943 raft_consensus.cc:2243] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:08.100767 9943 pending_rounds.cc:70] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3: Trying to abort 1 pending ops.
I20251215 14:55:08.100823 9943 pending_rounds.cc:77] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232759835010891776 op_type: NO_OP noop_request { }
I20251215 14:55:08.100950 9943 raft_consensus.cc:2889] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 14:55:08.101049 9943 raft_consensus.cc:2272] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:08.101706 9943 ts_tablet_manager.cc:1916] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:08.103049 9507 raft_consensus.cc:2749] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:08.103631 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet f080b56cff244a46bfb73d05d3127f31 (table default.Table_371fb0a76bea4b17b74b0eb7dc573f00 [id=a81a53d1daa84a799510d1f4224eb1e1]) successfully deleted
I20251215 14:55:08.122473 9314 raft_consensus.cc:2468] T 9425749d471f4f95bbae030977e278e4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:08.123374 9944 ts_tablet_manager.cc:1929] T 18cd1f63d51e4565bb8c55be13e3e099 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:08.123615 9943 ts_tablet_manager.cc:1929] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:08.126171 9435 tablet_bootstrap.cc:492] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:08.131254 9944 log.cc:1199] T 18cd1f63d51e4565bb8c55be13e3e099 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/18cd1f63d51e4565bb8c55be13e3e099
I20251215 14:55:08.132174 9313 raft_consensus.cc:1275] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 2 FOLLOWER]: Refusing update from remote peer 3ea5306c36594ef4a62211f2bd6669a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20251215 14:55:08.133313 9249 leader_election.cc:343] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:08.136289 8781 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4c96b655cf284326ae3fa2a165e2bf95 consensus state has no leader
I20251215 14:55:08.138971 8780 master_service.cc:954] ReplaceTablet: received request to replace tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:08.141425 8786 master_service.cc:954] ReplaceTablet: received request to replace tablet 96b2d20fd2304e7a9995206a043b7944 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:08.144138 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 35ade4502ed7497a82b362d38c65244a
I20251215 14:55:08.144696 8787 catalog_manager.cc:6724] ReplaceTablet: tablet 35ade4502ed7497a82b362d38c65244a deleted and replaced by tablet d09d7ce93d074bfaa830130b31bcc594
I20251215 14:55:08.145062 8787 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_2dd806808b064dadbe81feaae5862a89" } new_table_name: "default.Table_19778cae47da4d7fb3b868bdcea673ef" modify_external_catalogs: true
W20251215 14:55:08.145882 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 95583eee8a5041b1ade97e8f8f0db271
W20251215 14:55:08.145987 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 37181f50142f4d8bb88713221a755d50
W20251215 14:55:08.146154 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 15a974e3265a4c88aa6d5005ffa04dc8
I20251215 14:55:08.146730 8779 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 4c96b655cf284326ae3fa2a165e2bf95 (table default.Table_99ea47285b994715a5fae3cfb669d229 [id=b7ff2d02e55b4e839049b20b89227526]). Expected version 1 got 0
I20251215 14:55:08.147728 8783 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_2920b8dba9704f489af552aa0ce58b64" } modify_external_catalogs: true
I20251215 14:55:08.147838 8785 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f1ad091bc41747ffba1fca75bcf619b7" } new_table_name: "default.Table_404807c380fa4483ac5e0545eb3028cd" modify_external_catalogs: true
I20251215 14:55:08.147923 8783 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_2920b8dba9704f489af552aa0ce58b64" } modify_external_catalogs: true
I20251215 14:55:08.150580 8784 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_38b1c1a82dd441dfa8131162ac117124" } modify_external_catalogs: true
I20251215 14:55:08.150823 8784 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_38b1c1a82dd441dfa8131162ac117124" } modify_external_catalogs: true
I20251215 14:55:08.154851 8781 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ad8e8a5df4ec4b53a051977d42d10a17" } modify_external_catalogs: true
I20251215 14:55:08.155076 8781 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ad8e8a5df4ec4b53a051977d42d10a17" } modify_external_catalogs: true
I20251215 14:55:08.160197 8782 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_faa710b3964c433ea2f7227c3724659b" } new_table_name: "default.Table_07de59922021486886fb112cbc06c493" modify_external_catalogs: true
I20251215 14:55:08.164888 9782 raft_consensus.cc:515] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.165324 9952 consensus_queue.cc:1048] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.098s
I20251215 14:55:08.165899 10008 raft_consensus.cc:493] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:08.164566 9251 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s user 0.000s sys 0.011s
I20251215 14:55:08.167227 9971 consensus_queue.cc:1048] T 0db6246dee2643d98094408410618259 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
W20251215 14:55:08.167634 9249 leader_election.cc:343] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:08.167706 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet 35ade4502ed7497a82b362d38c65244a with delete_type TABLET_DATA_DELETED (replaced by tablet d09d7ce93d074bfaa830130b31bcc594) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:08.167795 9249 leader_election.cc:304] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:08.167935 9947 log.cc:1199] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/429c0b2d7cb2428c8de6b02acde36044
W20251215 14:55:08.171000 9251 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s user 0.001s sys 0.011s
I20251215 14:55:08.171810 9427 raft_consensus.cc:359] T c8af1d0b67424bec90b59863a975254e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.173105 9971 consensus_queue.cc:1048] T 1141b9a4cf3e4aa78529bed7f0375ff8 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20251215 14:55:08.173295 9952 consensus_queue.cc:1048] T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20251215 14:55:08.174242 9676 raft_consensus.cc:2749] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:08.166092 10008 raft_consensus.cc:515] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.180662 9944 ts_tablet_manager.cc:1950] T 18cd1f63d51e4565bb8c55be13e3e099 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
W20251215 14:55:08.179152 8772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.188:43131, user_credentials={real_user=slave}} blocked reactor thread for 49380.7us
I20251215 14:55:08.124754 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f03dfdd546c492185c6c31866a090a5" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:08.125093 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9425749d471f4f95bbae030977e278e4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:08.182262 9943 log.cc:1199] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:55:08.182956 9943 ts_tablet_manager.cc:1950] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:08.182032 9969 consensus_queue.cc:1048] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20251215 14:55:08.180996 10017 tablet.cc:1722] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:08.184528 9971 consensus_queue.cc:1048] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20251215 14:55:08.186950 9944 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33372 (request call id 5) took 1090 ms. Trace:
I20251215 14:55:08.195799 10008 leader_election.cc:290] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:08.187711 9944 rpcz_store.cc:276] 1215 14:55:07.091988 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:07.092090 (+ 102us) service_pool.cc:225] Handling call
1215 14:55:07.096365 (+ 4275us) ts_tablet_manager.cc:1151] Deleting tablet 18cd1f63d51e4565bb8c55be13e3e099
1215 14:55:07.096377 (+ 12us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1215 14:55:08.014474 (+918097us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:08.062481 (+ 48007us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:08.182791 (+120310us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":871,"thread_start_us":5948,"threads_started":1}
I20251215 14:55:08.197850 9435 tablet_bootstrap.cc:654] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:08.201574 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 0215ff355fce46b5a4cf1bf4bd7164f3 (table default.Table_28c03048db094b5093cd88eb3dc6f7fe [id=cf0e40d55af1486db1df4e85048a070b]) successfully deleted
I20251215 14:55:08.129009 9426 tablet_bootstrap.cc:492] T 188eb879e7c3479ea71c5b1864400243 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:08.129210 9812 consensus_queue.cc:1048] T df70bebdc8ad4f8186ba427e840799cf P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:08.129477 9115 leader_election.cc:304] T f9411030d08d40aabbdee6670ba95821 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:08.148243 9143 tablet_service.cc:1552] Processing DeleteTablet for tablet 35ade4502ed7497a82b362d38c65244a with delete_type TABLET_DATA_DELETED (replaced by tablet d09d7ce93d074bfaa830130b31bcc594) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:08.170676 9984 tablet.cc:1722] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251215 14:55:08.202615 9115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 73114.6us
I20251215 14:55:08.202754 9944 tablet_replica.cc:333] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:08.129122 9507 consensus_queue.cc:1048] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:08.203141 9507 raft_consensus.cc:2749] T f9411030d08d40aabbdee6670ba95821 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:08.203346 9507 consensus_queue.cc:1048] T 32432afc6e8d458bb7ed7abc42fb3dde P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:08.203848 9507 consensus_queue.cc:1048] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:08.204038 9507 consensus_queue.cc:1243] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Peer e89303a500544272b601d7c29be802b4 log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20251215 14:55:08.204975 9944 raft_consensus.cc:2243] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:08.205171 9944 raft_consensus.cc:2272] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:08.206764 9426 ts_tablet_manager.cc:1403] T 188eb879e7c3479ea71c5b1864400243 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.515s user 0.002s sys 0.011s
I20251215 14:55:08.207854 9426 raft_consensus.cc:359] T 188eb879e7c3479ea71c5b1864400243 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.208066 9426 raft_consensus.cc:385] T 188eb879e7c3479ea71c5b1864400243 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:08.208154 9426 raft_consensus.cc:740] T 188eb879e7c3479ea71c5b1864400243 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:08.208493 9426 consensus_queue.cc:260] T 188eb879e7c3479ea71c5b1864400243 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.208877 10017 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:33372 (request call id 4) took 1114 ms. Trace:
I20251215 14:55:08.212198 9953 raft_consensus.cc:515] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.219321 9944 ts_tablet_manager.cc:1916] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:08.209548 10017 rpcz_store.cc:276] 1215 14:55:07.091874 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:07.091924 (+ 50us) service_pool.cc:225] Handling call
1215 14:55:08.206294 (+1114370us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:07.092483 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
1215 14:55:07.093378 (+ 895us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
1215 14:55:07.093387 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
1215 14:55:07.093393 (+ 6us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
1215 14:55:07.093442 (+ 49us) alter_schema_op.cc:128] START. Timestamp: 1765810507093322
1215 14:55:07.093445 (+ 3us) op_driver.cc:348] REPLICATION: starting
1215 14:55:07.093719 (+ 274us) log.cc:844] Serialized 173 byte log entry
1215 14:55:08.070756 (+977037us) op_driver.cc:464] REPLICATION: finished
1215 14:55:08.180123 (+109367us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
1215 14:55:08.198192 (+ 18069us) log.cc:844] Serialized 5 byte log entry
1215 14:55:08.205839 (+ 7647us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:08.206213 (+ 374us) log.cc:844] Serialized 14 byte log entry
1215 14:55:08.206257 (+ 44us) alter_schema_op.cc:73] Released schema lock
1215 14:55:08.206261 (+ 4us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":108523,"prepare.queue_time_us":58,"prepare.run_cpu_time_us":647,"prepare.run_wall_time_us":1335,"raft.queue_time_us":2320,"raft.run_cpu_time_us":355,"raft.run_wall_time_us":355,"replication_time_us":977274,"thread_start_us":64881,"threads_started":1}]]}
I20251215 14:55:08.223982 9953 leader_election.cc:290] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:08.224877 9313 pending_rounds.cc:85] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4: Aborting all ops after (but not including) 0
I20251215 14:55:08.225608 9313 pending_rounds.cc:107] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20251215 14:55:08.225782 9313 raft_consensus.cc:2889] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251215 14:55:08.234860 10017 tablet.cc:1722] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251215 14:55:08.238796 9426 ts_tablet_manager.cc:1434] T 188eb879e7c3479ea71c5b1864400243 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.032s user 0.002s sys 0.000s
I20251215 14:55:08.245637 9777 consensus_queue.cc:1048] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.207s
I20251215 14:55:08.245970 9032 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f03dfdd546c492185c6c31866a090a5" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:08.246413 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9425749d471f4f95bbae030977e278e4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:08.246492 8787 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5830296559264b609909486aa15c9e2e consensus state has no leader
I20251215 14:55:08.246626 9040 raft_consensus.cc:2393] T 9425749d471f4f95bbae030977e278e4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
W20251215 14:55:08.248234 8785 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a639396098a941249afd9c3560073131 consensus state has no leader
I20251215 14:55:08.249126 9947 ts_tablet_manager.cc:1950] T 429c0b2d7cb2428c8de6b02acde36044 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:08.249315 8783 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet c8af1d0b67424bec90b59863a975254e
I20251215 14:55:08.250732 9143 tablet_service.cc:1552] Processing DeleteTablet for tablet c8af1d0b67424bec90b59863a975254e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:08.251348 9427 raft_consensus.cc:385] T c8af1d0b67424bec90b59863a975254e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:08.251995 8780 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 6ae72a1ded6e4faba1ad309d9a0e4a95
I20251215 14:55:08.252457 8780 catalog_manager.cc:6724] ReplaceTablet: tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 deleted and replaced by tablet 9e317c8dc24e481abb709e932fa39c29
I20251215 14:55:08.252982 9615 raft_consensus.cc:493] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:08.253208 9615 raft_consensus.cc:515] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.253446 8784 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet ec3d52299b7945cdbedbc89be7f174c5
I20251215 14:55:08.254364 9143 tablet_service.cc:1552] Processing DeleteTablet for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e317c8dc24e481abb709e932fa39c29) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:08.251824 9782 leader_election.cc:290] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:08.254365 9615 leader_election.cc:290] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:08.256141 8786 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 96b2d20fd2304e7a9995206a043b7944
I20251215 14:55:08.256537 8786 catalog_manager.cc:6724] ReplaceTablet: tablet 96b2d20fd2304e7a9995206a043b7944 deleted and replaced by tablet 6140a160980d49b09a5fda8475fc144f
I20251215 14:55:08.251893 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16309efc14e747d09ce6e5de4f3c2784" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:08.257607 9143 tablet_service.cc:1552] Processing DeleteTablet for tablet 96b2d20fd2304e7a9995206a043b7944 with delete_type TABLET_DATA_DELETED (replaced by tablet 6140a160980d49b09a5fda8475fc144f) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:08.258886 8781 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 78b3f18a62d544b38a0682bf3bc00977
I20251215 14:55:08.259533 8781 master_service.cc:954] ReplaceTablet: received request to replace tablet d4cff0ed3782446397dbae8a2da52ed7 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:08.261061 8779 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_74cef17050464ec6968b0d9dce366720 [id=bec2dd63f0aa4a05961adb6a70fbfd94] alter complete (version 1)
I20251215 14:55:08.262804 9143 tablet_service.cc:1552] Processing DeleteTablet for tablet 78b3f18a62d544b38a0682bf3bc00977 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:08.264120 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_f1ea3f5f6d5e42d28a025fbdbacc1f34"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:08.264659 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1ea3f5f6d5e42d28a025fbdbacc1f34 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:08.266038 8780 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b" } modify_external_catalogs: true
I20251215 14:55:08.266188 8780 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b" } modify_external_catalogs: true
I20251215 14:55:08.266511 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_f191a21e4c4f41c2910805786164e8ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:08.266983 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f191a21e4c4f41c2910805786164e8ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:08.268146 8787 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f416fea67a974ab084b7b48a60426131" } new_table_name: "default.Table_159b0c9ea29840df94432fbee21770fd" modify_external_catalogs: true
I20251215 14:55:08.269435 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_46f35067e409451fb9ba912af7baed94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:08.269683 9427 raft_consensus.cc:740] T c8af1d0b67424bec90b59863a975254e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
W20251215 14:55:08.269917 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46f35067e409451fb9ba912af7baed94 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:08.270222 9031 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "188eb879e7c3479ea71c5b1864400243" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:08.272143 8784 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_20d3d5a89e4a447ebcd9f4062e6b477b" } modify_external_catalogs: true
I20251215 14:55:08.272310 8784 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_20d3d5a89e4a447ebcd9f4062e6b477b" } modify_external_catalogs: true
W20251215 14:55:08.274353 8782 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f9c173d11f1449b829a54190313bea3 has no consensus state
I20251215 14:55:08.274663 8782 master_service.cc:954] ReplaceTablet: received request to replace tablet 88206b17f94242378a35d5314611ac1a from {username='slave'} at 127.0.0.1:49790
W20251215 14:55:08.281832 9248 leader_election.cc:343] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:08.282384 9248 leader_election.cc:343] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:08.277129 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0154b24522401b9cc0e37fa502532f" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:08.283682 9427 consensus_queue.cc:260] T c8af1d0b67424bec90b59863a975254e P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.285604 9038 raft_consensus.cc:3060] T ce0154b24522401b9cc0e37fa502532f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.286408 9427 ts_tablet_manager.cc:1434] T c8af1d0b67424bec90b59863a975254e P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.350s user 0.002s sys 0.000s
I20251215 14:55:08.286904 9427 tablet_bootstrap.cc:492] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:08.291270 9038 raft_consensus.cc:2468] T ce0154b24522401b9cc0e37fa502532f P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:08.291494 9248 leader_election.cc:304] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
W20251215 14:55:08.292128 9248 leader_election.cc:343] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:08.295604 9283 tablet_service.cc:1552] Processing DeleteTablet for tablet 96b2d20fd2304e7a9995206a043b7944 with delete_type TABLET_DATA_DELETED (replaced by tablet 6140a160980d49b09a5fda8475fc144f) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:08.295632 9285 tablet_service.cc:1552] Processing DeleteTablet for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e317c8dc24e481abb709e932fa39c29) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:08.295660 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 78b3f18a62d544b38a0682bf3bc00977 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:08.295529 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c96b655cf284326ae3fa2a165e2bf95" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:08.297188 9952 raft_consensus.cc:2749] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:08.297212 9115 leader_election.cc:343] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:08.297699 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet c8af1d0b67424bec90b59863a975254e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:08.294466 10022 consensus_queue.cc:1048] T 26876cdffd7e4664bc8f7efb74885776 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20251215 14:55:08.298700 9426 tablet_bootstrap.cc:492] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:08.298933 9678 consensus_queue.cc:1048] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20251215 14:55:08.298273 10023 consensus_queue.cc:1048] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20251215 14:55:08.301801 9426 tablet_bootstrap.cc:654] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:08.302884 8772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.190:44279, user_credentials={real_user=slave}} blocked reactor thread for 59194.8us
W20251215 14:55:08.305414 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet a0a74645593d46fcbc0235ec6a4670d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0a74645593d46fcbc0235ec6a4670d8 already in progress: creating tablet
W20251215 14:55:08.308174 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 3c6cfff573434fbcb18feaf6a8e6a153 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c6cfff573434fbcb18feaf6a8e6a153 already in progress: creating tablet
I20251215 14:55:08.309357 9435 tablet_bootstrap.cc:492] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:08.307705 9248 leader_election.cc:304] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:08.311254 10022 raft_consensus.cc:2804] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:08.312407 10022 raft_consensus.cc:697] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
W20251215 14:55:08.310194 9249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 127573us
I20251215 14:55:08.312758 10022 consensus_queue.cc:237] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.313687 9944 ts_tablet_manager.cc:1929] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20251215 14:55:08.313520 9249 leader_election.cc:343] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:08.313910 9944 log.cc:1199] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/16edd0bfd67848e688fa12d9c679fdac
I20251215 14:55:08.314265 9249 leader_election.cc:304] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:08.315855 10023 raft_consensus.cc:2749] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:08.314456 9944 ts_tablet_manager.cc:1950] T 16edd0bfd67848e688fa12d9c679fdac P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:08.317055 9249 leader_election.cc:304] T 9425749d471f4f95bbae030977e278e4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:08.319288 10023 raft_consensus.cc:3060] T 9425749d471f4f95bbae030977e278e4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.320936 9944 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33372 (request call id 21) took 1043 ms. Trace:
W20251215 14:55:08.323408 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet fc50995f6d934b58ab5f6f6f370cb7e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc50995f6d934b58ab5f6f6f370cb7e5 already in progress: creating tablet
W20251215 14:55:08.324220 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 15b8a2a337e54321afd67f7562c412a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15b8a2a337e54321afd67f7562c412a0 already in progress: creating tablet
I20251215 14:55:08.324208 9944 rpcz_store.cc:276] 1215 14:55:07.272796 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:07.280580 (+ 7784us) service_pool.cc:225] Handling call
1215 14:55:08.197538 (+916958us) ts_tablet_manager.cc:1151] Deleting tablet 16edd0bfd67848e688fa12d9c679fdac
1215 14:55:08.199578 (+ 2040us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1215 14:55:08.295115 (+ 95537us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:08.313558 (+ 18443us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:08.316507 (+ 2949us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":813034}
I20251215 14:55:08.324930 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 16edd0bfd67848e688fa12d9c679fdac (table default.Table_c1335c74e0f740b08e701ac0246125f0 [id=a4fa8fe05f924de6b14bcc04e80479ce]) successfully deleted
W20251215 14:55:08.325225 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 58926ab073974e2c8b725d5061a544d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58926ab073974e2c8b725d5061a544d5 already in progress: creating tablet
W20251215 14:55:08.325714 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 3c274c9002544af4947aa4ee76a705ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c274c9002544af4947aa4ee76a705ce already in progress: creating tablet
W20251215 14:55:08.326107 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 3af4f753a04b429a857e018f201ae6ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3af4f753a04b429a857e018f201ae6ed already in progress: creating tablet
I20251215 14:55:08.326967 9988 tablet.cc:1722] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251215 14:55:08.332355 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 333582us
I20251215 14:55:08.332782 9777 consensus_queue.cc:1048] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:08.333994 8976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 304268us
I20251215 14:55:08.334720 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e70b4070b6437e9b934af4e6b93f6a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:08.338586 10025 tablet.cc:1722] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251215 14:55:08.347082 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 429c0b2d7cb2428c8de6b02acde36044 (table default.Table_20d2c5b358444df59324e21800508f8d [id=c421ca23de494f4ba674e4cc86bac3da]) successfully deleted
W20251215 14:55:08.348198 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 3c6cfff573434fbcb18feaf6a8e6a153 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c6cfff573434fbcb18feaf6a8e6a153 already in progress: creating tablet
W20251215 14:55:08.349289 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 15b8a2a337e54321afd67f7562c412a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15b8a2a337e54321afd67f7562c412a0 already in progress: creating tablet
I20251215 14:55:08.312402 9435 ts_tablet_manager.cc:1403] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.222s user 0.011s sys 0.002s
W20251215 14:55:08.354461 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 35ade4502ed7497a82b362d38c65244a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35ade4502ed7497a82b362d38c65244a already in progress: creating tablet
W20251215 14:55:08.358527 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet c8af1d0b67424bec90b59863a975254e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8af1d0b67424bec90b59863a975254e already in progress: creating tablet
W20251215 14:55:08.358814 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 already in progress: creating tablet
W20251215 14:55:08.359094 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 96b2d20fd2304e7a9995206a043b7944 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96b2d20fd2304e7a9995206a043b7944 already in progress: creating tablet
W20251215 14:55:08.359381 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 78b3f18a62d544b38a0682bf3bc00977 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78b3f18a62d544b38a0682bf3bc00977 already in progress: creating tablet
W20251215 14:55:08.359757 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet fc50995f6d934b58ab5f6f6f370cb7e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc50995f6d934b58ab5f6f6f370cb7e5 already in progress: creating tablet
W20251215 14:55:08.360014 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 3af4f753a04b429a857e018f201ae6ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3af4f753a04b429a857e018f201ae6ed already in progress: creating tablet
I20251215 14:55:08.364145 8779 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b [id=472c67fefad54383b4ebac7e3c77d325] alter complete (version 1)
I20251215 14:55:08.374883 9427 tablet_bootstrap.cc:654] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:08.375136 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "188eb879e7c3479ea71c5b1864400243" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:08.375399 9176 raft_consensus.cc:2468] T 188eb879e7c3479ea71c5b1864400243 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:08.376232 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce0154b24522401b9cc0e37fa502532f" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:08.376451 9174 raft_consensus.cc:3060] T ce0154b24522401b9cc0e37fa502532f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:08.378746 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 3c274c9002544af4947aa4ee76a705ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c274c9002544af4947aa4ee76a705ce already in progress: creating tablet
W20251215 14:55:08.379038 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 58926ab073974e2c8b725d5061a544d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58926ab073974e2c8b725d5061a544d5 already in progress: creating tablet
I20251215 14:55:08.382025 9426 tablet_bootstrap.cc:492] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:08.382339 9426 ts_tablet_manager.cc:1403] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.143s user 0.004s sys 0.000s
I20251215 14:55:08.383306 9426 raft_consensus.cc:359] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.383589 9426 raft_consensus.cc:385] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:08.383688 9426 raft_consensus.cc:740] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:08.383975 9426 consensus_queue.cc:260] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.384500 9426 ts_tablet_manager.cc:1434] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:08.385525 9426 tablet_bootstrap.cc:492] T e2104a3530264fa982b20aed20afb0b4 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:08.389643 8787 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f121a14828e6443695960c0e540ae573 consensus state has no leader
I20251215 14:55:08.377730 9007 tablet_service.cc:1552] Processing DeleteTablet for tablet 35ade4502ed7497a82b362d38c65244a with delete_type TABLET_DATA_DELETED (replaced by tablet d09d7ce93d074bfaa830130b31bcc594) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.378031 9016 tablet_service.cc:1552] Processing DeleteTablet for tablet c8af1d0b67424bec90b59863a975254e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.378300 9014 tablet_service.cc:1552] Processing DeleteTablet for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e317c8dc24e481abb709e932fa39c29) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.378665 9009 tablet_service.cc:1552] Processing DeleteTablet for tablet 96b2d20fd2304e7a9995206a043b7944 with delete_type TABLET_DATA_DELETED (replaced by tablet 6140a160980d49b09a5fda8475fc144f) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.379436 9003 tablet_service.cc:1552] Processing DeleteTablet for tablet 78b3f18a62d544b38a0682bf3bc00977 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.393273 9947 tablet_replica.cc:333] T c8af1d0b67424bec90b59863a975254e P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:08.393476 9947 raft_consensus.cc:2243] T c8af1d0b67424bec90b59863a975254e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:08.393651 9947 raft_consensus.cc:2272] T c8af1d0b67424bec90b59863a975254e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:08.393894 8781 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet d4cff0ed3782446397dbae8a2da52ed7
I20251215 14:55:08.394347 8781 catalog_manager.cc:6724] ReplaceTablet: tablet d4cff0ed3782446397dbae8a2da52ed7 deleted and replaced by tablet f9a0c31abcf046c9b76bea3f946ba9fc
W20251215 14:55:08.385932 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 52127.8us
I20251215 14:55:08.395237 8978 leader_election.cc:304] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:08.395505 9947 ts_tablet_manager.cc:1916] T c8af1d0b67424bec90b59863a975254e P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:08.395728 9777 consensus_queue.cc:1048] T 15a974e3265a4c88aa6d5005ffa04dc8 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:08.396148 9777 raft_consensus.cc:2764] T 95583eee8a5041b1ade97e8f8f0db271 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20251215 14:55:08.400869 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c96b655cf284326ae3fa2a165e2bf95" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:08.401787 9947 ts_tablet_manager.cc:1929] T c8af1d0b67424bec90b59863a975254e P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:08.403264 9988 tablet.cc:1722] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251215 14:55:08.403497 9947 log.cc:1199] T c8af1d0b67424bec90b59863a975254e P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/c8af1d0b67424bec90b59863a975254e
I20251215 14:55:08.403947 9947 ts_tablet_manager.cc:1950] T c8af1d0b67424bec90b59863a975254e P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
W20251215 14:55:08.386263 8976 leader_election.cc:343] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:08.407245 8784 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 5560a21e16bb43c7903c1fc66429ecdf
I20251215 14:55:08.408463 8782 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 88206b17f94242378a35d5314611ac1a
I20251215 14:55:08.408918 8782 catalog_manager.cc:6724] ReplaceTablet: tablet 88206b17f94242378a35d5314611ac1a deleted and replaced by tablet 394844a49d254112883c40df9821c075
I20251215 14:55:08.410446 9969 raft_consensus.cc:493] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:08.411738 9969 raft_consensus.cc:515] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.412421 9969 leader_election.cc:290] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:08.412616 9249 leader_election.cc:304] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:08.413218 9675 raft_consensus.cc:2804] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:08.413322 9675 raft_consensus.cc:493] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:08.413427 9675 raft_consensus.cc:3060] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.413762 9944 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33372 (request call id 26) took 1018 ms. Trace:
I20251215 14:55:08.413894 8678 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu pid 9487
I20251215 14:55:08.413856 9944 rpcz_store.cc:276] 1215 14:55:07.339746 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:07.340171 (+ 425us) service_pool.cc:225] Handling call
1215 14:55:08.325612 (+985441us) ts_tablet_manager.cc:1151] Deleting tablet 9beef04f876d40d89dac5970ac6828e9
1215 14:55:08.325625 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1215 14:55:08.357832 (+ 32207us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":750188}
I20251215 14:55:08.414284 9970 consensus_queue.cc:1048] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:08.416113 9675 raft_consensus.cc:515] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.416636 9675 leader_election.cc:290] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:08.413344 9969 consensus_queue.cc:1048] T 062a482917794ae5a67ec685a2491ba2 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:08.418900 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_719f72c4c7e64ba5b4e1b29b3b9862a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:08.419414 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c4eaf4a0d8ed44e0ba7d485098c3e9aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:08.419900 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4eaf4a0d8ed44e0ba7d485098c3e9aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:08.421134 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_473211c2c5f644acb11bdea976d43900"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:08.421557 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_473211c2c5f644acb11bdea976d43900 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:08.422600 8787 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ad3fc7fcf00c4744994fffb8a98202ae" } new_table_name: "default.Table_05d3398565e643659ed17d3e282bae1d" modify_external_catalogs: true
I20251215 14:55:08.423799 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_e566b27e9ad74847a5e198bb1a5d13f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:08.424104 9003 tablet_service.cc:1552] Processing DeleteTablet for tablet d4cff0ed3782446397dbae8a2da52ed7 with delete_type TABLET_DATA_DELETED (replaced by tablet f9a0c31abcf046c9b76bea3f946ba9fc) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:08.424209 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e566b27e9ad74847a5e198bb1a5d13f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:08.424500 9003 tablet_service.cc:1552] Processing DeleteTablet for tablet 5560a21e16bb43c7903c1fc66429ecdf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.424810 9003 tablet_service.cc:1552] Processing DeleteTablet for tablet 88206b17f94242378a35d5314611ac1a with delete_type TABLET_DATA_DELETED (replaced by tablet 394844a49d254112883c40df9821c075) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.425354 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_78c038b3edc449fab589e43dea2d2dbf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:08.425809 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78c038b3edc449fab589e43dea2d2dbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:08.426260 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 35ade4502ed7497a82b362d38c65244a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35ade4502ed7497a82b362d38c65244a already in progress: creating tablet
I20251215 14:55:08.426478 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet c8af1d0b67424bec90b59863a975254e (table default.Table_2920b8dba9704f489af552aa0ce58b64 [id=53456f18769d4b1ebe4743594e412016]) successfully deleted
W20251215 14:55:08.426685 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 already in progress: creating tablet
I20251215 14:55:08.426810 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_1cd84143b1334ccabfe606ad41e253e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:08.426889 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 96b2d20fd2304e7a9995206a043b7944 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96b2d20fd2304e7a9995206a043b7944 already in progress: creating tablet
W20251215 14:55:08.427081 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 78b3f18a62d544b38a0682bf3bc00977 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78b3f18a62d544b38a0682bf3bc00977 already in progress: creating tablet
W20251215 14:55:08.427258 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1cd84143b1334ccabfe606ad41e253e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:08.428413 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_b45cbd9a2f644f35812619a39ec8dead"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:08.428833 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b45cbd9a2f644f35812619a39ec8dead in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:08.429917 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_719f72c4c7e64ba5b4e1b29b3b9862a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:08.437239 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet d4cff0ed3782446397dbae8a2da52ed7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4cff0ed3782446397dbae8a2da52ed7 already in progress: creating tablet
W20251215 14:55:08.437500 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 5560a21e16bb43c7903c1fc66429ecdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5560a21e16bb43c7903c1fc66429ecdf already in progress: creating tablet
W20251215 14:55:08.437789 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 88206b17f94242378a35d5314611ac1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88206b17f94242378a35d5314611ac1a already in progress: creating tablet
I20251215 14:55:08.440412 9089 heartbeater.cc:499] Master 127.8.121.189:45723 was elected leader, sending a full tablet report...
I20251215 14:55:08.446772 9988 tablet.cc:1722] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:08.452008 9988 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:40622 (request call id 28) took 1090 ms. Trace:
I20251215 14:55:08.452163 9988 rpcz_store.cc:276] 1215 14:55:07.361850 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:07.366886 (+ 5036us) service_pool.cc:225] Handling call
1215 14:55:08.451957 (+1085071us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:07.483340 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
1215 14:55:07.483439 (+ 99us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
1215 14:55:07.483448 (+ 9us) alter_schema_op.cc:66] Acquired schema lock
1215 14:55:07.483456 (+ 8us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
1215 14:55:07.485253 (+ 1797us) alter_schema_op.cc:128] START. Timestamp: 1765810507485147
1215 14:55:07.485256 (+ 3us) op_driver.cc:348] REPLICATION: starting
1215 14:55:07.503966 (+ 18710us) log.cc:844] Serialized 173 byte log entry
1215 14:55:07.723643 (+219677us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x61200001e69c. stack: 00007fbaf96cfee6 00007fbaf96cfca0 00007fbaf86ab3ad 0000000000984f94 0000000000984f5d 000000000098492a 00007fbaf958bdd8 00007fbaf958d574 00007fbb04e6c1d5 00007fbb04e63044 00007fbb04e4c71b 00007fbb04e4ad6a 00007fbb04e4a294 00007fbb04e5f2fb 00007fbb04e5f178 0000000000a8970c
1215 14:55:08.446639 (+722996us) op_driver.cc:464] REPLICATION: finished
1215 14:55:08.446711 (+ 72us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
1215 14:55:08.447215 (+ 504us) log.cc:844] Serialized 5 byte log entry
1215 14:55:08.450208 (+ 2993us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:08.450547 (+ 339us) log.cc:844] Serialized 14 byte log entry
1215 14:55:08.451913 (+ 1366us) alter_schema_op.cc:73] Released schema lock
1215 14:55:08.451918 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":30,"prepare.queue_time_us":69,"prepare.run_cpu_time_us":32916,"prepare.run_wall_time_us":227967,"raft.queue_time_us":45,"raft.run_cpu_time_us":6,"raft.run_wall_time_us":6,"replication_time_us":961353,"spinlock_wait_cycles":2394496,"thread_start_us":205676,"threads_started":1,"wal-append.queue_time_us":207680}]]}
I20251215 14:55:08.455045 8780 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet b9b39c879d444172871f43349978dc86
I20251215 14:55:08.460558 9003 tablet_service.cc:1552] Processing DeleteTablet for tablet b9b39c879d444172871f43349978dc86 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.460880 9947 tablet_replica.cc:333] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:08.461122 9947 raft_consensus.cc:2243] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:08.461331 9947 raft_consensus.cc:2272] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:08.462224 9947 ts_tablet_manager.cc:1916] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:08.392433 9174 raft_consensus.cc:2468] T ce0154b24522401b9cc0e37fa502532f P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:08.399062 9984 tablet.cc:1722] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:08.403005 9143 tablet_service.cc:1552] Processing DeleteTablet for tablet d4cff0ed3782446397dbae8a2da52ed7 with delete_type TABLET_DATA_DELETED (replaced by tablet f9a0c31abcf046c9b76bea3f946ba9fc) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:08.410909 9144 tablet_service.cc:1552] Processing DeleteTablet for tablet 5560a21e16bb43c7903c1fc66429ecdf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:08.411108 9145 tablet_service.cc:1552] Processing DeleteTablet for tablet 88206b17f94242378a35d5314611ac1a with delete_type TABLET_DATA_DELETED (replaced by tablet 394844a49d254112883c40df9821c075) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:08.413877 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08ca9ee6b76b4b13b7bc26d65dcc3979" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:08.417025 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "188eb879e7c3479ea71c5b1864400243" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:08.467885 9176 raft_consensus.cc:3060] T 188eb879e7c3479ea71c5b1864400243 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.458555 9151 tablet_service.cc:1552] Processing DeleteTablet for tablet b9b39c879d444172871f43349978dc86 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:08.472981 9745 generic_service.cc:196] Checking for leaks (request via RPC)
I20251215 14:55:08.478097 8780 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_05353059978c4d13804474b05f6c8d7b" } new_table_name: "default.Table_04a63cbcd13a48149362dc372ce3cd76" modify_external_catalogs: true
W20251215 14:55:08.486569 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:08.489375 9426 tablet_bootstrap.cc:654] T e2104a3530264fa982b20aed20afb0b4 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:08.493116 10017 tablet.cc:1722] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:08.494215 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet d4cff0ed3782446397dbae8a2da52ed7 with delete_type TABLET_DATA_DELETED (replaced by tablet f9a0c31abcf046c9b76bea3f946ba9fc) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:08.494647 9943 tablet_replica.cc:333] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:08.494866 9943 raft_consensus.cc:2243] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:08.495324 9943 raft_consensus.cc:2272] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:08.496310 9943 ts_tablet_manager.cc:1916] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251215 14:55:08.500110 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet d4cff0ed3782446397dbae8a2da52ed7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4cff0ed3782446397dbae8a2da52ed7 already in progress: creating tablet
W20251215 14:55:08.500427 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 5560a21e16bb43c7903c1fc66429ecdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5560a21e16bb43c7903c1fc66429ecdf already in progress: creating tablet
W20251215 14:55:08.500699 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 88206b17f94242378a35d5314611ac1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88206b17f94242378a35d5314611ac1a already in progress: creating tablet
W20251215 14:55:08.500700 9112 leader_election.cc:343] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:08.500818 9112 leader_election.cc:304] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:08.501176 9617 raft_consensus.cc:2749] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:08.502274 9617 consensus_queue.cc:1048] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:08.504264 9943 ts_tablet_manager.cc:1929] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:08.516747 9427 tablet_bootstrap.cc:492] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:08.517002 9427 ts_tablet_manager.cc:1403] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.230s user 0.005s sys 0.000s
I20251215 14:55:08.518194 9427 raft_consensus.cc:359] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.518532 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet 5560a21e16bb43c7903c1fc66429ecdf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:08.514739 10025 tablet.cc:1722] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20251215 14:55:08.515321 9249 leader_election.cc:343] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:08.523500 9176 raft_consensus.cc:2468] T 188eb879e7c3479ea71c5b1864400243 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
W20251215 14:55:08.528091 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 9beef04f876d40d89dac5970ac6828e9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9beef04f876d40d89dac5970ac6828e9 already in progress: creating tablet
I20251215 14:55:08.528931 10023 raft_consensus.cc:2749] T 9425749d471f4f95bbae030977e278e4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:08.529621 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 88206b17f94242378a35d5314611ac1a with delete_type TABLET_DATA_DELETED (replaced by tablet 394844a49d254112883c40df9821c075) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:08.529865 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet b9b39c879d444172871f43349978dc86 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:08.534816 9249 leader_election.cc:304] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:08.537053 8787 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb309f7c439740c89470da5636523a69 has no consensus state
I20251215 14:55:08.539390 9427 raft_consensus.cc:385] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:08.539518 9427 raft_consensus.cc:740] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:08.539788 9427 consensus_queue.cc:260] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.543984 9427 ts_tablet_manager.cc:1434] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20251215 14:55:08.544376 9427 tablet_bootstrap.cc:492] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:08.546042 9427 tablet_bootstrap.cc:654] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:08.546239 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e70b4070b6437e9b934af4e6b93f6a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:08.547230 9435 raft_consensus.cc:359] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.548009 9970 raft_consensus.cc:2804] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:08.548574 9311 raft_consensus.cc:2468] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:08.549633 8779 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_9b34c87957f84ac085d807b10a2eec83" } new_table_name: "default.Table_ce00bfcd8c0b40fa8afa1518fece6bbe" modify_external_catalogs: true
I20251215 14:55:08.550881 9435 raft_consensus.cc:385] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:08.550985 9435 raft_consensus.cc:740] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:08.551199 9970 raft_consensus.cc:697] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:08.551507 9970 consensus_queue.cc:237] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.553392 8787 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ada3150d10a34cb4aaf8a16a487fa543" } modify_external_catalogs: true
I20251215 14:55:08.553606 8787 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ada3150d10a34cb4aaf8a16a487fa543" } modify_external_catalogs: true
I20251215 14:55:08.554910 8784 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_61ca8adc55ea4c149b8ddaf2b30ef360" } new_table_name: "default.Table_15ad0aa39f5048228397e27df88eea2f" modify_external_catalogs: true
I20251215 14:55:08.555385 8783 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_371fb0a76bea4b17b74b0eb7dc573f00" } modify_external_catalogs: true
I20251215 14:55:08.555539 8783 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_371fb0a76bea4b17b74b0eb7dc573f00" } modify_external_catalogs: true
I20251215 14:55:08.556420 9435 consensus_queue.cc:260] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.557451 8785 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_07a3e98683664565943371f2c3fb4d65" } modify_external_catalogs: true
I20251215 14:55:08.557624 9435 ts_tablet_manager.cc:1434] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.200s user 0.003s sys 0.000s
I20251215 14:55:08.557658 8785 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_07a3e98683664565943371f2c3fb4d65" } modify_external_catalogs: true
W20251215 14:55:08.560714 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 26876cdffd7e4664bc8f7efb74885776
W20251215 14:55:08.560833 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet f9411030d08d40aabbdee6670ba95821
W20251215 14:55:08.560892 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 15a974e3265a4c88aa6d5005ffa04dc8
W20251215 14:55:08.560962 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet df70bebdc8ad4f8186ba427e840799cf
W20251215 14:55:08.561038 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet e6aad8bed15a416a925ae8c8870d4e51
W20251215 14:55:08.561080 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet fab39532fe6a403683952057c5ccabd9
W20251215 14:55:08.561132 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 32432afc6e8d458bb7ed7abc42fb3dde
W20251215 14:55:08.561193 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 5f03dfdd546c492185c6c31866a090a5
W20251215 14:55:08.561244 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet f32a6e8df31d482fa9b9686e002d81ff
W20251215 14:55:08.561302 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 188eb879e7c3479ea71c5b1864400243
W20251215 14:55:08.561357 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 0db6246dee2643d98094408410618259
W20251215 14:55:08.561396 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 1141b9a4cf3e4aa78529bed7f0375ff8
I20251215 14:55:08.562165 8786 catalog_manager.cc:5654] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to e89303a500544272b601d7c29be802b4 (127.8.121.131). New cstate: current_term: 1 leader_uuid: "e89303a500544272b601d7c29be802b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } }
I20251215 14:55:08.562570 8786 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet ae8a49b9a3bf4845943b1ad8e318ccbb (table default.Table_99268441afd84c5fbfbd1080deabb144 [id=02a2b4848c874afe8f9860eee9bc6ce7]). Expected version 2 got 0
W20251215 14:55:08.564350 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet f830b4af355e480bbe75d6060585529e
W20251215 14:55:08.564540 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 65ea0509d8eb42bdb2291ff01e8d3bd6
W20251215 14:55:08.564661 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7
W20251215 14:55:08.564721 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet fab39532fe6a403683952057c5ccabd9
W20251215 14:55:08.564821 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 9425749d471f4f95bbae030977e278e4
W20251215 14:55:08.564918 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 813cfeea5399457e91623fb3abf9fd32
W20251215 14:55:08.564965 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 26648bf286c94b2495e565969f945858
W20251215 14:55:08.565055 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet e6aad8bed15a416a925ae8c8870d4e51
W20251215 14:55:08.565099 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 44bd51f9bf77492b8890fc7c8411c887
W20251215 14:55:08.565176 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet a0a74645593d46fcbc0235ec6a4670d8
W20251215 14:55:08.565239 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet bdfc164128a6413a83d83d05b69fb74a
W20251215 14:55:08.565295 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 16309efc14e747d09ce6e5de4f3c2784
W20251215 14:55:08.565336 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bd8d964650a49b08093608abf3e31fa
W20251215 14:55:08.565397 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 37181f50142f4d8bb88713221a755d50
W20251215 14:55:08.565436 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 80d4c9b533ac4facb4205aff84903134
W20251215 14:55:08.565490 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet ff4508c5a110427eb4d9d2eaaadace0b
W20251215 14:55:08.565529 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 924c9dd0cd9d40189bfe1457040f3d37
W20251215 14:55:08.565584 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet b329b0abcad742ff94c1a62a72d1b673
W20251215 14:55:08.565627 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 1141b9a4cf3e4aa78529bed7f0375ff8
W20251215 14:55:08.565713 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 2d75636265f14a428aae592438064ea2
W20251215 14:55:08.565768 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 11a5a6a0895c49648c910fa2ea3ca373
W20251215 14:55:08.565821 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet fc9bda52c73e4aa6b7e2eb008c63391b
W20251215 14:55:08.565886 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet ce0154b24522401b9cc0e37fa502532f
W20251215 14:55:08.565959 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 4f1f902cbcb643b9b98fa3d72babba79
W20251215 14:55:08.566000 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet cb2f4fc179744458bc7db2f6c7197ec5
W20251215 14:55:08.566053 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
W20251215 14:55:08.566092 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 30c5c795ea4a4fe591cdf63320ec2521
W20251215 14:55:08.566164 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 4816503e4fa1459dbb311997be85f64a
W20251215 14:55:08.566249 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 90c0254840b442a3817171b06f2726c8
W20251215 14:55:08.566344 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bf4a899338f4bcfac099b5099a22f05
W20251215 14:55:08.566388 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet f32a6e8df31d482fa9b9686e002d81ff
W20251215 14:55:08.566442 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 2df2138e41844e9f897e57264b62cc9d
W20251215 14:55:08.566486 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet c0d0022e48f04b83ac1c998a83fe3f55
W20251215 14:55:08.566540 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 92e21a77ad074572a57b836743903a0b
W20251215 14:55:08.566583 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet d922d7b24dbd474cbee47c72f2779a07
W20251215 14:55:08.566666 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet f2aae2798eee4775afaa3afc59e98a6c
W20251215 14:55:08.566711 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 26876cdffd7e4664bc8f7efb74885776
W20251215 14:55:08.566977 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet f9411030d08d40aabbdee6670ba95821
W20251215 14:55:08.567039 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 062a482917794ae5a67ec685a2491ba2
W20251215 14:55:08.567094 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet df70bebdc8ad4f8186ba427e840799cf
W20251215 14:55:08.567427 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 194bb745ecb849cb9092fee1afb7dbe6
W20251215 14:55:08.567543 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 32432afc6e8d458bb7ed7abc42fb3dde
W20251215 14:55:08.567692 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 95583eee8a5041b1ade97e8f8f0db271
W20251215 14:55:08.568454 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:55:08.568679 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 188eb879e7c3479ea71c5b1864400243
W20251215 14:55:08.568908 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 0db6246dee2643d98094408410618259
W20251215 14:55:08.569417 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 15a974e3265a4c88aa6d5005ffa04dc8
W20251215 14:55:08.569584 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 5f03dfdd546c492185c6c31866a090a5
W20251215 14:55:08.569782 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 018bd6ac8a534a6abc461b57b89b93eb
W20251215 14:55:08.569988 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet f9695d47e35448fdad95ff3f24bafd03
W20251215 14:55:08.570176 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 9beef04f876d40d89dac5970ac6828e9
W20251215 14:55:08.570465 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 18cd1f63d51e4565bb8c55be13e3e099
W20251215 14:55:08.570806 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 5e80ac7bd98a46119a30bd5d2f3de2f9
W20251215 14:55:08.571106 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 4a6846144c8c409cad340e99374a38c6
W20251215 14:55:08.571367 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet f7af1f66c4f04f649379758ff1b3e387
W20251215 14:55:08.571609 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 034fec793ae74fcda0c73f1cea291311
I20251215 14:55:08.576376 10019 consensus_queue.cc:1048] T 9425749d471f4f95bbae030977e278e4 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.045s
I20251215 14:55:08.576396 9943 log.cc:1199] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/b9b39c879d444172871f43349978dc86
W20251215 14:55:08.582490 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 3cdfcddd91fe47de8fd14dc718f421a6 (table default.Table_aba7a90daaf544eb972bd7349f27ae63 [id=2bd880b71b174f528054fbc22143c01f], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3cdfcddd91fe47de8fd14dc718f421a6 consensus state has no leader
I20251215 14:55:08.602403 9943 ts_tablet_manager.cc:1950] T b9b39c879d444172871f43349978dc86 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:08.603502 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet b9b39c879d444172871f43349978dc86 (table default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b [id=472c67fefad54383b4ebac7e3c77d325]) successfully deleted
I20251215 14:55:08.531077 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "188eb879e7c3479ea71c5b1864400243" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:08.531350 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08ca9ee6b76b4b13b7bc26d65dcc3979" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:08.644371 9944 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33372 (request call id 24) took 1299 ms. Trace:
I20251215 14:55:08.644500 9944 rpcz_store.cc:276] 1215 14:55:07.339527 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:07.340133 (+ 606us) service_pool.cc:225] Handling call
1215 14:55:08.414154 (+1074021us) ts_tablet_manager.cc:1151] Deleting tablet 90c0254840b442a3817171b06f2726c8
1215 14:55:08.617261 (+203107us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1215 14:55:08.639345 (+ 22084us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":838551}
I20251215 14:55:08.645570 9944 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33372 (request call id 23) took 1305 ms. Trace:
I20251215 14:55:08.645670 9944 rpcz_store.cc:276] 1215 14:55:07.339352 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:07.340107 (+ 755us) service_pool.cc:225] Handling call
1215 14:55:08.644764 (+1304657us) ts_tablet_manager.cc:1151] Deleting tablet f830b4af355e480bbe75d6060585529e
1215 14:55:08.644774 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1215 14:55:08.644886 (+ 112us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1068953}
W20251215 14:55:08.646099 9248 leader_election.cc:343] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:08.646654 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 90c0254840b442a3817171b06f2726c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90c0254840b442a3817171b06f2726c8 already in progress: creating tablet
W20251215 14:55:08.646917 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet f830b4af355e480bbe75d6060585529e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f830b4af355e480bbe75d6060585529e already in progress: creating tablet
I20251215 14:55:08.647274 9944 tablet_replica.cc:333] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:08.647480 9944 raft_consensus.cc:2243] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:08.648125 9435 tablet_bootstrap.cc:492] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:08.520015 9988 tablet.cc:1722] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251215 14:55:08.653468 9248 leader_election.cc:343] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:08.653630 9248 leader_election.cc:304] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:08.653893 9952 raft_consensus.cc:2749] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:08.655817 9944 raft_consensus.cc:2272] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 14:55:08.659473 10032 log.cc:927] Time spent T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4: Append to log took a long time: real 0.061s user 0.001s sys 0.000s
I20251215 14:55:08.568560 8978 leader_election.cc:304] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:08.585280 9947 ts_tablet_manager.cc:1929] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:08.660181 9947 log.cc:1199] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/b9b39c879d444172871f43349978dc86
I20251215 14:55:08.660279 10021 raft_consensus.cc:2804] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:08.660364 10021 raft_consensus.cc:493] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:08.660458 10021 raft_consensus.cc:3060] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.660665 9947 ts_tablet_manager.cc:1950] T b9b39c879d444172871f43349978dc86 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:08.661821 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet b9b39c879d444172871f43349978dc86 (table default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b [id=472c67fefad54383b4ebac7e3c77d325]) successfully deleted
W20251215 14:55:08.662060 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 93540.7us
I20251215 14:55:08.664036 9944 ts_tablet_manager.cc:1916] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:08.665544 10021 raft_consensus.cc:515] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.666227 10021 leader_election.cc:290] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:08.666692 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e70b4070b6437e9b934af4e6b93f6a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:08.667359 8976 leader_election.cc:343] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:08.676497 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e70b4070b6437e9b934af4e6b93f6a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:08.676690 9313 raft_consensus.cc:3060] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.667860 10031 tablet.cc:1722] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251215 14:55:08.684899 10060 log.cc:927] Time spent T f9411030d08d40aabbdee6670ba95821 P e89303a500544272b601d7c29be802b4: Append to log took a long time: real 0.077s user 0.000s sys 0.000s
W20251215 14:55:08.689736 8779 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 798eb606957b4cf7a737ec1636437581 has no consensus state
I20251215 14:55:08.691206 9435 tablet_bootstrap.cc:654] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:08.693174 9944 ts_tablet_manager.cc:1929] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:08.697947 10017 tablet.cc:1722] T 7f38c44dbc884d74a61c7ed98deaf6aa P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:08.703073 9313 raft_consensus.cc:2468] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:08.705071 9944 log.cc:1199] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/429c0b2d7cb2428c8de6b02acde36044
I20251215 14:55:08.705458 8978 leader_election.cc:304] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:08.705933 10021 raft_consensus.cc:2804] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:08.706213 10021 raft_consensus.cc:697] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:08.706689 10021 consensus_queue.cc:237] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.710964 10017 tablet.cc:1722] T ae8a49b9a3bf4845943b1ad8e318ccbb P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:08.712605 9944 ts_tablet_manager.cc:1950] T 429c0b2d7cb2428c8de6b02acde36044 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:08.714258 8783 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 377c3e08df404b75a6a53dd2ef6e5f78
I20251215 14:55:08.715027 9427 tablet_bootstrap.cc:492] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:08.715214 9427 ts_tablet_manager.cc:1403] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.171s user 0.003s sys 0.001s
I20251215 14:55:08.716219 8785 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 10aa7633907e455caf2f0f9a506fc924
I20251215 14:55:08.716666 9617 consensus_queue.cc:1048] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:08.719234 9427 raft_consensus.cc:359] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.719525 9427 raft_consensus.cc:385] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:08.719662 9427 raft_consensus.cc:740] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:08.719974 9427 consensus_queue.cc:260] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.720682 9427 ts_tablet_manager.cc:1434] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251215 14:55:08.721550 9427 tablet_bootstrap.cc:492] T 16309efc14e747d09ce6e5de4f3c2784 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:08.724418 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet bb3b95d32c7044bd8a4451381c19aeba (table default.Table_7cbbdace45d641d4a9c5b95389d76554 [id=7ec65d77d89d4e40a60b716f721e2940]). Expected version 4 got 0
I20251215 14:55:08.725631 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 4c96b655cf284326ae3fa2a165e2bf95 (table default.Table_99ea47285b994715a5fae3cfb669d229 [id=b7ff2d02e55b4e839049b20b89227526]). Expected version 1 got 0
I20251215 14:55:08.725960 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d [id=066e8ae14004436cb8b4f3f740b45b19]). Expected version 3 got 0
I20251215 14:55:08.726357 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 5dc81eb40614463cb5017475b378eea6 (table default.Table_76a8f78ec8a74aadaf69142df6990dc8 [id=94ddd629cb1e4f5eb0061100187f4202]). Expected version 1 got 0
I20251215 14:55:08.726745 9427 tablet_bootstrap.cc:654] T 16309efc14e747d09ce6e5de4f3c2784 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:08.726720 9944 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33372 (request call id 25) took 1374 ms. Trace:
I20251215 14:55:08.726912 8781 catalog_manager.cc:5654] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156 reported cstate change: term changed from 0 to 1, leader changed from <none> to e89303a500544272b601d7c29be802b4 (127.8.121.131). New cstate: current_term: 1 leader_uuid: "e89303a500544272b601d7c29be802b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } }
I20251215 14:55:08.728325 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet c00aecc23c6541cbae4abd7cb1b3077b (table default.Table_b527fedbc2c14bb3861289fe2b27fd43 [id=640d70bd78554e92823dc104e06227d3]). Expected version 3 got 0
I20251215 14:55:08.728781 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 21a98ce868924690b8a5715f4103c360 (table default.Table_b83bf47931314e5b82bb09f7d6cd2ec8 [id=cb60f7deb1c34398b39508393cc4cefd]). Expected version 1 got 0
I20251215 14:55:08.728648 9944 rpcz_store.cc:276] 1215 14:55:07.339634 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:07.340153 (+ 519us) service_pool.cc:225] Handling call
1215 14:55:08.645903 (+1305750us) ts_tablet_manager.cc:1151] Deleting tablet 429c0b2d7cb2428c8de6b02acde36044
1215 14:55:08.645911 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1215 14:55:08.673365 (+ 27454us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:08.678534 (+ 5169us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:08.714487 (+ 35953us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1069699}
I20251215 14:55:08.729139 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 35326e99d413431583b25d11269d09dc (table default.Table_7624bbb38e9c499390f53c92673ed169 [id=41f7f84b468f4860b54a4544d236cecc]). Expected version 1 got 0
I20251215 14:55:08.729223 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 429c0b2d7cb2428c8de6b02acde36044 (table default.Table_20d2c5b358444df59324e21800508f8d [id=c421ca23de494f4ba674e4cc86bac3da]) successfully deleted
I20251215 14:55:08.729920 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781]). Expected version 2 got 0
I20251215 14:55:08.730331 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet e2104a3530264fa982b20aed20afb0b4 (table default.Table_6bd7eee6a17d43f4baf1db824203acab [id=d916193804f94519b84d259c0420e1a1]). Expected version 1 got 0
I20251215 14:55:08.731266 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_3f190fdaff1446908955f4b5957a8084 [id=cbafb4499c90447d8f185928d3e58b20]). Expected version 1 got 0
I20251215 14:55:08.731690 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 5830296559264b609909486aa15c9e2e (table default.Table_19778cae47da4d7fb3b868bdcea673ef [id=cfa97744d0364459ba63ed1d52dc15db]). Expected version 1 got 0
I20251215 14:55:08.731956 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet a639396098a941249afd9c3560073131 (table default.Table_404807c380fa4483ac5e0545eb3028cd [id=5cc820ec2c8b427db1c89647b295363e]). Expected version 1 got 0
I20251215 14:55:08.732700 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 0a597fd6c7c044228ffb2a5a5f924e70 (table default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f]). Expected version 1 got 0
I20251215 14:55:08.732960 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_93ee270c113a4a51ab4e5fe5f80117b0 [id=fa027087d00d452daa95b171d95c5a82]). Expected version 2 got 0
I20251215 14:55:08.733192 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1]). Expected version 1 got 0
I20251215 14:55:08.733395 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet f121a14828e6443695960c0e540ae573 (table default.Table_159b0c9ea29840df94432fbee21770fd [id=0e3677e1f3d048ecad508d50304ee56a]). Expected version 2 got 0
W20251215 14:55:08.733824 8780 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5dd36ea0aa53460f9c1fda4b31063fa7 consensus state has no leader
I20251215 14:55:08.736166 9944 tablet_replica.cc:333] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:08.736413 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 38e50a7f2bdd4907ab41436b59397ea6
I20251215 14:55:08.736635 9944 raft_consensus.cc:2243] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:08.736814 9944 raft_consensus.cc:2272] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:08.737540 9944 ts_tablet_manager.cc:1916] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:08.741912 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet 38e50a7f2bdd4907ab41436b59397ea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:08.741990 9003 tablet_service.cc:1552] Processing DeleteTablet for tablet 38e50a7f2bdd4907ab41436b59397ea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:08.742803 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 38e50a7f2bdd4907ab41436b59397ea6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38e50a7f2bdd4907ab41436b59397ea6 already in progress: creating tablet
I20251215 14:55:08.744764 9151 tablet_service.cc:1552] Processing DeleteTablet for tablet 38e50a7f2bdd4907ab41436b59397ea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:08.745602 8784 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 394844a49d254112883c40df9821c075 has no consensus state
W20251215 14:55:08.745566 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 38e50a7f2bdd4907ab41436b59397ea6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38e50a7f2bdd4907ab41436b59397ea6 already in progress: creating tablet
I20251215 14:55:08.745923 8784 master_service.cc:954] ReplaceTablet: received request to replace tablet 0a597fd6c7c044228ffb2a5a5f924e70 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:08.746065 9426 tablet_bootstrap.cc:492] T e2104a3530264fa982b20aed20afb0b4 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:08.747471 8783 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c042437915b141518837aa551d8500d0" } new_table_name: "default.Table_5ed1858b15504f70a200762ea0f213f1" modify_external_catalogs: true
I20251215 14:55:08.747483 9426 ts_tablet_manager.cc:1403] T e2104a3530264fa982b20aed20afb0b4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.362s user 0.014s sys 0.000s
I20251215 14:55:08.749176 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_2c8a749747754618ab3d5e74e5326d98"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:08.749809 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c8a749747754618ab3d5e74e5326d98 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:08.751255 9435 tablet_bootstrap.cc:492] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:08.751423 9435 ts_tablet_manager.cc:1403] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.134s user 0.005s sys 0.008s
I20251215 14:55:08.752313 9435 raft_consensus.cc:359] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.752492 9435 raft_consensus.cc:385] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:08.752599 9435 raft_consensus.cc:740] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:08.752815 9435 consensus_queue.cc:260] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.753454 9435 ts_tablet_manager.cc:1434] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:08.753772 9435 tablet_bootstrap.cc:492] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:08.754000 8787 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f4e69462c1fa42df8f9776f053474a93" } modify_external_catalogs: true
I20251215 14:55:08.754182 8787 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f4e69462c1fa42df8f9776f053474a93" } modify_external_catalogs: true
I20251215 14:55:08.754882 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_70b30cfea42546a2be4d9bcc5925c6f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:08.755432 9435 tablet_bootstrap.cc:654] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:08.755502 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70b30cfea42546a2be4d9bcc5925c6f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:08.758589 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_26f1e6862cc04d2d90fa8651f5d7e480"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:08.759763 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 65ea0509d8eb42bdb2291ff01e8d3bd6
W20251215 14:55:08.760063 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet f830b4af355e480bbe75d6060585529e
W20251215 14:55:08.759894 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26f1e6862cc04d2d90fa8651f5d7e480 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:08.760370 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 2d75636265f14a428aae592438064ea2
W20251215 14:55:08.760510 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet ff4508c5a110427eb4d9d2eaaadace0b
W20251215 14:55:08.760686 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7
W20251215 14:55:08.760916 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet fab39532fe6a403683952057c5ccabd9
W20251215 14:55:08.761111 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 9425749d471f4f95bbae030977e278e4
I20251215 14:55:08.761299 9435 tablet_bootstrap.cc:492] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
W20251215 14:55:08.761322 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 813cfeea5399457e91623fb3abf9fd32
I20251215 14:55:08.761444 9435 ts_tablet_manager.cc:1403] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
W20251215 14:55:08.761584 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 26648bf286c94b2495e565969f945858
W20251215 14:55:08.761792 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet a0a74645593d46fcbc0235ec6a4670d8
W20251215 14:55:08.761986 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet bdfc164128a6413a83d83d05b69fb74a
I20251215 14:55:08.762105 9435 raft_consensus.cc:359] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.762290 9435 raft_consensus.cc:385] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251215 14:55:08.762233 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 2df2138e41844e9f897e57264b62cc9d
I20251215 14:55:08.762358 9435 raft_consensus.cc:740] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
W20251215 14:55:08.762573 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet c0d0022e48f04b83ac1c998a83fe3f55
I20251215 14:55:08.762574 9435 consensus_queue.cc:260] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:08.762821 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 92e21a77ad074572a57b836743903a0b
W20251215 14:55:08.762987 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet e6aad8bed15a416a925ae8c8870d4e51
W20251215 14:55:08.763130 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 44bd51f9bf77492b8890fc7c8411c887
W20251215 14:55:08.763324 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 16309efc14e747d09ce6e5de4f3c2784
W20251215 14:55:08.763453 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bd8d964650a49b08093608abf3e31fa
I20251215 14:55:08.763594 9435 ts_tablet_manager.cc:1434] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20251215 14:55:08.763646 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 37181f50142f4d8bb88713221a755d50
W20251215 14:55:08.763861 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 80d4c9b533ac4facb4205aff84903134
I20251215 14:55:08.763885 9435 tablet_bootstrap.cc:492] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:08.763832 9981 consensus_queue.cc:1048] T 95583eee8a5041b1ade97e8f8f0db271 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:08.765553 9435 tablet_bootstrap.cc:654] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:08.769419 9944 ts_tablet_manager.cc:1929] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:08.771522 9427 tablet_bootstrap.cc:492] T 16309efc14e747d09ce6e5de4f3c2784 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:08.771723 9427 ts_tablet_manager.cc:1403] T 16309efc14e747d09ce6e5de4f3c2784 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.050s user 0.005s sys 0.001s
I20251215 14:55:08.772673 9427 raft_consensus.cc:359] T 16309efc14e747d09ce6e5de4f3c2784 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.772899 9427 raft_consensus.cc:385] T 16309efc14e747d09ce6e5de4f3c2784 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:08.772998 9427 raft_consensus.cc:740] T 16309efc14e747d09ce6e5de4f3c2784 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:08.772908 9426 raft_consensus.cc:359] T e2104a3530264fa982b20aed20afb0b4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.773286 9427 consensus_queue.cc:260] T 16309efc14e747d09ce6e5de4f3c2784 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.773460 9426 raft_consensus.cc:385] T e2104a3530264fa982b20aed20afb0b4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:08.773844 9426 raft_consensus.cc:740] T e2104a3530264fa982b20aed20afb0b4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:08.774335 9427 ts_tablet_manager.cc:1434] T 16309efc14e747d09ce6e5de4f3c2784 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:08.774664 9427 tablet_bootstrap.cc:492] T 188eb879e7c3479ea71c5b1864400243 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:08.774612 9426 consensus_queue.cc:260] T e2104a3530264fa982b20aed20afb0b4 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.775679 9426 ts_tablet_manager.cc:1434] T e2104a3530264fa982b20aed20afb0b4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.027s user 0.003s sys 0.000s
I20251215 14:55:08.775920 9944 log.cc:1199] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/f080b56cff244a46bfb73d05d3127f31
I20251215 14:55:08.776388 9944 ts_tablet_manager.cc:1950] T f080b56cff244a46bfb73d05d3127f31 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:08.776439 9426 tablet_bootstrap.cc:492] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:08.777148 9427 tablet_bootstrap.cc:654] T 188eb879e7c3479ea71c5b1864400243 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:08.780227 9944 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33372 (request call id 30) took 1205 ms. Trace:
I20251215 14:55:08.782995 9944 rpcz_store.cc:276] 1215 14:55:07.574721 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:07.574904 (+ 183us) service_pool.cc:225] Handling call
1215 14:55:08.729492 (+1154588us) ts_tablet_manager.cc:1151] Deleting tablet f080b56cff244a46bfb73d05d3127f31
1215 14:55:08.729505 (+ 13us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1215 14:55:08.758777 (+ 29272us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:08.769310 (+ 10533us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:08.780176 (+ 10866us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1151271}
I20251215 14:55:08.784180 9426 tablet_bootstrap.cc:654] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:08.782110 9435 tablet_bootstrap.cc:492] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:08.784917 9435 ts_tablet_manager.cc:1403] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.002s
I20251215 14:55:08.785696 9435 raft_consensus.cc:359] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.786278 9435 raft_consensus.cc:385] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:08.786417 9435 raft_consensus.cc:740] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:08.786170 9944 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33372 (request call id 29) took 1222 ms. Trace:
I20251215 14:55:08.787226 9944 rpcz_store.cc:276] 1215 14:55:07.563874 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:07.564089 (+ 215us) service_pool.cc:225] Handling call
1215 14:55:08.785966 (+1221877us) ts_tablet_manager.cc:1151] Deleting tablet 61aef86a30e842f2a90f9f1c88c84f4d
1215 14:55:08.785976 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1215 14:55:08.786117 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":826058}
I20251215 14:55:08.788203 9944 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33372 (request call id 31) took 1209 ms. Trace:
W20251215 14:55:08.788673 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet fc9bda52c73e4aa6b7e2eb008c63391b
W20251215 14:55:08.788945 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet ce0154b24522401b9cc0e37fa502532f
W20251215 14:55:08.789194 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 4f1f902cbcb643b9b98fa3d72babba79
W20251215 14:55:08.789358 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 924c9dd0cd9d40189bfe1457040f3d37
W20251215 14:55:08.789562 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet b329b0abcad742ff94c1a62a72d1b673
W20251215 14:55:08.789747 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 1141b9a4cf3e4aa78529bed7f0375ff8
W20251215 14:55:08.789911 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet cb2f4fc179744458bc7db2f6c7197ec5
W20251215 14:55:08.790175 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 429c0b2d7cb2428c8de6b02acde36044
W20251215 14:55:08.790416 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 4816503e4fa1459dbb311997be85f64a
W20251215 14:55:08.790627 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 90c0254840b442a3817171b06f2726c8
W20251215 14:55:08.790889 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
W20251215 14:55:08.791024 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 30c5c795ea4a4fe591cdf63320ec2521
W20251215 14:55:08.791229 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 26876cdffd7e4664bc8f7efb74885776
W20251215 14:55:08.791384 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet f2aae2798eee4775afaa3afc59e98a6c
W20251215 14:55:08.791661 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:55:08.792066 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet df70bebdc8ad4f8186ba427e840799cf
W20251215 14:55:08.792244 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 32432afc6e8d458bb7ed7abc42fb3dde
W20251215 14:55:08.792434 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 95583eee8a5041b1ade97e8f8f0db271
W20251215 14:55:08.792660 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 062a482917794ae5a67ec685a2491ba2
W20251215 14:55:08.792937 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 194bb745ecb849cb9092fee1afb7dbe6
W20251215 14:55:08.793116 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet f9411030d08d40aabbdee6670ba95821
I20251215 14:55:08.793026 9944 rpcz_store.cc:276] 1215 14:55:07.579006 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:07.579099 (+ 93us) service_pool.cc:225] Handling call
1215 14:55:08.788055 (+1208956us) ts_tablet_manager.cc:1151] Deleting tablet 3c6cfff573434fbcb18feaf6a8e6a153
1215 14:55:08.788064 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1215 14:55:08.788156 (+ 92us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":828010}
W20251215 14:55:08.793273 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 0db6246dee2643d98094408410618259
W20251215 14:55:08.793483 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 15a974e3265a4c88aa6d5005ffa04dc8
W20251215 14:55:08.793645 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 5f03dfdd546c492185c6c31866a090a5
W20251215 14:55:08.793696 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 3c6cfff573434fbcb18feaf6a8e6a153 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c6cfff573434fbcb18feaf6a8e6a153 already in progress: creating tablet
W20251215 14:55:08.793900 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet f32a6e8df31d482fa9b9686e002d81ff
I20251215 14:55:08.788475 9435 consensus_queue.cc:260] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:08.794096 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bf4a899338f4bcfac099b5099a22f05
W20251215 14:55:08.794404 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 18cd1f63d51e4565bb8c55be13e3e099
W20251215 14:55:08.794520 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 188eb879e7c3479ea71c5b1864400243
W20251215 14:55:08.794718 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 018bd6ac8a534a6abc461b57b89b93eb
W20251215 14:55:08.794843 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet f9695d47e35448fdad95ff3f24bafd03
W20251215 14:55:08.795109 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 5e80ac7bd98a46119a30bd5d2f3de2f9
W20251215 14:55:08.795413 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 4a6846144c8c409cad340e99374a38c6
W20251215 14:55:08.795590 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet f7af1f66c4f04f649379758ff1b3e387
W20251215 14:55:08.795796 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet fc50995f6d934b58ab5f6f6f370cb7e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc50995f6d934b58ab5f6f6f370cb7e5 already in progress: creating tablet
I20251215 14:55:08.796518 9435 ts_tablet_manager.cc:1434] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20251215 14:55:08.799528 8786 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_0593d9b93de9400ba29718af1b328262 [id=50a94314f5ba46e3a75b5a15e7362299] alter complete (version 1)
I20251215 14:55:08.812322 9953 raft_consensus.cc:493] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:08.812517 9953 raft_consensus.cc:515] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.813097 9953 leader_election.cc:290] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:08.814652 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c96b655cf284326ae3fa2a165e2bf95" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:08.815081 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c96b655cf284326ae3fa2a165e2bf95" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:08.815315 9170 raft_consensus.cc:2468] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:08.815795 9249 leader_election.cc:304] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:08.816495 9248 leader_election.cc:343] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:08.817021 9953 raft_consensus.cc:2804] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:08.817122 9953 raft_consensus.cc:493] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:08.817209 9953 raft_consensus.cc:3060] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.820117 9953 raft_consensus.cc:515] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.820624 8786 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_aba7a90daaf544eb972bd7349f27ae63 [id=2bd880b71b174f528054fbc22143c01f] alter complete (version 3)
I20251215 14:55:08.821314 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c96b655cf284326ae3fa2a165e2bf95" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:08.821758 8786 master_service.cc:954] ReplaceTablet: received request to replace tablet bdfc164128a6413a83d83d05b69fb74a from {username='slave'} at 127.0.0.1:49790
W20251215 14:55:08.821864 9248 leader_election.cc:343] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:08.827517 9009 tablet_service.cc:1552] Processing DeleteTablet for tablet 0215ff355fce46b5a4cf1bf4bd7164f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.827778 9014 tablet_service.cc:1552] Processing DeleteTablet for tablet a0a74645593d46fcbc0235ec6a4670d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.828220 9007 tablet_service.cc:1552] Processing DeleteTablet for tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.828410 9005 tablet_service.cc:1552] Processing DeleteTablet for tablet 9bf4a899338f4bcfac099b5099a22f05 with delete_type TABLET_DATA_DELETED (replaced by tablet 78b3f18a62d544b38a0682bf3bc00977) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:08.827919 8788 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet 5560a21e16bb43c7903c1fc66429ecdf (table default.Table_20d3d5a89e4a447ebcd9f4062e6b477b [id=5f7704a7da85406cb20243ca8c50962d], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5560a21e16bb43c7903c1fc66429ecdf consensus state has no leader
I20251215 14:55:08.828581 9019 tablet_service.cc:1552] Processing DeleteTablet for tablet f830b4af355e480bbe75d6060585529e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:06 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.828764 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 with delete_type TABLET_DATA_DELETED (replaced by tablet 21a98ce868924690b8a5715f4103c360) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.828927 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet 16edd0bfd67848e688fa12d9c679fdac with delete_type TABLET_DATA_DELETED (replaced by tablet df30b9f793bf4232ba848f569100a747) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.829097 9008 tablet_service.cc:1552] Processing DeleteTablet for tablet f7af1f66c4f04f649379758ff1b3e387 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.829288 9947 tablet_replica.cc:333] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:08.829483 9947 raft_consensus.cc:2243] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:08.829638 9947 pending_rounds.cc:70] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156: Trying to abort 1 pending ops.
I20251215 14:55:08.829692 9947 pending_rounds.cc:77] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232759835010891776 op_type: NO_OP noop_request { }
I20251215 14:55:08.829803 9947 raft_consensus.cc:2889] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251215 14:55:08.829908 9947 raft_consensus.cc:2272] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:08.830786 9947 ts_tablet_manager.cc:1916] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251215 14:55:08.832078 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 58926ab073974e2c8b725d5061a544d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58926ab073974e2c8b725d5061a544d5 already in progress: creating tablet
W20251215 14:55:08.834872 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 034fec793ae74fcda0c73f1cea291311
W20251215 14:55:08.836496 8783 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 77780f8cfe544db7baee2c761fe52ca2 consensus state has no leader
I20251215 14:55:08.836719 9947 ts_tablet_manager.cc:1929] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:08.836774 8783 master_service.cc:954] ReplaceTablet: received request to replace tablet c4f47c22111c427a8ab9c4ae1e105375 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:08.836843 9947 log.cc:1199] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:55:08.837164 8783 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_2cd6053e07df4b11bbd32c56cde0cf9f" } modify_external_catalogs: true
I20251215 14:55:08.837328 8783 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_2cd6053e07df4b11bbd32c56cde0cf9f" } modify_external_catalogs: true
I20251215 14:55:08.837749 9003 tablet_service.cc:1552] Processing DeleteTablet for tablet 18cd1f63d51e4565bb8c55be13e3e099 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:06 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.838231 9947 ts_tablet_manager.cc:1950] T 0215ff355fce46b5a4cf1bf4bd7164f3 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:08.839757 8780 master_service.cc:954] ReplaceTablet: received request to replace tablet 11a5a6a0895c49648c910fa2ea3ca373 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:08.840211 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_f88a18e5389a43c181dee6486cd0b5a3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:08.840757 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f88a18e5389a43c181dee6486cd0b5a3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:08.842124 8773 catalog_manager.cc:5058] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): alter failed for tablet b9b39c879d444172871f43349978dc86 (table default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b [id=472c67fefad54383b4ebac7e3c77d325]),no further retry: Not found: Tablet not found: b9b39c879d444172871f43349978dc86
I20251215 14:55:08.842864 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet 90c0254840b442a3817171b06f2726c8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:06 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.843271 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet d922d7b24dbd474cbee47c72f2779a07 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:05 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.843127 9008 tablet_service.cc:1552] Processing DeleteTablet for tablet 429c0b2d7cb2428c8de6b02acde36044 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:06 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.843327 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_5b54d0c2c0154c2792f194721a32c6e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:08.843472 9947 tablet_replica.cc:333] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:08.843533 9003 tablet_service.cc:1552] Processing DeleteTablet for tablet ff4508c5a110427eb4d9d2eaaadace0b with delete_type TABLET_DATA_DELETED (replaced by tablet 15b8a2a337e54321afd67f7562c412a0) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.843669 9947 raft_consensus.cc:2243] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:08.843854 9947 pending_rounds.cc:70] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156: Trying to abort 1 pending ops.
W20251215 14:55:08.843866 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5b54d0c2c0154c2792f194721a32c6e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:08.843916 9947 pending_rounds.cc:77] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232759833384177664 op_type: NO_OP noop_request { }
I20251215 14:55:08.844030 9947 raft_consensus.cc:2889] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251215 14:55:08.844139 9947 raft_consensus.cc:2272] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:08.844736 9947 ts_tablet_manager.cc:1916] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:08.845566 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c96b655cf284326ae3fa2a165e2bf95" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:08.845790 9170 raft_consensus.cc:3060] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.846522 10033 raft_consensus.cc:493] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:08.846652 10033 raft_consensus.cc:515] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.847268 10033 leader_election.cc:290] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:08.847440 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_b7c3ac62986d4570822a7b1930ee841f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:08.847962 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7c3ac62986d4570822a7b1930ee841f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:08.847973 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfead52afe8040a88ba0d826f482b1bd" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:08.848448 8976 leader_election.cc:343] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:08.849042 9170 raft_consensus.cc:2468] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:08.849224 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 0215ff355fce46b5a4cf1bf4bd7164f3 (table default.Table_28c03048db094b5093cd88eb3dc6f7fe [id=cf0e40d55af1486db1df4e85048a070b]) successfully deleted
W20251215 14:55:08.849511 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet a0a74645593d46fcbc0235ec6a4670d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a0a74645593d46fcbc0235ec6a4670d8 already in progress: creating tablet
W20251215 14:55:08.849695 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 already in progress: creating tablet
W20251215 14:55:08.849853 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 9bf4a899338f4bcfac099b5099a22f05 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9bf4a899338f4bcfac099b5099a22f05 already in progress: creating tablet
I20251215 14:55:08.849925 9249 leader_election.cc:304] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
W20251215 14:55:08.850020 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet f830b4af355e480bbe75d6060585529e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f830b4af355e480bbe75d6060585529e already in progress: creating tablet
W20251215 14:55:08.850160 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 65ea0509d8eb42bdb2291ff01e8d3bd6 already in progress: creating tablet
W20251215 14:55:08.850322 8772 catalog_manager.cc:4952] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 16edd0bfd67848e688fa12d9c679fdac because the tablet was not found. No further retry: Not found: Tablet not found: 16edd0bfd67848e688fa12d9c679fdac
W20251215 14:55:08.850468 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet f7af1f66c4f04f649379758ff1b3e387 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f7af1f66c4f04f649379758ff1b3e387 already in progress: creating tablet
I20251215 14:55:08.850662 9678 raft_consensus.cc:2804] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
W20251215 14:55:08.850710 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 90c0254840b442a3817171b06f2726c8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 90c0254840b442a3817171b06f2726c8 already in progress: creating tablet
I20251215 14:55:08.851050 9678 raft_consensus.cc:697] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:08.851543 9678 consensus_queue.cc:237] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.852481 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfead52afe8040a88ba0d826f482b1bd" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:08.852674 9313 raft_consensus.cc:2468] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:08.853163 8978 leader_election.cc:304] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:08.853597 10033 raft_consensus.cc:2804] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:08.853724 10033 raft_consensus.cc:493] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:08.853808 10033 raft_consensus.cc:3060] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.854315 9944 tablet_replica.cc:333] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:08.854513 9944 raft_consensus.cc:2243] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:08.854701 9944 raft_consensus.cc:2272] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:08.855558 9944 ts_tablet_manager.cc:1916] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251215 14:55:08.855788 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 3af4f753a04b429a857e018f201ae6ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3af4f753a04b429a857e018f201ae6ed already in progress: creating tablet
W20251215 14:55:08.856060 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 15b8a2a337e54321afd67f7562c412a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15b8a2a337e54321afd67f7562c412a0 already in progress: creating tablet
W20251215 14:55:08.856261 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 3c274c9002544af4947aa4ee76a705ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c274c9002544af4947aa4ee76a705ce already in progress: creating tablet
W20251215 14:55:08.856458 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 35ade4502ed7497a82b362d38c65244a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35ade4502ed7497a82b362d38c65244a already in progress: creating tablet
W20251215 14:55:08.856631 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 96b2d20fd2304e7a9995206a043b7944 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96b2d20fd2304e7a9995206a043b7944 already in progress: creating tablet
W20251215 14:55:08.856814 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 already in progress: creating tablet
W20251215 14:55:08.856985 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 78b3f18a62d544b38a0682bf3bc00977 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78b3f18a62d544b38a0682bf3bc00977 already in progress: creating tablet
W20251215 14:55:08.857182 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet c8af1d0b67424bec90b59863a975254e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8af1d0b67424bec90b59863a975254e already in progress: creating tablet
W20251215 14:55:08.857331 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet d4cff0ed3782446397dbae8a2da52ed7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4cff0ed3782446397dbae8a2da52ed7 already in progress: creating tablet
W20251215 14:55:08.857522 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 5560a21e16bb43c7903c1fc66429ecdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5560a21e16bb43c7903c1fc66429ecdf already in progress: creating tablet
W20251215 14:55:08.857748 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 88206b17f94242378a35d5314611ac1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88206b17f94242378a35d5314611ac1a already in progress: creating tablet
I20251215 14:55:08.852797 9953 leader_election.cc:290] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:08.859282 10033 raft_consensus.cc:515] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.860455 9947 ts_tablet_manager.cc:1929] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:08.860497 10033 leader_election.cc:290] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:08.860575 9947 log.cc:1199] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/d922d7b24dbd474cbee47c72f2779a07
I20251215 14:55:08.860976 9947 ts_tablet_manager.cc:1950] T d922d7b24dbd474cbee47c72f2779a07 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:08.861974 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet d922d7b24dbd474cbee47c72f2779a07 (table default.Table_5d032dd330df4c33aa8ef50ce62c8d08 [id=977e2ac089d545278d13e59908bad89e]) successfully deleted
I20251215 14:55:08.862275 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfead52afe8040a88ba0d826f482b1bd" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:08.862455 9313 raft_consensus.cc:3060] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.865069 9313 raft_consensus.cc:2468] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:08.865598 8978 leader_election.cc:304] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:08.865851 10021 raft_consensus.cc:2804] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:08.866003 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfead52afe8040a88ba0d826f482b1bd" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:08.866106 10021 raft_consensus.cc:697] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:08.866384 10021 consensus_queue.cc:237] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:08.866511 8976 leader_election.cc:343] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:08.875125 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 95583eee8a5041b1ade97e8f8f0db271
W20251215 14:55:08.875308 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 9425749d471f4f95bbae030977e278e4
I20251215 14:55:08.872213 9435 tablet_bootstrap.cc:492] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:08.876762 9944 ts_tablet_manager.cc:1929] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:08.876904 9944 log.cc:1199] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/b9b39c879d444172871f43349978dc86
I20251215 14:55:08.877293 9944 ts_tablet_manager.cc:1950] T b9b39c879d444172871f43349978dc86 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:08.877626 9981 raft_consensus.cc:493] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:08.877761 9981 raft_consensus.cc:515] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.878358 9981 leader_election.cc:290] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:08.882627 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f03dfdd546c492185c6c31866a090a5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:08.883229 9112 leader_election.cc:343] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:08.883507 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f03dfdd546c492185c6c31866a090a5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:08.883709 9313 raft_consensus.cc:2468] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:08.884199 9115 leader_election.cc:304] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:08.884600 10019 raft_consensus.cc:2804] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:08.884712 10019 raft_consensus.cc:493] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:08.884799 10019 raft_consensus.cc:3060] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.887909 10019 raft_consensus.cc:515] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.888554 10019 leader_election.cc:290] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:08.888655 9426 tablet_bootstrap.cc:492] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:08.888918 9426 ts_tablet_manager.cc:1403] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.113s user 0.008s sys 0.024s
I20251215 14:55:08.889219 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f03dfdd546c492185c6c31866a090a5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:08.889416 9313 raft_consensus.cc:3060] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.889408 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f03dfdd546c492185c6c31866a090a5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
W20251215 14:55:08.890426 9112 leader_election.cc:343] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:08.890544 9426 raft_consensus.cc:359] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.890980 9426 raft_consensus.cc:385] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:08.891140 9426 raft_consensus.cc:740] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:08.891621 9426 consensus_queue.cc:260] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.892208 9313 raft_consensus.cc:2468] T 5f03dfdd546c492185c6c31866a090a5 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:08.892766 9115 leader_election.cc:304] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:08.893335 10019 raft_consensus.cc:2804] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:08.893472 10019 raft_consensus.cc:697] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:08.893734 10019 consensus_queue.cc:237] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.897032 9426 ts_tablet_manager.cc:1434] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20251215 14:55:08.902694 9426 tablet_bootstrap.cc:492] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:08.904086 9435 tablet_bootstrap.cc:654] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:08.905131 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 92e21a77ad074572a57b836743903a0b
W20251215 14:55:08.905253 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 11a5a6a0895c49648c910fa2ea3ca373
W20251215 14:55:08.906072 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 062a482917794ae5a67ec685a2491ba2
W20251215 14:55:08.906204 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 26876cdffd7e4664bc8f7efb74885776
W20251215 14:55:08.906759 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet f9411030d08d40aabbdee6670ba95821
W20251215 14:55:08.906886 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 1141b9a4cf3e4aa78529bed7f0375ff8
W20251215 14:55:08.907662 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet ff4508c5a110427eb4d9d2eaaadace0b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff4508c5a110427eb4d9d2eaaadace0b already in progress: creating tablet
I20251215 14:55:08.909097 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet b9b39c879d444172871f43349978dc86 (table default.Table_7f03fe8b4ecc4ef8acb06faf55cfbf8b [id=472c67fefad54383b4ebac7e3c77d325]) successfully deleted
W20251215 14:55:08.909366 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 38e50a7f2bdd4907ab41436b59397ea6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38e50a7f2bdd4907ab41436b59397ea6 already in progress: creating tablet
I20251215 14:55:08.915879 9426 tablet_bootstrap.cc:654] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:08.918793 8788 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.8.121.129:34405 (request call id 140) took 1768 ms (client timeout 1000 ms). Trace:
I20251215 14:55:08.921762 9427 tablet_bootstrap.cc:492] T 188eb879e7c3479ea71c5b1864400243 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:08.924983 9507 raft_consensus.cc:493] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:08.925145 9507 raft_consensus.cc:515] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.925768 9507 leader_election.cc:290] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:08.926559 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16309efc14e747d09ce6e5de4f3c2784" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:08.926796 9034 raft_consensus.cc:2468] T 16309efc14e747d09ce6e5de4f3c2784 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:08.927129 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16309efc14e747d09ce6e5de4f3c2784" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:08.927346 9313 raft_consensus.cc:2468] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:08.927937 9115 leader_election.cc:304] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:08.928241 9507 raft_consensus.cc:2804] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:08.928352 9507 raft_consensus.cc:493] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:08.928433 9507 raft_consensus.cc:3060] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.922886 9427 ts_tablet_manager.cc:1403] T 188eb879e7c3479ea71c5b1864400243 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.148s user 0.005s sys 0.000s
W20251215 14:55:08.918956 8788 rpcz_store.cc:269] 1215 14:55:07.137298 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:07.203678 (+ 66380us) service_pool.cc:225] Handling call
1215 14:55:08.905902 (+1702224us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:07.333343 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1215 14:55:07.333422 (+ 79us) write_op.cc:432] Acquiring schema lock in shared mode
1215 14:55:07.333426 (+ 4us) write_op.cc:435] Acquired schema lock
1215 14:55:07.333428 (+ 2us) tablet.cc:660] Decoding operations
1215 14:55:07.333538 (+ 110us) write_op.cc:620] Acquiring the partition lock for write op
1215 14:55:07.333545 (+ 7us) write_op.cc:641] Partition lock acquired for write op
1215 14:55:07.333549 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
1215 14:55:07.333660 (+ 111us) tablet.cc:699] Row locks acquired
1215 14:55:07.333662 (+ 2us) write_op.cc:260] PREPARE: finished
1215 14:55:07.333687 (+ 25us) write_op.cc:270] Start()
1215 14:55:07.333707 (+ 20us) write_op.cc:276] Timestamp: P: 1765810507333596 usec, L: 0
1215 14:55:07.333710 (+ 3us) op_driver.cc:348] REPLICATION: starting
1215 14:55:07.333827 (+ 117us) log.cc:844] Serialized 913 byte log entry
1215 14:55:07.344991 (+ 11164us) op_driver.cc:464] REPLICATION: finished
1215 14:55:07.345693 (+ 702us) write_op.cc:301] APPLY: starting
1215 14:55:07.345704 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
1215 14:55:07.345737 (+ 33us) tablet.cc:1368] finished BulkCheckPresence
1215 14:55:07.345773 (+ 36us) tablet.cc:1370] starting ApplyRowOperation cycle
1215 14:55:07.345828 (+ 55us) tablet.cc:1381] finished ApplyRowOperation cycle
1215 14:55:07.345854 (+ 26us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
1215 14:55:07.345861 (+ 7us) write_op.cc:312] APPLY: finished
1215 14:55:07.345912 (+ 51us) log.cc:844] Serialized 29 byte log entry
1215 14:55:07.345959 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
1215 14:55:07.345974 (+ 15us) write_op.cc:454] Released schema lock
1215 14:55:07.345979 (+ 5us) write_op.cc:341] FINISH: Updating metrics
1215 14:55:07.346036 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
1215 14:55:07.346040 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2368,"reported_tablets":98,"child_traces":[["op",{"apply.queue_time_us":670,"apply.run_cpu_time_us":337,"apply.run_wall_time_us":336,"num_ops":2,"prepare.queue_time_us":528,"prepare.run_cpu_time_us":527,"prepare.run_wall_time_us":526,"replication_time_us":11265}]]}
I20251215 14:55:08.931538 9507 raft_consensus.cc:515] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.932025 9427 raft_consensus.cc:359] T 188eb879e7c3479ea71c5b1864400243 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.932250 9427 raft_consensus.cc:385] T 188eb879e7c3479ea71c5b1864400243 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:08.932323 9427 raft_consensus.cc:740] T 188eb879e7c3479ea71c5b1864400243 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:08.933156 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16309efc14e747d09ce6e5de4f3c2784" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:08.933348 9034 raft_consensus.cc:3060] T 16309efc14e747d09ce6e5de4f3c2784 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.933465 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_cec087c50d3147c1a275c74922342970"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:08.933827 9507 leader_election.cc:290] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:08.934059 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cec087c50d3147c1a275c74922342970 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:08.935243 9427 consensus_queue.cc:260] T 188eb879e7c3479ea71c5b1864400243 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.936141 9034 raft_consensus.cc:2468] T 16309efc14e747d09ce6e5de4f3c2784 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:08.936192 9427 ts_tablet_manager.cc:1434] T 188eb879e7c3479ea71c5b1864400243 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20251215 14:55:08.936472 9427 tablet_bootstrap.cc:492] T 5f03dfdd546c492185c6c31866a090a5 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:08.936539 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16309efc14e747d09ce6e5de4f3c2784" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:08.936738 9313 raft_consensus.cc:3060] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:08.938112 9427 tablet_bootstrap.cc:654] T 5f03dfdd546c492185c6c31866a090a5 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:08.938948 8780 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_6bd7eee6a17d43f4baf1db824203acab" } new_table_name: "default.Table_d92a50e24ad64b9496b0cb3ca5d0dd9a" modify_external_catalogs: true
I20251215 14:55:08.940387 9112 leader_election.cc:304] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:08.940685 9507 raft_consensus.cc:2804] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:08.941048 9313 raft_consensus.cc:2468] T 16309efc14e747d09ce6e5de4f3c2784 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:08.941244 9507 raft_consensus.cc:697] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:08.941596 9507 consensus_queue.cc:237] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.944001 8783 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 87c2841acf504dc9aaddba0862df835a
I20251215 14:55:08.944356 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_8fe903d6d8e74a54acb4eaf2bc1cbbda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:08.944958 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8fe903d6d8e74a54acb4eaf2bc1cbbda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:08.945304 9435 tablet_bootstrap.cc:492] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:08.945452 9435 ts_tablet_manager.cc:1403] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.073s user 0.011s sys 0.001s
I20251215 14:55:08.946841 8783 master_service.cc:954] ReplaceTablet: received request to replace tablet bdfc164128a6413a83d83d05b69fb74a from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:08.947011 9435 raft_consensus.cc:359] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.947228 9435 raft_consensus.cc:385] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:08.947292 9435 raft_consensus.cc:740] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:08.947268 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_96cdb82e10874b08bd807d3d485cf7bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:08.947546 9435 consensus_queue.cc:260] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:08.948549 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96cdb82e10874b08bd807d3d485cf7bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:08.949470 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_909b1c1b27904f0d952dc5ed285f1383"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:08.950007 9435 ts_tablet_manager.cc:1434] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:08.950290 9435 tablet_bootstrap.cc:492] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:08.953791 9507 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:08.953998 9435 tablet_bootstrap.cc:654] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:08.954030 9507 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:08.954479 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_909b1c1b27904f0d952dc5ed285f1383 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:08.955376 8779 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet e2104a3530264fa982b20aed20afb0b4 (table default.Table_6bd7eee6a17d43f4baf1db824203acab [id=d916193804f94519b84d259c0420e1a1]). Expected version 1 got 0
W20251215 14:55:08.955476 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:08.955668 8779 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet c00aecc23c6541cbae4abd7cb1b3077b (table default.Table_b527fedbc2c14bb3861289fe2b27fd43 [id=640d70bd78554e92823dc104e06227d3]). Expected version 3 got 0
I20251215 14:55:08.955875 9507 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:08.956480 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:08.956597 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:08.957270 9507 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:08.958992 9426 tablet_bootstrap.cc:492] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:08.959125 9426 ts_tablet_manager.cc:1403] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.057s user 0.007s sys 0.001s
I20251215 14:55:08.959887 9426 raft_consensus.cc:359] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.960108 9426 raft_consensus.cc:385] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:08.960186 8784 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 0a597fd6c7c044228ffb2a5a5f924e70
I20251215 14:55:08.960222 9426 raft_consensus.cc:740] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:08.960515 9426 consensus_queue.cc:260] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.960655 8784 catalog_manager.cc:6724] ReplaceTablet: tablet 0a597fd6c7c044228ffb2a5a5f924e70 deleted and replaced by tablet 022c9c0d19ac450cb270319004886fe2
I20251215 14:55:08.961002 8784 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_599d7b1173e24bda8ca827394b97ada0" } new_table_name: "default.Table_1575d3d624744c93a3dc41685842aca0" modify_external_catalogs: true
I20251215 14:55:08.961090 9426 ts_tablet_manager.cc:1434] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:08.962466 8785 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_b83bf47931314e5b82bb09f7d6cd2ec8" } modify_external_catalogs: true
I20251215 14:55:08.962601 8785 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_b83bf47931314e5b82bb09f7d6cd2ec8" } modify_external_catalogs: true
I20251215 14:55:08.964145 9003 tablet_service.cc:1552] Processing DeleteTablet for tablet 0a597fd6c7c044228ffb2a5a5f924e70 with delete_type TABLET_DATA_DELETED (replaced by tablet 022c9c0d19ac450cb270319004886fe2) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:08.964421 9947 tablet_replica.cc:333] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:08.964608 9947 raft_consensus.cc:2243] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:08.964821 9947 raft_consensus.cc:2272] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:08.965197 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet 0a597fd6c7c044228ffb2a5a5f924e70 with delete_type TABLET_DATA_DELETED (replaced by tablet 022c9c0d19ac450cb270319004886fe2) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:08.965530 9426 tablet_bootstrap.cc:492] T 96b2d20fd2304e7a9995206a043b7944 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:08.965710 9947 ts_tablet_manager.cc:1916] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:08.967100 9426 tablet_bootstrap.cc:654] T 96b2d20fd2304e7a9995206a043b7944 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:08.968088 9151 tablet_service.cc:1552] Processing DeleteTablet for tablet 0a597fd6c7c044228ffb2a5a5f924e70 with delete_type TABLET_DATA_DELETED (replaced by tablet 022c9c0d19ac450cb270319004886fe2) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:08.968303 9943 tablet_replica.cc:333] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:08.968488 9943 raft_consensus.cc:2243] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 LEADER]: Raft consensus shutting down.
I20251215 14:55:08.968782 9943 raft_consensus.cc:2272] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:08.969915 9943 ts_tablet_manager.cc:1916] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:08.971316 9944 tablet_replica.cc:333] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:08.971534 9944 raft_consensus.cc:2243] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:08.971742 9944 raft_consensus.cc:2272] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:08.972798 9944 ts_tablet_manager.cc:1916] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:08.976509 9435 tablet_bootstrap.cc:492] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:08.976686 9435 ts_tablet_manager.cc:1403] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20251215 14:55:08.977454 9435 raft_consensus.cc:359] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.977700 9435 raft_consensus.cc:385] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:08.977803 9435 raft_consensus.cc:740] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:08.978060 9435 consensus_queue.cc:260] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:08.978564 9435 ts_tablet_manager.cc:1434] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:08.978886 9435 tablet_bootstrap.cc:492] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:08.980190 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet bb3b95d32c7044bd8a4451381c19aeba (table default.Table_7cbbdace45d641d4a9c5b95389d76554 [id=7ec65d77d89d4e40a60b716f721e2940]). Expected version 4 got 0
I20251215 14:55:08.980428 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 77780f8cfe544db7baee2c761fe52ca2 (table default.Table_5ed1858b15504f70a200762ea0f213f1 [id=f2428abb656749d0907096c2df05ef64]). Expected version 1 got 0
I20251215 14:55:08.980612 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_3f190fdaff1446908955f4b5957a8084 [id=cbafb4499c90447d8f185928d3e58b20]). Expected version 1 got 0
I20251215 14:55:08.981421 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet e2104a3530264fa982b20aed20afb0b4 (table default.Table_6bd7eee6a17d43f4baf1db824203acab [id=d916193804f94519b84d259c0420e1a1]). Expected version 1 got 0
I20251215 14:55:08.982322 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet f121a14828e6443695960c0e540ae573 (table default.Table_159b0c9ea29840df94432fbee21770fd [id=0e3677e1f3d048ecad508d50304ee56a]). Expected version 2 got 0
I20251215 14:55:08.982604 9944 ts_tablet_manager.cc:1929] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20251215 14:55:08.982738 9944 log.cc:1199] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/0a597fd6c7c044228ffb2a5a5f924e70
I20251215 14:55:08.984184 9435 tablet_bootstrap.cc:654] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:08.983755 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1]). Expected version 1 got 0
I20251215 14:55:08.986371 9947 ts_tablet_manager.cc:1929] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20251215 14:55:08.986503 9947 log.cc:1199] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/0a597fd6c7c044228ffb2a5a5f924e70
I20251215 14:55:08.986900 9947 ts_tablet_manager.cc:1950] T 0a597fd6c7c044228ffb2a5a5f924e70 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:08.986699 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_93ee270c113a4a51ab4e5fe5f80117b0 [id=fa027087d00d452daa95b171d95c5a82]). Expected version 2 got 0
I20251215 14:55:08.988634 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 0a597fd6c7c044228ffb2a5a5f924e70 (table default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f]) successfully deleted
I20251215 14:55:08.991554 8788 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c96b5d2bf6ac4d3fa984f8047f2f6d30" } modify_external_catalogs: true
I20251215 14:55:08.991739 8788 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c96b5d2bf6ac4d3fa984f8047f2f6d30" } modify_external_catalogs: true
I20251215 14:55:08.995204 8783 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_942e1382bd0c457b88e70fd2cbb19872" } new_table_name: "default.Table_3a3de1a36ece4604ba7c47a47664499a" modify_external_catalogs: true
I20251215 14:55:08.987859 9944 ts_tablet_manager.cc:1950] T 0a597fd6c7c044228ffb2a5a5f924e70 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:08.999336 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 0a597fd6c7c044228ffb2a5a5f924e70 (table default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f]) successfully deleted
I20251215 14:55:09.001267 8786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d582b0f606d1487287ac187149a256c1" } modify_external_catalogs: true
I20251215 14:55:09.001510 8786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d582b0f606d1487287ac187149a256c1" } modify_external_catalogs: true
I20251215 14:55:09.001691 9426 tablet_bootstrap.cc:492] T 96b2d20fd2304e7a9995206a043b7944 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:09.001865 9426 ts_tablet_manager.cc:1403] T 96b2d20fd2304e7a9995206a043b7944 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.036s user 0.010s sys 0.001s
I20251215 14:55:09.002646 9426 raft_consensus.cc:359] T 96b2d20fd2304e7a9995206a043b7944 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.002923 9426 raft_consensus.cc:385] T 96b2d20fd2304e7a9995206a043b7944 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.003028 9426 raft_consensus.cc:740] T 96b2d20fd2304e7a9995206a043b7944 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
W20251215 14:55:09.003199 8784 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a93d01ea31a64dc2a8d8b03884675024 has no consensus state
I20251215 14:55:09.003391 9426 consensus_queue.cc:260] T 96b2d20fd2304e7a9995206a043b7944 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.003599 8784 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_5b54d0c2c0154c2792f194721a32c6e6" } new_table_name: "default.Table_2b599310beac4f1baef868099196f8ac" modify_external_catalogs: true
I20251215 14:55:09.006004 9426 ts_tablet_manager.cc:1434] T 96b2d20fd2304e7a9995206a043b7944 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:09.006367 9426 tablet_bootstrap.cc:492] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:09.008154 9426 tablet_bootstrap.cc:654] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.009013 9435 tablet_bootstrap.cc:492] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:09.009187 9435 ts_tablet_manager.cc:1403] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.000s
I20251215 14:55:09.008692 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 (table default.Table_0593d9b93de9400ba29718af1b328262 [id=50a94314f5ba46e3a75b5a15e7362299]). Expected version 1 got 0
I20251215 14:55:09.009904 9435 raft_consensus.cc:359] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.010087 9435 raft_consensus.cc:385] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.010149 9435 raft_consensus.cc:740] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.010529 9435 consensus_queue.cc:260] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.011219 9435 ts_tablet_manager.cc:1434] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:09.011603 9435 tablet_bootstrap.cc:492] T 38e50a7f2bdd4907ab41436b59397ea6 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:09.015612 9435 tablet_bootstrap.cc:654] T 38e50a7f2bdd4907ab41436b59397ea6 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:09.015749 8775 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet f121a14828e6443695960c0e540ae573 (table default.Table_159b0c9ea29840df94432fbee21770fd [id=0e3677e1f3d048ecad508d50304ee56a], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet f121a14828e6443695960c0e540ae573 consensus state has no leader
I20251215 14:55:09.017189 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 5dd36ea0aa53460f9c1fda4b31063fa7 (table default.Table_04a63cbcd13a48149362dc372ce3cd76 [id=6dd2c68a85f648e1b4c51e691c1eb632]). Expected version 1 got 0
I20251215 14:55:09.018050 8785 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 21a98ce868924690b8a5715f4103c360
I20251215 14:55:09.019369 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet 21a98ce868924690b8a5715f4103c360 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.019876 9151 tablet_service.cc:1552] Processing DeleteTablet for tablet 21a98ce868924690b8a5715f4103c360 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:09.020080 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 21a98ce868924690b8a5715f4103c360 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21a98ce868924690b8a5715f4103c360 already in progress: creating tablet
I20251215 14:55:09.020948 9003 tablet_service.cc:1552] Processing DeleteTablet for tablet 21a98ce868924690b8a5715f4103c360 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:09.022619 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 21a98ce868924690b8a5715f4103c360 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21a98ce868924690b8a5715f4103c360 already in progress: creating tablet
I20251215 14:55:09.023753 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 5dc81eb40614463cb5017475b378eea6 (table default.Table_76a8f78ec8a74aadaf69142df6990dc8 [id=94ddd629cb1e4f5eb0061100187f4202]). Expected version 1 got 0
I20251215 14:55:09.025271 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet ae8a49b9a3bf4845943b1ad8e318ccbb (table default.Table_99268441afd84c5fbfbd1080deabb144 [id=02a2b4848c874afe8f9860eee9bc6ce7]). Expected version 2 got 0
I20251215 14:55:09.030084 9943 ts_tablet_manager.cc:1929] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20251215 14:55:09.030426 9426 tablet_bootstrap.cc:492] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:09.030634 9426 ts_tablet_manager.cc:1403] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.000s
I20251215 14:55:09.030457 9943 log.cc:1199] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/0a597fd6c7c044228ffb2a5a5f924e70
W20251215 14:55:09.032883 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:09.033066 9426 raft_consensus.cc:359] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.033268 9426 raft_consensus.cc:385] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.033373 9426 raft_consensus.cc:740] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.033617 9426 consensus_queue.cc:260] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.034119 9426 ts_tablet_manager.cc:1434] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20251215 14:55:09.034329 8788 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 710cea1c9f6d49828515b806db320cb0
I20251215 14:55:09.034415 9426 tablet_bootstrap.cc:492] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:09.035362 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 3cdfcddd91fe47de8fd14dc718f421a6 (table default.Table_aba7a90daaf544eb972bd7349f27ae63 [id=2bd880b71b174f528054fbc22143c01f]). Expected version 3 got 0
I20251215 14:55:09.036120 9426 tablet_bootstrap.cc:654] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.036720 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet a639396098a941249afd9c3560073131 (table default.Table_404807c380fa4483ac5e0545eb3028cd [id=5cc820ec2c8b427db1c89647b295363e]). Expected version 1 got 0
I20251215 14:55:09.040642 9427 tablet_bootstrap.cc:492] T 5f03dfdd546c492185c6c31866a090a5 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:09.040685 8788 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_b7c3ac62986d4570822a7b1930ee841f" } new_table_name: "default.Table_cac9287494284dd6b1f7ce317d633368" modify_external_catalogs: true
I20251215 14:55:09.040880 9427 ts_tablet_manager.cc:1403] T 5f03dfdd546c492185c6c31866a090a5 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.104s user 0.005s sys 0.006s
I20251215 14:55:09.041783 9427 raft_consensus.cc:359] T 5f03dfdd546c492185c6c31866a090a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.042009 9427 raft_consensus.cc:385] T 5f03dfdd546c492185c6c31866a090a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.042127 9427 raft_consensus.cc:740] T 5f03dfdd546c492185c6c31866a090a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.042433 9427 consensus_queue.cc:260] T 5f03dfdd546c492185c6c31866a090a5 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.039333 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 7f38c44dbc884d74a61c7ed98deaf6aa (table default.Table_74cef17050464ec6968b0d9dce366720 [id=bec2dd63f0aa4a05961adb6a70fbfd94]). Expected version 1 got 0
I20251215 14:55:09.045154 9427 ts_tablet_manager.cc:1434] T 5f03dfdd546c492185c6c31866a090a5 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:09.045514 9427 tablet_bootstrap.cc:492] T 194bb745ecb849cb9092fee1afb7dbe6 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:09.046139 8783 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1cb23f66c1b94751a9557e8b426dd434 has no consensus state
I20251215 14:55:09.046729 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet c00aecc23c6541cbae4abd7cb1b3077b (table default.Table_b527fedbc2c14bb3861289fe2b27fd43 [id=640d70bd78554e92823dc104e06227d3]). Expected version 3 got 0
I20251215 14:55:09.047188 9427 tablet_bootstrap.cc:654] T 194bb745ecb849cb9092fee1afb7dbe6 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.047979 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781]). Expected version 2 got 0
I20251215 14:55:09.049070 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 4c96b655cf284326ae3fa2a165e2bf95 (table default.Table_99ea47285b994715a5fae3cfb669d229 [id=b7ff2d02e55b4e839049b20b89227526]). Expected version 1 got 0
I20251215 14:55:09.049152 9943 ts_tablet_manager.cc:1950] T 0a597fd6c7c044228ffb2a5a5f924e70 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:09.049794 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_73b7bfe544f34dd7b685ab9819f4a52b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.050364 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73b7bfe544f34dd7b685ab9819f4a52b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.050719 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d [id=066e8ae14004436cb8b4f3f740b45b19]). Expected version 3 got 0
I20251215 14:55:09.054219 8781 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_99268441afd84c5fbfbd1080deabb144 [id=02a2b4848c874afe8f9860eee9bc6ce7] alter complete (version 2)
I20251215 14:55:09.056268 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c2efd3f029df4f7c9a74f6201cacf057"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.056799 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2efd3f029df4f7c9a74f6201cacf057 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:09.061899 8784 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a71d029bbd88416da1dbcad09dc93115 has no consensus state
I20251215 14:55:09.063994 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet accc3fdaf8e64b0f96b45150a59516bf
I20251215 14:55:09.065222 9151 tablet_service.cc:1552] Processing DeleteTablet for tablet accc3fdaf8e64b0f96b45150a59516bf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:09.066383 8780 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e2104a3530264fa982b20aed20afb0b4 consensus state has no leader
I20251215 14:55:09.067626 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet accc3fdaf8e64b0f96b45150a59516bf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.068353 8779 master_service.cc:954] ReplaceTablet: received request to replace tablet 18cd1f63d51e4565bb8c55be13e3e099 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:09.068707 9003 tablet_service.cc:1552] Processing DeleteTablet for tablet accc3fdaf8e64b0f96b45150a59516bf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:09.070657 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet accc3fdaf8e64b0f96b45150a59516bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet accc3fdaf8e64b0f96b45150a59516bf already in progress: creating tablet
I20251215 14:55:09.071964 9426 tablet_bootstrap.cc:492] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:09.072134 9426 ts_tablet_manager.cc:1403] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.005s
I20251215 14:55:09.073288 9426 raft_consensus.cc:359] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.073498 9426 raft_consensus.cc:385] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.073592 9426 raft_consensus.cc:740] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.073814 9426 consensus_queue.cc:260] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.074313 9426 ts_tablet_manager.cc:1434] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:09.074610 9426 tablet_bootstrap.cc:492] T f7af1f66c4f04f649379758ff1b3e387 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:09.076126 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_167f954113c245df9dbd333990b68e0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.076702 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_167f954113c245df9dbd333990b68e0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.078934 9426 tablet_bootstrap.cc:654] T f7af1f66c4f04f649379758ff1b3e387 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:09.081157 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet accc3fdaf8e64b0f96b45150a59516bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet accc3fdaf8e64b0f96b45150a59516bf already in progress: creating tablet
W20251215 14:55:09.082584 8780 catalog_manager.cc:5487] Ignoring report from unknown tablet 5f03dfdd546c492185c6c31866a090a5
W20251215 14:55:09.083328 8780 catalog_manager.cc:5487] Ignoring report from unknown tablet 16309efc14e747d09ce6e5de4f3c2784
I20251215 14:55:09.088199 8787 master_service.cc:954] ReplaceTablet: received request to replace tablet a0a74645593d46fcbc0235ec6a4670d8 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:09.092444 8787 master_service.cc:954] ReplaceTablet: received request to replace tablet 32432afc6e8d458bb7ed7abc42fb3dde from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:09.094765 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 0a597fd6c7c044228ffb2a5a5f924e70 (table default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f]) successfully deleted
W20251215 14:55:09.095271 8788 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 10cd2cbd7956444cb125d97310d2b102 has no consensus state
I20251215 14:55:09.101421 9427 tablet_bootstrap.cc:492] T 194bb745ecb849cb9092fee1afb7dbe6 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:09.101671 9427 ts_tablet_manager.cc:1403] T 194bb745ecb849cb9092fee1afb7dbe6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.056s user 0.001s sys 0.005s
W20251215 14:55:09.102782 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 21a98ce868924690b8a5715f4103c360 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21a98ce868924690b8a5715f4103c360 already in progress: creating tablet
I20251215 14:55:09.103432 9427 raft_consensus.cc:359] T 194bb745ecb849cb9092fee1afb7dbe6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.103658 9427 raft_consensus.cc:385] T 194bb745ecb849cb9092fee1afb7dbe6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.103770 9427 raft_consensus.cc:740] T 194bb745ecb849cb9092fee1afb7dbe6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.104031 9427 consensus_queue.cc:260] T 194bb745ecb849cb9092fee1afb7dbe6 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.104709 9427 ts_tablet_manager.cc:1434] T 194bb745ecb849cb9092fee1afb7dbe6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:09.105036 9427 tablet_bootstrap.cc:492] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:09.106905 9427 tablet_bootstrap.cc:654] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.107899 9435 tablet_bootstrap.cc:492] T 38e50a7f2bdd4907ab41436b59397ea6 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:09.108049 9435 ts_tablet_manager.cc:1403] T 38e50a7f2bdd4907ab41436b59397ea6 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.097s user 0.010s sys 0.006s
I20251215 14:55:09.108803 9435 raft_consensus.cc:359] T 38e50a7f2bdd4907ab41436b59397ea6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.108959 9435 raft_consensus.cc:385] T 38e50a7f2bdd4907ab41436b59397ea6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.109030 9435 raft_consensus.cc:740] T 38e50a7f2bdd4907ab41436b59397ea6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.109232 9435 consensus_queue.cc:260] T 38e50a7f2bdd4907ab41436b59397ea6 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:09.109591 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet accc3fdaf8e64b0f96b45150a59516bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet accc3fdaf8e64b0f96b45150a59516bf already in progress: creating tablet
I20251215 14:55:09.111663 9435 ts_tablet_manager.cc:1434] T 38e50a7f2bdd4907ab41436b59397ea6 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:09.111954 9435 tablet_bootstrap.cc:492] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:09.113510 9435 tablet_bootstrap.cc:654] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.124012 9435 tablet_bootstrap.cc:492] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:09.124191 9435 ts_tablet_manager.cc:1403] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
I20251215 14:55:09.124866 9435 raft_consensus.cc:359] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.125041 9435 raft_consensus.cc:385] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.125105 9435 raft_consensus.cc:740] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.125304 9435 consensus_queue.cc:260] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.126169 9435 ts_tablet_manager.cc:1434] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:09.126497 9435 tablet_bootstrap.cc:492] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:09.128165 9435 tablet_bootstrap.cc:654] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.130728 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ce491c1e2a09492cbfe26725b319b74e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.131470 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce491c1e2a09492cbfe26725b319b74e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.132330 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_e11c28b153a64c73acb0610cea4c60dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.132952 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e11c28b153a64c73acb0610cea4c60dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.134407 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c0657e638f4347278be5c502e7972828"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.134958 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0657e638f4347278be5c502e7972828 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.146495 8779 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_909b1c1b27904f0d952dc5ed285f1383" } modify_external_catalogs: true
I20251215 14:55:09.146713 8779 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_909b1c1b27904f0d952dc5ed285f1383" } modify_external_catalogs: true
I20251215 14:55:09.147866 10077 tablet.cc:1722] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251215 14:55:09.150039 8786 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 56816add0a61454c9980ad09f5815b09
I20251215 14:55:09.151084 9427 tablet_bootstrap.cc:492] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:09.151296 9427 ts_tablet_manager.cc:1403] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.002s
I20251215 14:55:09.152333 9427 raft_consensus.cc:359] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.152592 9427 raft_consensus.cc:385] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.152666 9427 raft_consensus.cc:740] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.152945 9427 consensus_queue.cc:260] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.153604 9427 ts_tablet_manager.cc:1434] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:09.153928 9427 tablet_bootstrap.cc:492] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:09.155932 9427 tablet_bootstrap.cc:654] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.160490 9151 tablet_service.cc:1552] Processing DeleteTablet for tablet 56816add0a61454c9980ad09f5815b09 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:09.160645 9435 tablet_bootstrap.cc:492] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:09.160780 9435 ts_tablet_manager.cc:1403] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.034s user 0.000s sys 0.004s
I20251215 14:55:09.161577 9435 raft_consensus.cc:359] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.161684 9003 tablet_service.cc:1552] Processing DeleteTablet for tablet 56816add0a61454c9980ad09f5815b09 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.161796 9435 raft_consensus.cc:385] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.161891 9435 raft_consensus.cc:740] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.162142 9435 consensus_queue.cc:260] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.162735 9435 ts_tablet_manager.cc:1434] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:09.163022 9435 tablet_bootstrap.cc:492] T e2104a3530264fa982b20aed20afb0b4 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:09.164644 9435 tablet_bootstrap.cc:654] T e2104a3530264fa982b20aed20afb0b4 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.164811 10104 tablet.cc:1722] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20251215 14:55:09.167670 8773 catalog_manager.cc:5058] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): alter failed for tablet 0a597fd6c7c044228ffb2a5a5f924e70 (table default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f]),no further retry: Not found: Tablet not found: 0a597fd6c7c044228ffb2a5a5f924e70
I20251215 14:55:09.168579 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_e14188f87ed340c8b0eea119157a8a42"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.169212 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e14188f87ed340c8b0eea119157a8a42 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.171070 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet 56816add0a61454c9980ad09f5815b09 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:09.171972 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 56816add0a61454c9980ad09f5815b09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56816add0a61454c9980ad09f5815b09 already in progress: creating tablet
W20251215 14:55:09.173281 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 56816add0a61454c9980ad09f5815b09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56816add0a61454c9980ad09f5815b09 already in progress: creating tablet
I20251215 14:55:09.175762 9008 tablet_service.cc:1552] Processing DeleteTablet for tablet 35ade4502ed7497a82b362d38c65244a with delete_type TABLET_DATA_DELETED (replaced by tablet d09d7ce93d074bfaa830130b31bcc594) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.176081 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet b9b39c879d444172871f43349978dc86 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.176283 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet 61aef86a30e842f2a90f9f1c88c84f4d with delete_type TABLET_DATA_DELETED (replaced by tablet ec3d52299b7945cdbedbc89be7f174c5) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.176483 9019 tablet_service.cc:1552] Processing DeleteTablet for tablet 5560a21e16bb43c7903c1fc66429ecdf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.176666 9005 tablet_service.cc:1552] Processing DeleteTablet for tablet 58926ab073974e2c8b725d5061a544d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.176875 9007 tablet_service.cc:1552] Processing DeleteTablet for tablet 38e50a7f2bdd4907ab41436b59397ea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.177058 9016 tablet_service.cc:1552] Processing DeleteTablet for tablet fc50995f6d934b58ab5f6f6f370cb7e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.177248 9014 tablet_service.cc:1552] Processing DeleteTablet for tablet d4cff0ed3782446397dbae8a2da52ed7 with delete_type TABLET_DATA_DELETED (replaced by tablet f9a0c31abcf046c9b76bea3f946ba9fc) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.177414 9009 tablet_service.cc:1552] Processing DeleteTablet for tablet 3c274c9002544af4947aa4ee76a705ce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.177577 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet 3af4f753a04b429a857e018f201ae6ed with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.177793 9017 tablet_service.cc:1552] Processing DeleteTablet for tablet 15b8a2a337e54321afd67f7562c412a0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:07 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.178005 9021 tablet_service.cc:1552] Processing DeleteTablet for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e317c8dc24e481abb709e932fa39c29) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.178246 9011 tablet_service.cc:1552] Processing DeleteTablet for tablet 88206b17f94242378a35d5314611ac1a with delete_type TABLET_DATA_DELETED (replaced by tablet 394844a49d254112883c40df9821c075) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.178423 9015 tablet_service.cc:1552] Processing DeleteTablet for tablet 3c6cfff573434fbcb18feaf6a8e6a153 with delete_type TABLET_DATA_DELETED (replaced by tablet ca2bba36b0f54aadb3980aa41dfd0eb0) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.178640 9020 tablet_service.cc:1552] Processing DeleteTablet for tablet 78b3f18a62d544b38a0682bf3bc00977 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.178918 9003 tablet_service.cc:1552] Processing DeleteTablet for tablet 96b2d20fd2304e7a9995206a043b7944 with delete_type TABLET_DATA_DELETED (replaced by tablet 6140a160980d49b09a5fda8475fc144f) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.181825 9970 consensus_queue.cc:1048] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:09.188526 8785 master_service.cc:954] ReplaceTablet: received request to replace tablet a0a74645593d46fcbc0235ec6a4670d8 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:09.188648 9435 tablet_bootstrap.cc:492] T e2104a3530264fa982b20aed20afb0b4 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:09.188809 9435 ts_tablet_manager.cc:1403] T e2104a3530264fa982b20aed20afb0b4 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20251215 14:55:09.189559 9435 raft_consensus.cc:359] T e2104a3530264fa982b20aed20afb0b4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.189823 9435 raft_consensus.cc:385] T e2104a3530264fa982b20aed20afb0b4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.189935 9435 raft_consensus.cc:740] T e2104a3530264fa982b20aed20afb0b4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.190202 9435 consensus_queue.cc:260] T e2104a3530264fa982b20aed20afb0b4 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.190743 9435 ts_tablet_manager.cc:1434] T e2104a3530264fa982b20aed20afb0b4 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:09.190680 10107 tablet.cc:1722] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251215 14:55:09.191078 9435 tablet_bootstrap.cc:492] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:09.191805 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 35ade4502ed7497a82b362d38c65244a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35ade4502ed7497a82b362d38c65244a already in progress: creating tablet
W20251215 14:55:09.192085 8772 catalog_manager.cc:4952] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet b9b39c879d444172871f43349978dc86 because the tablet was not found. No further retry: Not found: Tablet not found: b9b39c879d444172871f43349978dc86
W20251215 14:55:09.192245 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 61aef86a30e842f2a90f9f1c88c84f4d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 61aef86a30e842f2a90f9f1c88c84f4d already in progress: creating tablet
W20251215 14:55:09.192413 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 5560a21e16bb43c7903c1fc66429ecdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5560a21e16bb43c7903c1fc66429ecdf already in progress: creating tablet
W20251215 14:55:09.192550 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 58926ab073974e2c8b725d5061a544d5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58926ab073974e2c8b725d5061a544d5 already in progress: creating tablet
W20251215 14:55:09.192726 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 38e50a7f2bdd4907ab41436b59397ea6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 38e50a7f2bdd4907ab41436b59397ea6 already in progress: creating tablet
I20251215 14:55:09.192903 9435 tablet_bootstrap.cc:654] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:09.192894 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet fc50995f6d934b58ab5f6f6f370cb7e5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fc50995f6d934b58ab5f6f6f370cb7e5 already in progress: creating tablet
W20251215 14:55:09.193053 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet d4cff0ed3782446397dbae8a2da52ed7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d4cff0ed3782446397dbae8a2da52ed7 already in progress: creating tablet
W20251215 14:55:09.193192 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 3c274c9002544af4947aa4ee76a705ce because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c274c9002544af4947aa4ee76a705ce already in progress: creating tablet
W20251215 14:55:09.193338 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 3af4f753a04b429a857e018f201ae6ed because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3af4f753a04b429a857e018f201ae6ed already in progress: creating tablet
W20251215 14:55:09.193488 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 15b8a2a337e54321afd67f7562c412a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 15b8a2a337e54321afd67f7562c412a0 already in progress: creating tablet
W20251215 14:55:09.193643 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 already in progress: creating tablet
W20251215 14:55:09.193787 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 88206b17f94242378a35d5314611ac1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88206b17f94242378a35d5314611ac1a already in progress: creating tablet
W20251215 14:55:09.193951 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 3c6cfff573434fbcb18feaf6a8e6a153 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c6cfff573434fbcb18feaf6a8e6a153 already in progress: creating tablet
W20251215 14:55:09.194146 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 78b3f18a62d544b38a0682bf3bc00977 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 78b3f18a62d544b38a0682bf3bc00977 already in progress: creating tablet
W20251215 14:55:09.194331 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 96b2d20fd2304e7a9995206a043b7944 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96b2d20fd2304e7a9995206a043b7944 already in progress: creating tablet
I20251215 14:55:09.194722 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c42301ca90e643bdb1c34a89b930c3f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.195425 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c42301ca90e643bdb1c34a89b930c3f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.197752 8784 master_service.cc:954] ReplaceTablet: received request to replace tablet 38e50a7f2bdd4907ab41436b59397ea6 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:09.199280 9676 consensus_queue.cc:1048] T ce0154b24522401b9cc0e37fa502532f P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:09.199462 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_26adf52407f64ad28bfc32668a710cba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.201228 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_26adf52407f64ad28bfc32668a710cba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.205211 9970 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:09.205426 9970 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.206158 9970 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:09.207017 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8af1d0b67424bec90b59863a975254e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:09.207870 9249 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:09.208813 9248 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:55:09.208935 9248 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:09.209489 9970 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:09.211344 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 56816add0a61454c9980ad09f5815b09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56816add0a61454c9980ad09f5815b09 already in progress: creating tablet
I20251215 14:55:09.212252 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_8aa89f1547a54860886e482f1c87f816"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:09.213980 9435 tablet_bootstrap.cc:492] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:09.214190 9435 ts_tablet_manager.cc:1403] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.002s
I20251215 14:55:09.215035 9435 raft_consensus.cc:359] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.215312 9435 raft_consensus.cc:385] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.215447 9435 raft_consensus.cc:740] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.215737 9435 consensus_queue.cc:260] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.216420 9435 ts_tablet_manager.cc:1434] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251215 14:55:09.216747 9435 tablet_bootstrap.cc:492] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:09.217555 10021 raft_consensus.cc:493] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:09.217767 10021 raft_consensus.cc:515] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.218420 10021 leader_election.cc:290] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:09.219099 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2104a3530264fa982b20aed20afb0b4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:09.219344 9170 raft_consensus.cc:2468] T e2104a3530264fa982b20aed20afb0b4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:09.219719 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2104a3530264fa982b20aed20afb0b4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:09.219802 8976 leader_election.cc:304] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:09.219929 9313 raft_consensus.cc:2468] T e2104a3530264fa982b20aed20afb0b4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:09.220113 10021 raft_consensus.cc:2804] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:09.220198 10021 raft_consensus.cc:493] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:09.220310 10021 raft_consensus.cc:3060] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:09.227429 9435 tablet_bootstrap.cc:654] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.227743 10021 raft_consensus.cc:515] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.229408 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2104a3530264fa982b20aed20afb0b4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:09.229619 9170 raft_consensus.cc:3060] T e2104a3530264fa982b20aed20afb0b4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:09.232430 9170 raft_consensus.cc:2468] T e2104a3530264fa982b20aed20afb0b4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:09.232898 8976 leader_election.cc:304] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:09.233248 10033 raft_consensus.cc:2804] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:09.233390 10033 raft_consensus.cc:697] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:09.233682 10033 consensus_queue.cc:237] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.235400 9507 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:09.235572 9507 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.236145 9507 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:09.237668 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61aef86a30e842f2a90f9f1c88c84f4d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:09.237851 9314 raft_consensus.cc:2468] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:09.238353 9115 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:09.238737 9507 raft_consensus.cc:2804] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:09.238938 9507 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:09.239046 9507 raft_consensus.cc:3060] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:09.241941 9507 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.242959 9507 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:09.243717 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61aef86a30e842f2a90f9f1c88c84f4d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:09.243904 9314 raft_consensus.cc:3060] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:09.244500 9971 raft_consensus.cc:493] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:09.244639 9971 raft_consensus.cc:515] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.245200 9971 leader_election.cc:290] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:09.245810 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61aef86a30e842f2a90f9f1c88c84f4d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:09.246304 9112 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:09.246726 9314 raft_consensus.cc:2468] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:09.247407 9115 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:09.247875 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61aef86a30e842f2a90f9f1c88c84f4d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
W20251215 14:55:09.248598 9112 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:09.249452 9745 rpcz_store.cc:267] Call kudu.server.GenericService.CheckLeaks from 127.0.0.1:33822 (request call id 0) took 776 ms (client timeout 1000 ms). Trace:
W20251215 14:55:09.249567 9745 rpcz_store.cc:269] 1215 14:55:08.472665 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:08.472729 (+ 64us) service_pool.cc:225] Handling call
1215 14:55:09.249401 (+776672us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251215 14:55:09.250555 8678 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu with pid 9487
I20251215 14:55:09.251016 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7f760639a664cfb9f4af5578154b981" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:09.253075 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7f760639a664cfb9f4af5578154b981" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:09.253923 9249 leader_election.cc:343] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:09.257018 9248 leader_election.cc:343] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:09.257164 9248 leader_election.cc:304] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:09.257285 9507 raft_consensus.cc:2804] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:09.257608 9971 raft_consensus.cc:2749] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:09.257786 9507 raft_consensus.cc:697] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:09.258061 9507 consensus_queue.cc:237] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.264760 10021 leader_election.cc:290] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:09.265460 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2104a3530264fa982b20aed20afb0b4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:09.265683 9314 raft_consensus.cc:3060] T e2104a3530264fa982b20aed20afb0b4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:09.268838 9314 raft_consensus.cc:2468] T e2104a3530264fa982b20aed20afb0b4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:09.271519 9971 raft_consensus.cc:493] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:09.271715 9971 raft_consensus.cc:515] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.272388 9971 leader_election.cc:290] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:09.273202 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e80ac7bd98a46119a30bd5d2f3de2f9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:09.273799 9249 leader_election.cc:343] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:09.279245 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e80ac7bd98a46119a30bd5d2f3de2f9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:09.279853 9248 leader_election.cc:343] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:09.280002 9248 leader_election.cc:304] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:09.280328 9971 raft_consensus.cc:2749] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:09.286828 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8aa89f1547a54860886e482f1c87f816 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.290889 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 96b2d20fd2304e7a9995206a043b7944 with delete_type TABLET_DATA_DELETED (replaced by tablet 6140a160980d49b09a5fda8475fc144f) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:09.291843 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 96b2d20fd2304e7a9995206a043b7944 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96b2d20fd2304e7a9995206a043b7944 already in progress: creating tablet
W20251215 14:55:09.286926 8772 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.8.121.190:44279 (error 108) [suppressed 4 similar messages]
I20251215 14:55:09.292393 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 38e50a7f2bdd4907ab41436b59397ea6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.292732 9944 tablet_replica.cc:333] T 38e50a7f2bdd4907ab41436b59397ea6 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:09.292944 9944 raft_consensus.cc:2243] T 38e50a7f2bdd4907ab41436b59397ea6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:09.293133 9944 raft_consensus.cc:2272] T 38e50a7f2bdd4907ab41436b59397ea6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:09.293401 9426 tablet_bootstrap.cc:492] T f7af1f66c4f04f649379758ff1b3e387 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:09.293540 9426 ts_tablet_manager.cc:1403] T f7af1f66c4f04f649379758ff1b3e387 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.219s user 0.005s sys 0.006s
I20251215 14:55:09.294301 9426 raft_consensus.cc:359] T f7af1f66c4f04f649379758ff1b3e387 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.294467 9426 raft_consensus.cc:385] T f7af1f66c4f04f649379758ff1b3e387 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.294553 9426 raft_consensus.cc:740] T f7af1f66c4f04f649379758ff1b3e387 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.294849 9426 consensus_queue.cc:260] T f7af1f66c4f04f649379758ff1b3e387 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.295372 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 0a597fd6c7c044228ffb2a5a5f924e70 with delete_type TABLET_DATA_DELETED (replaced by tablet 022c9c0d19ac450cb270319004886fe2) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.295800 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet c8af1d0b67424bec90b59863a975254e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.296197 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 5560a21e16bb43c7903c1fc66429ecdf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.296574 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet accc3fdaf8e64b0f96b45150a59516bf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.296974 9426 ts_tablet_manager.cc:1434] T f7af1f66c4f04f649379758ff1b3e387 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:09.297276 9426 tablet_bootstrap.cc:492] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:09.297494 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 3c6cfff573434fbcb18feaf6a8e6a153 with delete_type TABLET_DATA_DELETED (replaced by tablet ca2bba36b0f54aadb3980aa41dfd0eb0) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.297924 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 88206b17f94242378a35d5314611ac1a with delete_type TABLET_DATA_DELETED (replaced by tablet 394844a49d254112883c40df9821c075) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.298278 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 with delete_type TABLET_DATA_DELETED (replaced by tablet 9e317c8dc24e481abb709e932fa39c29) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.298949 9426 tablet_bootstrap.cc:654] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.299151 9944 ts_tablet_manager.cc:1916] T 38e50a7f2bdd4907ab41436b59397ea6 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:09.312568 9944 ts_tablet_manager.cc:1929] T 38e50a7f2bdd4907ab41436b59397ea6 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20251215 14:55:09.314112 10117 negotiation.cc:337] Failed RPC negotiation. Trace:
1215 14:55:09.288602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.121.190:44279 (local address 127.8.121.129:59675)
1215 14:55:09.300607 (+ 12005us) negotiation.cc:107] Waiting for socket to connect
1215 14:55:09.300625 (+ 18us) client_negotiation.cc:174] Beginning negotiation
1215 14:55:09.300738 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1215 14:55:09.313813 (+ 13075us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.121.190:44279: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":11904,"thread_start_us":17802,"threads_started":1}
W20251215 14:55:09.314817 10116 negotiation.cc:337] Failed RPC negotiation. Trace:
1215 14:55:09.288148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.121.190:44279 (local address 127.8.121.130:57623)
1215 14:55:09.300132 (+ 11984us) negotiation.cc:107] Waiting for socket to connect
1215 14:55:09.300152 (+ 20us) client_negotiation.cc:174] Beginning negotiation
1215 14:55:09.300259 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1215 14:55:09.314480 (+ 14221us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.8.121.190:44279: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":11878,"thread_start_us":11760,"threads_started":1}
I20251215 14:55:09.313141 9294 tablet_service.cc:1552] Processing DeleteTablet for tablet 61aef86a30e842f2a90f9f1c88c84f4d with delete_type TABLET_DATA_DELETED (replaced by tablet ec3d52299b7945cdbedbc89be7f174c5) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:09.313584 9248 connection.cc:537] client connection to 127.8.121.190:44279 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251215 14:55:09.313714 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet 16edd0bfd67848e688fa12d9c679fdac with delete_type TABLET_DATA_DELETED (replaced by tablet df30b9f793bf4232ba848f569100a747) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.313884 9285 tablet_service.cc:1552] Processing DeleteTablet for tablet f080b56cff244a46bfb73d05d3127f31 with delete_type TABLET_DATA_DELETED (replaced by tablet 377c3e08df404b75a6a53dd2ef6e5f78) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:09.326005 8772 consensus_peers.cc:597] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 -> Peer cad1fca07ac7419cb608c21541f672f3 (127.8.121.190:44279): Couldn't send request to peer cad1fca07ac7419cb608c21541f672f3. Status: Network error: Client connection negotiation failed: client connection to 127.8.121.190:44279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:09.326349 9435 tablet_bootstrap.cc:492] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:09.326577 9435 ts_tablet_manager.cc:1403] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.110s user 0.010s sys 0.008s
I20251215 14:55:09.327625 9435 raft_consensus.cc:359] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.328756 9435 raft_consensus.cc:385] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.329035 9435 raft_consensus.cc:740] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.329506 9944 log.cc:1199] T 38e50a7f2bdd4907ab41436b59397ea6 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/38e50a7f2bdd4907ab41436b59397ea6
I20251215 14:55:09.329916 9944 ts_tablet_manager.cc:1950] T 38e50a7f2bdd4907ab41436b59397ea6 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:09.329424 9435 consensus_queue.cc:260] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.331022 8825 master_runner.cc:186] Error getting master registration for 127.8.121.190:44279: Network error: Client connection negotiation failed: client connection to 127.8.121.190:44279: connect: Connection refused (error 111),
I20251215 14:55:09.331233 8825 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251215 14:55:09.331689 9427 tablet_bootstrap.cc:492] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:09.331851 9427 ts_tablet_manager.cc:1403] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.178s user 0.013s sys 0.024s
I20251215 14:55:09.333123 9507 raft_consensus.cc:493] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:09.333278 9507 raft_consensus.cc:515] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.333398 9427 raft_consensus.cc:359] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.333570 9427 raft_consensus.cc:385] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.333662 9427 raft_consensus.cc:740] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.333884 9427 consensus_queue.cc:260] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.333936 9507 leader_election.cc:290] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:09.334375 9427 ts_tablet_manager.cc:1434] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251215 14:55:09.334648 9427 tablet_bootstrap.cc:492] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:09.334926 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e70b4070b6437e9b934af4e6b93f6a" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:09.335193 9314 raft_consensus.cc:2393] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:09.335026 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05e70b4070b6437e9b934af4e6b93f6a" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:09.336858 9112 leader_election.cc:304] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:09.337162 9507 raft_consensus.cc:3060] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:09.339790 9507 raft_consensus.cc:2749] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:09.337061 9944 tablet_replica.cc:333] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:09.340442 9285 tablet_service.cc:1552] Processing DeleteTablet for tablet b9b39c879d444172871f43349978dc86 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.341711 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 38e50a7f2bdd4907ab41436b59397ea6 (table default.Table_ada3150d10a34cb4aaf8a16a487fa543 [id=d12dc623fa0a4a6cbd87ee8180c4c885]) successfully deleted
W20251215 14:55:09.341953 8775 catalog_manager.cc:4952] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 0a597fd6c7c044228ffb2a5a5f924e70 because the tablet was not found. No further retry: Not found: Tablet not found: 0a597fd6c7c044228ffb2a5a5f924e70
I20251215 14:55:09.342445 9427 tablet_bootstrap.cc:654] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.340441 9435 ts_tablet_manager.cc:1434] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20251215 14:55:09.343847 9944 raft_consensus.cc:2243] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
W20251215 14:55:09.345865 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 5f03dfdd546c492185c6c31866a090a5
I20251215 14:55:09.346084 9435 tablet_bootstrap.cc:492] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:09.350793 9427 tablet_bootstrap.cc:492] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:09.351003 9427 ts_tablet_manager.cc:1403] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.001s
I20251215 14:55:09.351300 9435 tablet_bootstrap.cc:654] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.351747 9427 raft_consensus.cc:359] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.351945 9427 raft_consensus.cc:385] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.352035 9427 raft_consensus.cc:740] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.352244 9427 consensus_queue.cc:260] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.352892 9427 ts_tablet_manager.cc:1434] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:09.349701 9944 raft_consensus.cc:2272] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:09.355638 9944 ts_tablet_manager.cc:1916] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:09.355789 9426 tablet_bootstrap.cc:492] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:09.355980 9426 ts_tablet_manager.cc:1403] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.059s user 0.000s sys 0.003s
I20251215 14:55:09.356688 9426 raft_consensus.cc:359] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.356911 9426 raft_consensus.cc:385] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.357055 9426 raft_consensus.cc:740] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.357333 9426 consensus_queue.cc:260] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.358062 9427 tablet_bootstrap.cc:492] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:09.359668 9427 tablet_bootstrap.cc:654] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.360287 9426 ts_tablet_manager.cc:1434] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20251215 14:55:09.366343 9426 tablet_bootstrap.cc:492] T 38e50a7f2bdd4907ab41436b59397ea6 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:09.370213 9944 ts_tablet_manager.cc:1929] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:09.370626 9944 log.cc:1199] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/c8af1d0b67424bec90b59863a975254e
I20251215 14:55:09.370839 9427 tablet_bootstrap.cc:492] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:09.371029 9427 ts_tablet_manager.cc:1403] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.002s
I20251215 14:55:09.371515 9944 ts_tablet_manager.cc:1950] T c8af1d0b67424bec90b59863a975254e P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:09.371964 9427 raft_consensus.cc:359] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.372180 9427 raft_consensus.cc:385] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.372315 9427 raft_consensus.cc:740] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.372570 9427 consensus_queue.cc:260] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.372699 9426 tablet_bootstrap.cc:654] T 38e50a7f2bdd4907ab41436b59397ea6 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.373142 9427 ts_tablet_manager.cc:1434] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:09.373467 9427 tablet_bootstrap.cc:492] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:09.375129 9427 tablet_bootstrap.cc:654] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.374248 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet c8af1d0b67424bec90b59863a975254e (table default.Table_2920b8dba9704f489af552aa0ce58b64 [id=53456f18769d4b1ebe4743594e412016]) successfully deleted
W20251215 14:55:09.375831 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 5560a21e16bb43c7903c1fc66429ecdf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5560a21e16bb43c7903c1fc66429ecdf already in progress: creating tablet
W20251215 14:55:09.376087 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet accc3fdaf8e64b0f96b45150a59516bf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet accc3fdaf8e64b0f96b45150a59516bf already in progress: creating tablet
W20251215 14:55:09.376673 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 3c6cfff573434fbcb18feaf6a8e6a153 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3c6cfff573434fbcb18feaf6a8e6a153 already in progress: creating tablet
W20251215 14:55:09.376916 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 194bb745ecb849cb9092fee1afb7dbe6
W20251215 14:55:09.377612 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 88206b17f94242378a35d5314611ac1a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88206b17f94242378a35d5314611ac1a already in progress: creating tablet
W20251215 14:55:09.377981 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet ce0154b24522401b9cc0e37fa502532f
W20251215 14:55:09.378500 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6ae72a1ded6e4faba1ad309d9a0e4a95 already in progress: creating tablet
W20251215 14:55:09.378477 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 95583eee8a5041b1ade97e8f8f0db271
I20251215 14:55:09.378763 9944 tablet_replica.cc:333] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:09.379361 9944 raft_consensus.cc:2243] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus shutting down.
W20251215 14:55:09.379227 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet f9411030d08d40aabbdee6670ba95821
I20251215 14:55:09.379845 9944 raft_consensus.cc:2272] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 14:55:09.380004 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 1141b9a4cf3e4aa78529bed7f0375ff8
W20251215 14:55:09.380437 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 26876cdffd7e4664bc8f7efb74885776
I20251215 14:55:09.381572 9944 ts_tablet_manager.cc:1916] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:09.387284 9427 tablet_bootstrap.cc:492] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:09.387511 9427 ts_tablet_manager.cc:1403] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20251215 14:55:09.388199 9971 raft_consensus.cc:493] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:09.388347 9427 raft_consensus.cc:359] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.388372 9971 raft_consensus.cc:515] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.388540 9427 raft_consensus.cc:385] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.388603 9427 raft_consensus.cc:740] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.388870 9427 consensus_queue.cc:260] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.389062 9971 leader_election.cc:290] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:09.389755 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "194bb745ecb849cb9092fee1afb7dbe6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:09.390271 9249 leader_election.cc:343] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:09.390305 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 9425749d471f4f95bbae030977e278e4
I20251215 14:55:09.389508 9427 ts_tablet_manager.cc:1434] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:09.391924 9427 tablet_bootstrap.cc:492] T 4c96b655cf284326ae3fa2a165e2bf95 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:09.392879 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 16309efc14e747d09ce6e5de4f3c2784
I20251215 14:55:09.393599 9427 tablet_bootstrap.cc:654] T 4c96b655cf284326ae3fa2a165e2bf95 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:09.393466 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 188eb879e7c3479ea71c5b1864400243
I20251215 14:55:09.395711 8786 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_74cef17050464ec6968b0d9dce366720" } new_table_name: "default.Table_145283350dd24d6ca18a985e25c2758d" modify_external_catalogs: true
I20251215 14:55:09.397102 8783 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_7fbfc1dd536247d4b9f3472efe93ca60" } modify_external_catalogs: true
I20251215 14:55:09.397264 8783 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_7fbfc1dd536247d4b9f3472efe93ca60" } modify_external_catalogs: true
I20251215 14:55:09.397629 8787 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_1575d3d624744c93a3dc41685842aca0" } modify_external_catalogs: true
I20251215 14:55:09.397795 8787 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_1575d3d624744c93a3dc41685842aca0" } modify_external_catalogs: true
W20251215 14:55:09.397858 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet f7af1f66c4f04f649379758ff1b3e387
W20251215 14:55:09.397974 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 5e80ac7bd98a46119a30bd5d2f3de2f9
W20251215 14:55:09.398046 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 95583eee8a5041b1ade97e8f8f0db271
W20251215 14:55:09.398176 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 92e21a77ad074572a57b836743903a0b
W20251215 14:55:09.398227 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 30c5c795ea4a4fe591cdf63320ec2521
W20251215 14:55:09.398283 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
W20251215 14:55:09.398324 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 32432afc6e8d458bb7ed7abc42fb3dde
W20251215 14:55:09.398372 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 188eb879e7c3479ea71c5b1864400243
W20251215 14:55:09.398413 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 062a482917794ae5a67ec685a2491ba2
W20251215 14:55:09.398492 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 194bb745ecb849cb9092fee1afb7dbe6
W20251215 14:55:09.398564 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 813cfeea5399457e91623fb3abf9fd32
W20251215 14:55:09.398618 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 37181f50142f4d8bb88713221a755d50
W20251215 14:55:09.398674 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet fab39532fe6a403683952057c5ccabd9
W20251215 14:55:09.398725 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 9425749d471f4f95bbae030977e278e4
W20251215 14:55:09.398766 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 1141b9a4cf3e4aa78529bed7f0375ff8
W20251215 14:55:09.398993 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet f9411030d08d40aabbdee6670ba95821
W20251215 14:55:09.399055 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet f32a6e8df31d482fa9b9686e002d81ff
W20251215 14:55:09.399111 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet fc9bda52c73e4aa6b7e2eb008c63391b
I20251215 14:55:09.399366 9971 raft_consensus.cc:493] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:09.399518 9971 raft_consensus.cc:515] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.400115 9971 leader_election.cc:290] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:09.400705 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f121a14828e6443695960c0e540ae573" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:09.399148 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet ce0154b24522401b9cc0e37fa502532f
W20251215 14:55:09.401449 9249 leader_election.cc:343] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:09.401656 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet b329b0abcad742ff94c1a62a72d1b673
W20251215 14:55:09.402063 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet df70bebdc8ad4f8186ba427e840799cf
W20251215 14:55:09.402441 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet e6aad8bed15a416a925ae8c8870d4e51
W20251215 14:55:09.402993 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 0db6246dee2643d98094408410618259
W20251215 14:55:09.403360 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 15a974e3265a4c88aa6d5005ffa04dc8
W20251215 14:55:09.403861 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 26876cdffd7e4664bc8f7efb74885776
I20251215 14:55:09.407119 8779 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet a98376a145a0421183a33683251b8e0e
I20251215 14:55:09.410320 8779 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ca2a9c1da0264e1eb4e1b13acfed1ece" } new_table_name: "default.Table_9bc811b3caa448e2b7cf83094f1ba245" modify_external_catalogs: true
I20251215 14:55:09.414675 8785 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_167f954113c245df9dbd333990b68e0a" } new_table_name: "default.Table_3b83163b30384377a042e449398cc9e0" modify_external_catalogs: true
I20251215 14:55:09.421123 9944 ts_tablet_manager.cc:1929] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:09.421643 9944 log.cc:1199] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:55:09.422945 9944 ts_tablet_manager.cc:1950] T 61aef86a30e842f2a90f9f1c88c84f4d P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:09.426497 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 61aef86a30e842f2a90f9f1c88c84f4d (table default.Table_38b1c1a82dd441dfa8131162ac117124 [id=c50e99dfae684c81a80bfce95ff35672]) successfully deleted
I20251215 14:55:09.428124 8784 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c4eaf4a0d8ed44e0ba7d485098c3e9aa" } modify_external_catalogs: true
I20251215 14:55:09.428310 8784 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c4eaf4a0d8ed44e0ba7d485098c3e9aa" } modify_external_catalogs: true
W20251215 14:55:09.428973 8775 catalog_manager.cc:4952] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 16edd0bfd67848e688fa12d9c679fdac because the tablet was not found. No further retry: Not found: Tablet not found: 16edd0bfd67848e688fa12d9c679fdac
W20251215 14:55:09.430122 8775 catalog_manager.cc:4952] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet f080b56cff244a46bfb73d05d3127f31 because the tablet was not found. No further retry: Not found: Tablet not found: f080b56cff244a46bfb73d05d3127f31
W20251215 14:55:09.431188 8775 catalog_manager.cc:4952] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet b9b39c879d444172871f43349978dc86 because the tablet was not found. No further retry: Not found: Tablet not found: b9b39c879d444172871f43349978dc86
I20251215 14:55:09.435752 8780 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781]). Expected version 2 got 0
I20251215 14:55:09.437044 8780 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_93ee270c113a4a51ab4e5fe5f80117b0" } new_table_name: "default.Table_8794e4e1bca04ca694f7521050d4b376" modify_external_catalogs: true
I20251215 14:55:09.439823 8788 catalog_manager.cc:5654] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e89303a500544272b601d7c29be802b4 (127.8.121.131). New cstate: current_term: 1 leader_uuid: "e89303a500544272b601d7c29be802b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: HEALTHY } } }
I20251215 14:55:09.440246 8788 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 4c96b655cf284326ae3fa2a165e2bf95 (table default.Table_99ea47285b994715a5fae3cfb669d229 [id=b7ff2d02e55b4e839049b20b89227526]). Expected version 1 got 0
I20251215 14:55:09.440526 8788 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d [id=066e8ae14004436cb8b4f3f740b45b19]). Expected version 3 got 0
I20251215 14:55:09.440776 8788 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet e2104a3530264fa982b20aed20afb0b4 (table default.Table_d92a50e24ad64b9496b0cb3ca5d0dd9a [id=d916193804f94519b84d259c0420e1a1]). Expected version 2 got 0
I20251215 14:55:09.441035 8788 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1]). Expected version 1 got 0
I20251215 14:55:09.443058 8788 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet f121a14828e6443695960c0e540ae573 (table default.Table_159b0c9ea29840df94432fbee21770fd [id=0e3677e1f3d048ecad508d50304ee56a]). Expected version 2 got 0
I20251215 14:55:09.444069 9285 tablet_service.cc:1505] Processing CreateTablet for tablet c8b49b3d98ef4e0988e9019fe82f8727 (DEFAULT_TABLE table=default.Table_719f72c4c7e64ba5b4e1b29b3b9862a0 [id=bc5242d996ad40d9a5c32f16904e1b0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.444300 8786 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_cee40c41a2f74ddfb19f74f8be3ae220" } new_table_name: "default.Table_7fa1b2c1e53d43159ab9cd514864b006" modify_external_catalogs: true
I20251215 14:55:09.444447 9285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b49b3d98ef4e0988e9019fe82f8727. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.446991 9151 tablet_service.cc:1505] Processing CreateTablet for tablet c8b49b3d98ef4e0988e9019fe82f8727 (DEFAULT_TABLE table=default.Table_719f72c4c7e64ba5b4e1b29b3b9862a0 [id=bc5242d996ad40d9a5c32f16904e1b0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.447415 9151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b49b3d98ef4e0988e9019fe82f8727. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.447463 9277 tablet_service.cc:1505] Processing CreateTablet for tablet 2ebdaff1fcbe4b27b6da28f010d1af1a (DEFAULT_TABLE table=default.Table_e566b27e9ad74847a5e198bb1a5d13f7 [id=84fc0206dc0f4b9fa754dd702fb2a5e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.447788 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebdaff1fcbe4b27b6da28f010d1af1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.453953 9889 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "40747def373e4b19abfa5d21ba0a4315" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:55:09.454144 9889 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 [sys.catalog]: This master's current role is: LEADER
I20251215 14:55:09.454859 8781 master_service.cc:954] ReplaceTablet: received request to replace tablet 82ca60c5a63744ffb0a0c0a140ef665e from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:09.459899 9294 tablet_service.cc:1505] Processing CreateTablet for tablet f4203c4941184a66956ec9be8d703bb6 (DEFAULT_TABLE table=default.Table_46f35067e409451fb9ba912af7baed94 [id=89af833f92c9454b9ebc760496bf5995]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.460314 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4203c4941184a66956ec9be8d703bb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.463436 9284 tablet_service.cc:1505] Processing CreateTablet for tablet 1cb23f66c1b94751a9557e8b426dd434 (DEFAULT_TABLE table=default.Table_3a3de1a36ece4604ba7c47a47664499a [id=c157580aaa09416fbf64b7dc61b93a80]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.463806 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb23f66c1b94751a9557e8b426dd434. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.459870 9283 tablet_service.cc:1505] Processing CreateTablet for tablet c4660d4e5cb84f3a983922c0b4aef90b (DEFAULT_TABLE table=default.Table_f191a21e4c4f41c2910805786164e8ff [id=e48472bbf65e450da681976f5eef3d3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.467612 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4660d4e5cb84f3a983922c0b4aef90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.474411 9285 tablet_service.cc:1505] Processing CreateTablet for tablet a2a58a13b66641b0bdc710cf5d458689 (DEFAULT_TABLE table=default.Table_c4eaf4a0d8ed44e0ba7d485098c3e9aa [id=b44efd4bfd8144388a8c45c3bc91455a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.474885 9285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a58a13b66641b0bdc710cf5d458689. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.495674 9149 tablet_service.cc:1505] Processing CreateTablet for tablet c4660d4e5cb84f3a983922c0b4aef90b (DEFAULT_TABLE table=default.Table_f191a21e4c4f41c2910805786164e8ff [id=e48472bbf65e450da681976f5eef3d3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.496701 9150 tablet_service.cc:1505] Processing CreateTablet for tablet a2a58a13b66641b0bdc710cf5d458689 (DEFAULT_TABLE table=default.Table_c4eaf4a0d8ed44e0ba7d485098c3e9aa [id=b44efd4bfd8144388a8c45c3bc91455a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.505303 9143 tablet_service.cc:1505] Processing CreateTablet for tablet f4203c4941184a66956ec9be8d703bb6 (DEFAULT_TABLE table=default.Table_46f35067e409451fb9ba912af7baed94 [id=89af833f92c9454b9ebc760496bf5995]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.505810 9145 tablet_service.cc:1552] Processing DeleteTablet for tablet 96b2d20fd2304e7a9995206a043b7944 with delete_type TABLET_DATA_DELETED (replaced by tablet 6140a160980d49b09a5fda8475fc144f) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:09.506682 9144 tablet_service.cc:1505] Processing CreateTablet for tablet 2ebdaff1fcbe4b27b6da28f010d1af1a (DEFAULT_TABLE table=default.Table_e566b27e9ad74847a5e198bb1a5d13f7 [id=84fc0206dc0f4b9fa754dd702fb2a5e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.506985 9152 tablet_service.cc:1505] Processing CreateTablet for tablet 56f600c59b094e4f96acec978911a8a7 (DEFAULT_TABLE table=default.Table_ddea9e06b72a43758693e2b1f32c1b15 [id=3c4a8527ae214b3c8659ce02a13d10f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.508870 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4660d4e5cb84f3a983922c0b4aef90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.509372 9155 tablet_service.cc:1505] Processing CreateTablet for tablet 1cb23f66c1b94751a9557e8b426dd434 (DEFAULT_TABLE table=default.Table_3a3de1a36ece4604ba7c47a47664499a [id=c157580aaa09416fbf64b7dc61b93a80]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.511631 9943 tablet_replica.cc:333] T 96b2d20fd2304e7a9995206a043b7944 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:09.511855 9943 raft_consensus.cc:2243] T 96b2d20fd2304e7a9995206a043b7944 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:09.512120 9943 raft_consensus.cc:2272] T 96b2d20fd2304e7a9995206a043b7944 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:09.512657 9943 ts_tablet_manager.cc:1916] T 96b2d20fd2304e7a9995206a043b7944 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:09.512753 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebdaff1fcbe4b27b6da28f010d1af1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.515379 9152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56f600c59b094e4f96acec978911a8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.518751 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb23f66c1b94751a9557e8b426dd434. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.524272 9143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4203c4941184a66956ec9be8d703bb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.534787 9283 tablet_service.cc:1505] Processing CreateTablet for tablet 56f600c59b094e4f96acec978911a8a7 (DEFAULT_TABLE table=default.Table_ddea9e06b72a43758693e2b1f32c1b15 [id=3c4a8527ae214b3c8659ce02a13d10f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.535297 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56f600c59b094e4f96acec978911a8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.542763 9284 tablet_service.cc:1505] Processing CreateTablet for tablet a93d01ea31a64dc2a8d8b03884675024 (DEFAULT_TABLE table=default.Table_1575d3d624744c93a3dc41685842aca0 [id=04a10d805635468082ccf52d466f24fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.543308 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93d01ea31a64dc2a8d8b03884675024. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.550839 9150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a58a13b66641b0bdc710cf5d458689. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.552426 9149 tablet_service.cc:1505] Processing CreateTablet for tablet a93d01ea31a64dc2a8d8b03884675024 (DEFAULT_TABLE table=default.Table_1575d3d624744c93a3dc41685842aca0 [id=04a10d805635468082ccf52d466f24fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.553143 9971 consensus_queue.cc:1048] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:09.554003 9145 tablet_service.cc:1505] Processing CreateTablet for tablet f4ec165149a74778aee1fb39c4d96871 (DEFAULT_TABLE table=default.Table_59a89434b3b24db2905384e5da65e1a0 [id=cecf067caefb4060a3b00733628e14d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.554457 9145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4ec165149a74778aee1fb39c4d96871. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.557264 9294 tablet_service.cc:1505] Processing CreateTablet for tablet f4ec165149a74778aee1fb39c4d96871 (DEFAULT_TABLE table=default.Table_59a89434b3b24db2905384e5da65e1a0 [id=cecf067caefb4060a3b00733628e14d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.557835 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4ec165149a74778aee1fb39c4d96871. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.558698 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93d01ea31a64dc2a8d8b03884675024. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:09.607975 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 05e70b4070b6437e9b934af4e6b93f6a consensus state has no leader
I20251215 14:55:09.613392 9943 ts_tablet_manager.cc:1929] T 96b2d20fd2304e7a9995206a043b7944 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:09.613618 9943 log.cc:1199] T 96b2d20fd2304e7a9995206a043b7944 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/96b2d20fd2304e7a9995206a043b7944
I20251215 14:55:09.614078 9943 ts_tablet_manager.cc:1950] T 96b2d20fd2304e7a9995206a043b7944 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:09.615245 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 96b2d20fd2304e7a9995206a043b7944 (table default.Table_42e5c1011ba64c0b9602eed064c8ecbd [id=4343a6c3acc545d7be8d3b7ec617da90]) successfully deleted
W20251215 14:55:09.627624 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:09.629290 9149 tablet_service.cc:1505] Processing CreateTablet for tablet 745482d5b350403c97621609e6935340 (DEFAULT_TABLE table=default.Table_000f958eb97a4a8a93fb9520a90c485c [id=12862c38a8714a2085f46f70be0a0cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.629797 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 745482d5b350403c97621609e6935340. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.646521 9150 tablet_service.cc:1505] Processing CreateTablet for tablet 14ac26b3a02449f8a7588151abe7ae10 (DEFAULT_TABLE table=default.Table_8ee3cade1b94484b8cdf7579a865f570 [id=148c3bbaa3d845efad3703f604e36032]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.647080 9150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14ac26b3a02449f8a7588151abe7ae10. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.655134 10003 raft_consensus.cc:493] T 5f03dfdd546c492185c6c31866a090a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:09.655328 10003 raft_consensus.cc:515] T 5f03dfdd546c492185c6c31866a090a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.655443 9285 tablet_service.cc:1505] Processing CreateTablet for tablet 14ac26b3a02449f8a7588151abe7ae10 (DEFAULT_TABLE table=default.Table_8ee3cade1b94484b8cdf7579a865f570 [id=148c3bbaa3d845efad3703f604e36032]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.655889 9285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14ac26b3a02449f8a7588151abe7ae10. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.655988 10003 leader_election.cc:290] T 5f03dfdd546c492185c6c31866a090a5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:09.656504 9143 tablet_service.cc:1505] Processing CreateTablet for tablet 46bd8e49fff5473f8787742f6023ddbe (DEFAULT_TABLE table=default.Table_b7e8e496ff654bdea9558a04abb32447 [id=1c28164ca77c4db9b53fe9e8c0f98e78]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.656908 9143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46bd8e49fff5473f8787742f6023ddbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.657948 9277 tablet_service.cc:1505] Processing CreateTablet for tablet 46bd8e49fff5473f8787742f6023ddbe (DEFAULT_TABLE table=default.Table_b7e8e496ff654bdea9558a04abb32447 [id=1c28164ca77c4db9b53fe9e8c0f98e78]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.658324 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46bd8e49fff5473f8787742f6023ddbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.658289 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f03dfdd546c492185c6c31866a090a5" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:09.659130 9144 tablet_service.cc:1505] Processing CreateTablet for tablet 7f9c173d11f1449b829a54190313bea3 (DEFAULT_TABLE table=default.Table_07de59922021486886fb112cbc06c493 [id=1ff1a56115104321ba6aafed10d1506d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.659507 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9c173d11f1449b829a54190313bea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.661688 9155 tablet_service.cc:1505] Processing CreateTablet for tablet e9353aff4c0742c191b37d3a412ed411 (DEFAULT_TABLE table=default.Table_ca2a9c1da0264e1eb4e1b13acfed1ece [id=ec4265755f604ee3b8ca72186d9ec98a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.662251 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9353aff4c0742c191b37d3a412ed411. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:09.663235 8785 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 90660799e0cc4ce3bda91bbb7e734ac3 has no consensus state
I20251215 14:55:09.663514 9291 tablet_service.cc:1505] Processing CreateTablet for tablet 7f9c173d11f1449b829a54190313bea3 (DEFAULT_TABLE table=default.Table_07de59922021486886fb112cbc06c493 [id=1ff1a56115104321ba6aafed10d1506d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.663897 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9c173d11f1449b829a54190313bea3. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:09.665040 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 32432afc6e8d458bb7ed7abc42fb3dde
W20251215 14:55:09.665110 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet df70bebdc8ad4f8186ba427e840799cf
W20251215 14:55:09.665174 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet f7af1f66c4f04f649379758ff1b3e387
W20251215 14:55:09.665215 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet ce0154b24522401b9cc0e37fa502532f
W20251215 14:55:09.665319 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet e6aad8bed15a416a925ae8c8870d4e51
W20251215 14:55:09.665388 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 18cd1f63d51e4565bb8c55be13e3e099
W20251215 14:55:09.665925 8779 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e9353aff4c0742c191b37d3a412ed411 consensus state has no leader
I20251215 14:55:09.666314 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ab675320fa5a4421948fc3438902cfd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.666853 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab675320fa5a4421948fc3438902cfd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:09.677258 8780 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
I20251215 14:55:09.677647 8780 master_service.cc:954] ReplaceTablet: received request to replace tablet 66f2c74e55f04a6fa4b2c238c0a6b901 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:09.679214 8783 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 5bfe8cc0805247de9df4a59d461818f3
I20251215 14:55:09.680032 8783 master_service.cc:954] ReplaceTablet: received request to replace tablet 9425749d471f4f95bbae030977e278e4 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:09.680636 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_33fa344a68b64dcc901ab7f6ce8de37b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.681406 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33fa344a68b64dcc901ab7f6ce8de37b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.682825 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet a93d01ea31a64dc2a8d8b03884675024
W20251215 14:55:09.683503 8786 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e9124dd3d98947b29289e0561976ada4 consensus state has no leader
I20251215 14:55:09.683939 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c3332b4583ce44ee84532c70bbe9eac4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.684541 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3332b4583ce44ee84532c70bbe9eac4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.685891 9971 raft_consensus.cc:493] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:09.685905 8784 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet a2a58a13b66641b0bdc710cf5d458689
I20251215 14:55:09.686038 9971 raft_consensus.cc:515] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.686650 8784 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f9cf4c41c7b846e88bae24711ee3421a" } modify_external_catalogs: true
I20251215 14:55:09.686857 8784 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f9cf4c41c7b846e88bae24711ee3421a" } modify_external_catalogs: true
I20251215 14:55:09.686966 9971 leader_election.cc:290] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:09.687425 8781 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 82ca60c5a63744ffb0a0c0a140ef665e
I20251215 14:55:09.687839 8781 catalog_manager.cc:6724] ReplaceTablet: tablet 82ca60c5a63744ffb0a0c0a140ef665e deleted and replaced by tablet 90c7925890474a76b35a3ce5e6db8ebf
I20251215 14:55:09.688074 8781 master_service.cc:954] ReplaceTablet: received request to replace tablet 062a482917794ae5a67ec685a2491ba2 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:09.688458 8781 master_service.cc:954] ReplaceTablet: received request to replace tablet 123361ef48714d859ee5ac85c3c37d08 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:09.690735 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_52ac8cc4c4294a57a57b129861367764"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:09.704931 9291 tablet_service.cc:1552] Processing DeleteTablet for tablet 5bfe8cc0805247de9df4a59d461818f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.705029 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet a2a58a13b66641b0bdc710cf5d458689 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.705260 9285 tablet_service.cc:1552] Processing DeleteTablet for tablet 82ca60c5a63744ffb0a0c0a140ef665e with delete_type TABLET_DATA_DELETED (replaced by tablet 90c7925890474a76b35a3ce5e6db8ebf) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.705343 9291 tablet_service.cc:1552] Processing DeleteTablet for tablet a93d01ea31a64dc2a8d8b03884675024 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:09.706481 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52ac8cc4c4294a57a57b129861367764 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:09.707702 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 5bfe8cc0805247de9df4a59d461818f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bfe8cc0805247de9df4a59d461818f3 already in progress: creating tablet
W20251215 14:55:09.707964 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 82ca60c5a63744ffb0a0c0a140ef665e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82ca60c5a63744ffb0a0c0a140ef665e already in progress: creating tablet
W20251215 14:55:09.708191 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet a93d01ea31a64dc2a8d8b03884675024 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a93d01ea31a64dc2a8d8b03884675024 already in progress: creating tablet
W20251215 14:55:09.708390 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet a2a58a13b66641b0bdc710cf5d458689 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2a58a13b66641b0bdc710cf5d458689 already in progress: creating tablet
I20251215 14:55:09.710122 9143 tablet_service.cc:1552] Processing DeleteTablet for tablet 5bfe8cc0805247de9df4a59d461818f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:09.710397 9144 tablet_service.cc:1552] Processing DeleteTablet for tablet a2a58a13b66641b0bdc710cf5d458689 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:09.710640 9143 tablet_service.cc:1552] Processing DeleteTablet for tablet a93d01ea31a64dc2a8d8b03884675024 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:09.710731 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7af1f66c4f04f649379758ff1b3e387" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:09.710973 9176 raft_consensus.cc:2468] T f7af1f66c4f04f649379758ff1b3e387 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
W20251215 14:55:09.711133 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 5bfe8cc0805247de9df4a59d461818f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bfe8cc0805247de9df4a59d461818f3 already in progress: creating tablet
I20251215 14:55:09.711683 9249 leader_election.cc:304] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:09.711974 9971 raft_consensus.cc:2804] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:09.712071 9971 raft_consensus.cc:493] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:09.712146 9971 raft_consensus.cc:3060] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:09.713177 9152 tablet_service.cc:1552] Processing DeleteTablet for tablet 82ca60c5a63744ffb0a0c0a140ef665e with delete_type TABLET_DATA_DELETED (replaced by tablet 90c7925890474a76b35a3ce5e6db8ebf) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:09.714056 8782 catalog_manager.cc:5654] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129). New cstate: current_term: 1 leader_uuid: "67978ac4539d4b289e53f4eedd9a8156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:09.714629 8782 catalog_manager.cc:5654] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129). New cstate: current_term: 1 leader_uuid: "67978ac4539d4b289e53f4eedd9a8156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:09.714792 9971 raft_consensus.cc:515] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.715010 8782 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781]). Expected version 2 got 0
I20251215 14:55:09.715268 8782 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d [id=066e8ae14004436cb8b4f3f740b45b19]). Expected version 3 got 0
I20251215 14:55:09.715926 9971 leader_election.cc:290] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:09.716079 8782 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet e2104a3530264fa982b20aed20afb0b4 (table default.Table_d92a50e24ad64b9496b0cb3ca5d0dd9a [id=d916193804f94519b84d259c0420e1a1]). Expected version 2 got 0
I20251215 14:55:09.716555 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7af1f66c4f04f649379758ff1b3e387" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:09.716732 9176 raft_consensus.cc:3060] T f7af1f66c4f04f649379758ff1b3e387 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:09.717346 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet a2a58a13b66641b0bdc710cf5d458689 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2a58a13b66641b0bdc710cf5d458689 already in progress: creating tablet
W20251215 14:55:09.717556 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet a93d01ea31a64dc2a8d8b03884675024 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a93d01ea31a64dc2a8d8b03884675024 already in progress: creating tablet
W20251215 14:55:09.717777 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 82ca60c5a63744ffb0a0c0a140ef665e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82ca60c5a63744ffb0a0c0a140ef665e already in progress: creating tablet
I20251215 14:55:09.718031 8780 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 66f2c74e55f04a6fa4b2c238c0a6b901
I20251215 14:55:09.718534 8780 catalog_manager.cc:6724] ReplaceTablet: tablet 66f2c74e55f04a6fa4b2c238c0a6b901 deleted and replaced by tablet b9c074f12b3c4abaa39fe3412df7fe02
I20251215 14:55:09.718700 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c1ab0640e3c44aeab9699e38c97745d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:09.718895 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_a6f2c02f62ef431c8a6587853a3548f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.719336 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c1ab0640e3c44aeab9699e38c97745d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.719494 9176 raft_consensus.cc:2468] T f7af1f66c4f04f649379758ff1b3e387 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:09.719558 8781 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 123361ef48714d859ee5ac85c3c37d08
I20251215 14:55:09.719981 9249 leader_election.cc:304] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:09.720036 8781 catalog_manager.cc:6724] ReplaceTablet: tablet 123361ef48714d859ee5ac85c3c37d08 deleted and replaced by tablet 3bd33107c2ed4b27841f3e1ece1df152
I20251215 14:55:09.720463 9971 raft_consensus.cc:2804] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:09.720384 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_a5079bcaff9847bf96a580ee3bbeea4d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.720856 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a5079bcaff9847bf96a580ee3bbeea4d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.721823 9971 raft_consensus.cc:697] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:09.722107 9971 consensus_queue.cc:237] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.722388 8786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e14188f87ed340c8b0eea119157a8a42" } modify_external_catalogs: true
I20251215 14:55:09.722568 8786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e14188f87ed340c8b0eea119157a8a42" } modify_external_catalogs: true
I20251215 14:55:09.725113 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet 66f2c74e55f04a6fa4b2c238c0a6b901 with delete_type TABLET_DATA_DELETED (replaced by tablet b9c074f12b3c4abaa39fe3412df7fe02) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.725597 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet 123361ef48714d859ee5ac85c3c37d08 with delete_type TABLET_DATA_DELETED (replaced by tablet 3bd33107c2ed4b27841f3e1ece1df152) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.726984 9143 tablet_service.cc:1552] Processing DeleteTablet for tablet 123361ef48714d859ee5ac85c3c37d08 with delete_type TABLET_DATA_DELETED (replaced by tablet 3bd33107c2ed4b27841f3e1ece1df152) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:09.727347 9152 tablet_service.cc:1552] Processing DeleteTablet for tablet 66f2c74e55f04a6fa4b2c238c0a6b901 with delete_type TABLET_DATA_DELETED (replaced by tablet b9c074f12b3c4abaa39fe3412df7fe02) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:09.719337 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6f2c02f62ef431c8a6587853a3548f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.729257 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_0b5550fc67b74b9e997ee17398719a8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.729777 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0b5550fc67b74b9e997ee17398719a8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:09.731122 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 66f2c74e55f04a6fa4b2c238c0a6b901 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66f2c74e55f04a6fa4b2c238c0a6b901 already in progress: creating tablet
W20251215 14:55:09.731364 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 123361ef48714d859ee5ac85c3c37d08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 123361ef48714d859ee5ac85c3c37d08 already in progress: creating tablet
W20251215 14:55:09.736656 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 123361ef48714d859ee5ac85c3c37d08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 123361ef48714d859ee5ac85c3c37d08 already in progress: creating tablet
W20251215 14:55:09.736994 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 66f2c74e55f04a6fa4b2c238c0a6b901 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66f2c74e55f04a6fa4b2c238c0a6b901 already in progress: creating tablet
I20251215 14:55:09.738670 8788 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_b527fedbc2c14bb3861289fe2b27fd43 [id=640d70bd78554e92823dc104e06227d3] alter complete (version 3)
I20251215 14:55:09.740286 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_8db54f1c2da24f868800c51c6a04bcce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.740850 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8db54f1c2da24f868800c51c6a04bcce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:09.749256 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 95583eee8a5041b1ade97e8f8f0db271
W20251215 14:55:09.749374 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 188eb879e7c3479ea71c5b1864400243
W20251215 14:55:09.749437 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 11a5a6a0895c49648c910fa2ea3ca373
I20251215 14:55:09.749977 8779 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_642fc0a3b7ac49d6843e4dcefe43650e" } new_table_name: "default.Table_b2e5b280bc8e450f809d52261090830d" modify_external_catalogs: true
I20251215 14:55:09.752609 8784 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet bcd7d00fa01f4a9cbdf0d505684dab0e
I20251215 14:55:09.753365 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_37bdefb7cdb34904ac81a47dd467abe9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.753952 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37bdefb7cdb34904ac81a47dd467abe9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.759152 9291 tablet_service.cc:1552] Processing DeleteTablet for tablet c8af1d0b67424bec90b59863a975254e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:08 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.760071 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet bcd7d00fa01f4a9cbdf0d505684dab0e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.760591 9944 tablet_replica.cc:333] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:09.760823 9944 raft_consensus.cc:2243] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:09.761157 9944 raft_consensus.cc:2272] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:09.761772 9944 ts_tablet_manager.cc:1916] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:09.761876 9143 tablet_service.cc:1552] Processing DeleteTablet for tablet bcd7d00fa01f4a9cbdf0d505684dab0e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:09.762161 9152 tablet_service.cc:1552] Processing DeleteTablet for tablet 61aef86a30e842f2a90f9f1c88c84f4d with delete_type TABLET_DATA_DELETED (replaced by tablet ec3d52299b7945cdbedbc89be7f174c5) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:09.762367 9943 tablet_replica.cc:333] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:09.763595 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet 61aef86a30e842f2a90f9f1c88c84f4d with delete_type TABLET_DATA_DELETED (replaced by tablet ec3d52299b7945cdbedbc89be7f174c5) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.766969 9943 raft_consensus.cc:2243] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:09.767257 9943 raft_consensus.cc:2272] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 14:55:09.767488 8775 catalog_manager.cc:4952] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet c8af1d0b67424bec90b59863a975254e because the tablet was not found. No further retry: Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:55:09.767917 9943 ts_tablet_manager.cc:1916] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:09.770651 9944 ts_tablet_manager.cc:1929] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:09.770864 9944 log.cc:1199] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/bcd7d00fa01f4a9cbdf0d505684dab0e
I20251215 14:55:09.772396 9944 ts_tablet_manager.cc:1950] T bcd7d00fa01f4a9cbdf0d505684dab0e P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:09.778791 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet bcd7d00fa01f4a9cbdf0d505684dab0e (table default.Table_f9cf4c41c7b846e88bae24711ee3421a [id=c427c258b3b443eea28d804f57a2bb30]) successfully deleted
I20251215 14:55:09.779844 10021 raft_consensus.cc:493] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:09.780032 10033 raft_consensus.cc:493] T 188eb879e7c3479ea71c5b1864400243 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:09.780743 8775 catalog_manager.cc:4952] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 61aef86a30e842f2a90f9f1c88c84f4d because the tablet was not found. No further retry: Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:55:09.787259 10033 raft_consensus.cc:515] T 188eb879e7c3479ea71c5b1864400243 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.788043 10033 leader_election.cc:290] T 188eb879e7c3479ea71c5b1864400243 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:09.788918 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "188eb879e7c3479ea71c5b1864400243" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:09.789525 10003 consensus_queue.cc:1048] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.130s
I20251215 14:55:09.790612 10021 raft_consensus.cc:515] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.791373 9003 tablet_service.cc:1505] Processing CreateTablet for tablet c8b49b3d98ef4e0988e9019fe82f8727 (DEFAULT_TABLE table=default.Table_719f72c4c7e64ba5b4e1b29b3b9862a0 [id=bc5242d996ad40d9a5c32f16904e1b0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.791424 9020 tablet_service.cc:1505] Processing CreateTablet for tablet 2ebdaff1fcbe4b27b6da28f010d1af1a (DEFAULT_TABLE table=default.Table_e566b27e9ad74847a5e198bb1a5d13f7 [id=84fc0206dc0f4b9fa754dd702fb2a5e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.792253 9003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8b49b3d98ef4e0988e9019fe82f8727. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.793452 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ebdaff1fcbe4b27b6da28f010d1af1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.793620 10021 leader_election.cc:290] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:09.783479 8975 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.Ping -> {remote=127.8.121.190:44279, user_credentials={real_user=slave}} blocked reactor thread for 224635us
I20251215 14:55:09.796191 9971 raft_consensus.cc:493] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:09.796381 9971 raft_consensus.cc:515] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.797020 9971 leader_election.cc:290] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:09.798185 9435 tablet_bootstrap.cc:492] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:09.798382 9435 ts_tablet_manager.cc:1403] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.452s user 0.035s sys 0.094s
I20251215 14:55:09.799253 9435 raft_consensus.cc:359] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.799528 9435 raft_consensus.cc:385] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.799665 9435 raft_consensus.cc:740] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.799996 9435 consensus_queue.cc:260] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.801432 9284 tablet_service.cc:1505] Processing CreateTablet for tablet 745482d5b350403c97621609e6935340 (DEFAULT_TABLE table=default.Table_000f958eb97a4a8a93fb9520a90c485c [id=12862c38a8714a2085f46f70be0a0cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.801872 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 745482d5b350403c97621609e6935340. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.804165 9435 ts_tablet_manager.cc:1434] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20251215 14:55:09.805724 9435 tablet_bootstrap.cc:492] T 96b2d20fd2304e7a9995206a043b7944 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:09.814114 9277 tablet_service.cc:1505] Processing CreateTablet for tablet 396fe2752398427f840998609beba351 (DEFAULT_TABLE table=default.Table_6f9a4bda466c4244b9c239e6b4bd7fe0 [id=c79ddfc952124f1eb17830e27bd35861]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.814622 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 396fe2752398427f840998609beba351. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.815112 9291 tablet_service.cc:1505] Processing CreateTablet for tablet 7fd7f0ff96c54765926c6d45ea6a20a5 (DEFAULT_TABLE table=default.Table_c6d8ee8140464d86871ee6cc6141fce3 [id=b8f83f4568c640608f0c4b93ff59584d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.815500 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd7f0ff96c54765926c6d45ea6a20a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.819036 8786 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 0b31cb8e81934b07bb668efbff9f6a76
I20251215 14:55:09.825292 9291 tablet_service.cc:1505] Processing CreateTablet for tablet bc9c699d00b64239b3190e57f0f42011 (DEFAULT_TABLE table=default.Table_6a2c679c707b486c9d57cc2900b26575 [id=1d04a1d862f24c24bc2e9ae5bb5922f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.825660 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc9c699d00b64239b3190e57f0f42011. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.828501 9294 tablet_service.cc:1505] Processing CreateTablet for tablet e9353aff4c0742c191b37d3a412ed411 (DEFAULT_TABLE table=default.Table_9bc811b3caa448e2b7cf83094f1ba245 [id=ec4265755f604ee3b8ca72186d9ec98a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.830598 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9353aff4c0742c191b37d3a412ed411. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:09.831794 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet f7af1f66c4f04f649379758ff1b3e387
W20251215 14:55:09.831947 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 188eb879e7c3479ea71c5b1864400243
W20251215 14:55:09.832031 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 062a482917794ae5a67ec685a2491ba2
W20251215 14:55:09.836763 8779 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 032f27e7f6054188a3169a3c10ee4d09 consensus state has no leader
I20251215 14:55:09.841362 9435 tablet_bootstrap.cc:654] T 96b2d20fd2304e7a9995206a043b7944 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.842694 9284 tablet_service.cc:1505] Processing CreateTablet for tablet 07fafc0eab704e42a793eeb32ac9a7d6 (DEFAULT_TABLE table=default.Table_c15ea76b3b6f41419688ef6bc1f667cf [id=1225a7d23a0040b0a3103fbc1f9c5962]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.843338 9277 tablet_service.cc:1505] Processing CreateTablet for tablet bee9a28b78184d4893a845120670e302 (DEFAULT_TABLE table=default.Table_b7af23e2b15b483b86f9bc4b3b65802b [id=5f025e0ed993425393a7475fb52ef5ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.845120 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07fafc0eab704e42a793eeb32ac9a7d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.846532 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee9a28b78184d4893a845120670e302. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.851397 9015 tablet_service.cc:1505] Processing CreateTablet for tablet f4203c4941184a66956ec9be8d703bb6 (DEFAULT_TABLE table=default.Table_46f35067e409451fb9ba912af7baed94 [id=89af833f92c9454b9ebc760496bf5995]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.852258 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "194bb745ecb849cb9092fee1afb7dbe6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:09.858598 9021 tablet_service.cc:1505] Processing CreateTablet for tablet c4660d4e5cb84f3a983922c0b4aef90b (DEFAULT_TABLE table=default.Table_f191a21e4c4f41c2910805786164e8ff [id=e48472bbf65e450da681976f5eef3d3e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.862982 9285 tablet_service.cc:1505] Processing CreateTablet for tablet a7cb14a555914e25a50d98d13267c296 (DEFAULT_TABLE table=default.Table_68741bcb63154f56abf551a2c960108c [id=d82de41de697469ea6aa74cbf359fc4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.863415 9285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7cb14a555914e25a50d98d13267c296. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.866190 9507 raft_consensus.cc:493] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:09.866539 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30c5c795ea4a4fe591cdf63320ec2521" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:09.871616 9507 raft_consensus.cc:515] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.872263 9507 leader_election.cc:290] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:09.873741 8781 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_8f94c89c96d2444e82c9681f3a6ef372" } new_table_name: "default.Table_1d4e6d3c6cb74511b929a8c022624c33" modify_external_catalogs: true
I20251215 14:55:09.873801 8782 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_aba7a90daaf544eb972bd7349f27ae63" } new_table_name: "default.Table_a1e03b46c6e04ebbb7a47128968fb6de" modify_external_catalogs: true
I20251215 14:55:09.876159 9017 tablet_service.cc:1505] Processing CreateTablet for tablet 1cb23f66c1b94751a9557e8b426dd434 (DEFAULT_TABLE table=default.Table_3a3de1a36ece4604ba7c47a47664499a [id=c157580aaa09416fbf64b7dc61b93a80]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.880275 9009 tablet_service.cc:1505] Processing CreateTablet for tablet 56f600c59b094e4f96acec978911a8a7 (DEFAULT_TABLE table=default.Table_ddea9e06b72a43758693e2b1f32c1b15 [id=3c4a8527ae214b3c8659ce02a13d10f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.880525 9435 tablet_bootstrap.cc:492] T 96b2d20fd2304e7a9995206a043b7944 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:09.880686 9435 ts_tablet_manager.cc:1403] T 96b2d20fd2304e7a9995206a043b7944 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.075s user 0.007s sys 0.009s
I20251215 14:55:09.880946 9034 raft_consensus.cc:2468] T 194bb745ecb849cb9092fee1afb7dbe6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
W20251215 14:55:09.881240 8781 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ec16a234222470bb9cf8c29db536cc1 consensus state has no leader
I20251215 14:55:09.881505 9435 raft_consensus.cc:359] T 96b2d20fd2304e7a9995206a043b7944 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.881695 9435 raft_consensus.cc:385] T 96b2d20fd2304e7a9995206a043b7944 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.881755 9435 raft_consensus.cc:740] T 96b2d20fd2304e7a9995206a043b7944 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.881991 9435 consensus_queue.cc:260] T 96b2d20fd2304e7a9995206a043b7944 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.885475 9435 ts_tablet_manager.cc:1434] T 96b2d20fd2304e7a9995206a043b7944 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20251215 14:55:09.886564 9435 tablet_bootstrap.cc:492] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:09.887848 9285 tablet_service.cc:1552] Processing DeleteTablet for tablet 96b2d20fd2304e7a9995206a043b7944 with delete_type TABLET_DATA_DELETED (replaced by tablet 6140a160980d49b09a5fda8475fc144f) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:09.888146 9435 tablet_bootstrap.cc:654] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:09.888512 9018 tablet_service.cc:1505] Processing CreateTablet for tablet a2a58a13b66641b0bdc710cf5d458689 (DEFAULT_TABLE table=default.Table_c4eaf4a0d8ed44e0ba7d485098c3e9aa [id=b44efd4bfd8144388a8c45c3bc91455a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.889191 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4203c4941184a66956ec9be8d703bb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.891462 9944 tablet_replica.cc:333] T 96b2d20fd2304e7a9995206a043b7944 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:09.891673 9944 raft_consensus.cc:2243] T 96b2d20fd2304e7a9995206a043b7944 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:09.891875 9944 raft_consensus.cc:2272] T 96b2d20fd2304e7a9995206a043b7944 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:09.892956 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2a58a13b66641b0bdc710cf5d458689. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.895326 9427 tablet_bootstrap.cc:492] T 4c96b655cf284326ae3fa2a165e2bf95 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:09.896453 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f121a14828e6443695960c0e540ae573" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:09.897328 9009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56f600c59b094e4f96acec978911a8a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.900425 9014 tablet_service.cc:1505] Processing CreateTablet for tablet a93d01ea31a64dc2a8d8b03884675024 (DEFAULT_TABLE table=default.Table_1575d3d624744c93a3dc41685842aca0 [id=04a10d805635468082ccf52d466f24fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.900794 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93d01ea31a64dc2a8d8b03884675024. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.903081 9944 ts_tablet_manager.cc:1916] T 96b2d20fd2304e7a9995206a043b7944 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:09.905616 9427 ts_tablet_manager.cc:1403] T 4c96b655cf284326ae3fa2a165e2bf95 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.504s user 0.076s sys 0.110s
I20251215 14:55:09.905568 8779 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_7fa1b2c1e53d43159ab9cd514864b006" } new_table_name: "default.Table_3b14c63de5274e12a94726cb1c368a36" modify_external_catalogs: true
I20251215 14:55:09.906404 9016 tablet_service.cc:1505] Processing CreateTablet for tablet f4ec165149a74778aee1fb39c4d96871 (DEFAULT_TABLE table=default.Table_59a89434b3b24db2905384e5da65e1a0 [id=cecf067caefb4060a3b00733628e14d7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.905540 8783 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_3b83163b30384377a042e449398cc9e0" } modify_external_catalogs: true
I20251215 14:55:09.906922 8783 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_3b83163b30384377a042e449398cc9e0" } modify_external_catalogs: true
I20251215 14:55:09.909171 8788 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_a68d34f520064abe9fb31e83e0162483" } modify_external_catalogs: true
I20251215 14:55:09.909335 8788 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_a68d34f520064abe9fb31e83e0162483" } modify_external_catalogs: true
I20251215 14:55:09.909340 8782 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_bec53ce4c0c04be8bb0aabb4ce60974b" } modify_external_catalogs: true
I20251215 14:55:09.910014 8782 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_bec53ce4c0c04be8bb0aabb4ce60974b" } modify_external_catalogs: true
I20251215 14:55:09.905493 8781 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e11c28b153a64c73acb0610cea4c60dd" } new_table_name: "default.Table_d42fe6d18cbb4914a8e4f9049c87ffe8" modify_external_catalogs: true
I20251215 14:55:09.911577 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 46bd8e49fff5473f8787742f6023ddbe (DEFAULT_TABLE table=default.Table_b7e8e496ff654bdea9558a04abb32447 [id=1c28164ca77c4db9b53fe9e8c0f98e78]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.912467 9008 tablet_service.cc:1552] Processing DeleteTablet for tablet 5bfe8cc0805247de9df4a59d461818f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.913283 9007 tablet_service.cc:1505] Processing CreateTablet for tablet 745482d5b350403c97621609e6935340 (DEFAULT_TABLE table=default.Table_000f958eb97a4a8a93fb9520a90c485c [id=12862c38a8714a2085f46f70be0a0cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.913589 9021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4660d4e5cb84f3a983922c0b4aef90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.914688 9006 tablet_service.cc:1505] Processing CreateTablet for tablet 7f9c173d11f1449b829a54190313bea3 (DEFAULT_TABLE table=default.Table_07de59922021486886fb112cbc06c493 [id=1ff1a56115104321ba6aafed10d1506d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.915094 9010 tablet_service.cc:1552] Processing DeleteTablet for tablet a93d01ea31a64dc2a8d8b03884675024 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.915491 9022 tablet_service.cc:1505] Processing CreateTablet for tablet e9353aff4c0742c191b37d3a412ed411 (DEFAULT_TABLE table=default.Table_ca2a9c1da0264e1eb4e1b13acfed1ece [id=ec4265755f604ee3b8ca72186d9ec98a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.916297 8783 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 90660799e0cc4ce3bda91bbb7e734ac3
I20251215 14:55:09.916601 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_764ac5e43afb4f7b92907c505f8c2d6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:09.916714 9005 tablet_service.cc:1505] Processing CreateTablet for tablet 14ac26b3a02449f8a7588151abe7ae10 (DEFAULT_TABLE table=default.Table_8ee3cade1b94484b8cdf7579a865f570 [id=148c3bbaa3d845efad3703f604e36032]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:09.917140 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_764ac5e43afb4f7b92907c505f8c2d6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:09.916723 8779 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e9124dd3d98947b29289e0561976ada4 consensus state has no leader
I20251215 14:55:09.918565 9010 tablet_service.cc:1552] Processing DeleteTablet for tablet a2a58a13b66641b0bdc710cf5d458689 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.918946 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46bd8e49fff5473f8787742f6023ddbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.919721 9005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14ac26b3a02449f8a7588151abe7ae10. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.922818 8788 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet f9a0c31abcf046c9b76bea3f946ba9fc
I20251215 14:55:09.923017 9010 tablet_service.cc:1552] Processing DeleteTablet for tablet 82ca60c5a63744ffb0a0c0a140ef665e with delete_type TABLET_DATA_DELETED (replaced by tablet 90c7925890474a76b35a3ce5e6db8ebf) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.923235 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 745482d5b350403c97621609e6935340. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.924227 8782 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet c7f760639a664cfb9f4af5578154b981
I20251215 14:55:09.924702 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9353aff4c0742c191b37d3a412ed411. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.925403 9006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9c173d11f1449b829a54190313bea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.926450 9010 tablet_service.cc:1552] Processing DeleteTablet for tablet 66f2c74e55f04a6fa4b2c238c0a6b901 with delete_type TABLET_DATA_DELETED (replaced by tablet b9c074f12b3c4abaa39fe3412df7fe02) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.926631 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet 123361ef48714d859ee5ac85c3c37d08 with delete_type TABLET_DATA_DELETED (replaced by tablet 3bd33107c2ed4b27841f3e1ece1df152) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.926980 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4ec165149a74778aee1fb39c4d96871. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.927922 9017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cb23f66c1b94751a9557e8b426dd434. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.928205 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_4b3832fa06ed4ca9b9aaaceeb07c1c3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.928731 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b3832fa06ed4ca9b9aaaceeb07c1c3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.928838 9427 raft_consensus.cc:359] T 4c96b655cf284326ae3fa2a165e2bf95 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.929016 9427 raft_consensus.cc:385] T 4c96b655cf284326ae3fa2a165e2bf95 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.929111 9427 raft_consensus.cc:740] T 4c96b655cf284326ae3fa2a165e2bf95 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.929350 9427 consensus_queue.cc:260] T 4c96b655cf284326ae3fa2a165e2bf95 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.930075 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet bcd7d00fa01f4a9cbdf0d505684dab0e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:09.933781 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_37a4070d85974aa6a6cc25f78196a7c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.934458 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37a4070d85974aa6a6cc25f78196a7c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.935827 9013 tablet_service.cc:1505] Processing CreateTablet for tablet 396fe2752398427f840998609beba351 (DEFAULT_TABLE table=default.Table_6f9a4bda466c4244b9c239e6b4bd7fe0 [id=c79ddfc952124f1eb17830e27bd35861]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.936218 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 396fe2752398427f840998609beba351. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.936930 9010 tablet_service.cc:1505] Processing CreateTablet for tablet 7fd7f0ff96c54765926c6d45ea6a20a5 (DEFAULT_TABLE table=default.Table_c6d8ee8140464d86871ee6cc6141fce3 [id=b8f83f4568c640608f0c4b93ff59584d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.937304 9010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd7f0ff96c54765926c6d45ea6a20a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:09.937659 8781 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 25615ca6c21d4d5f8880d3dff4253e61 has no consensus state
I20251215 14:55:09.938519 9004 tablet_service.cc:1505] Processing CreateTablet for tablet bc9c699d00b64239b3190e57f0f42011 (DEFAULT_TABLE table=default.Table_6a2c679c707b486c9d57cc2900b26575 [id=1d04a1d862f24c24bc2e9ae5bb5922f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.938874 9004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc9c699d00b64239b3190e57f0f42011. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.938949 9040 raft_consensus.cc:3060] T 188eb879e7c3479ea71c5b1864400243 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:09.940332 9012 tablet_service.cc:1505] Processing CreateTablet for tablet 07fafc0eab704e42a793eeb32ac9a7d6 (DEFAULT_TABLE table=default.Table_c15ea76b3b6f41419688ef6bc1f667cf [id=1225a7d23a0040b0a3103fbc1f9c5962]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.940671 9012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07fafc0eab704e42a793eeb32ac9a7d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.940610 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7af1f66c4f04f649379758ff1b3e387" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:09.943562 9034 raft_consensus.cc:3060] T 4c96b655cf284326ae3fa2a165e2bf95 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:09.944191 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7af1f66c4f04f649379758ff1b3e387" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:09.944664 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30c5c795ea4a4fe591cdf63320ec2521" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:09.947870 9014 tablet_service.cc:1505] Processing CreateTablet for tablet 6140a160980d49b09a5fda8475fc144f (DEFAULT_TABLE table=default.Table_42e5c1011ba64c0b9602eed064c8ecbd [id=4343a6c3acc545d7be8d3b7ec617da90]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.956224 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18cd1f63d51e4565bb8c55be13e3e099" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:09.957062 9426 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.516s user 0.050s sys 0.110s
W20251215 14:55:09.957168 9426 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.584s user 0.050s sys 0.110s
I20251215 14:55:09.961730 8788 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_04a63cbcd13a48149362dc372ce3cd76" } modify_external_catalogs: true
I20251215 14:55:09.961928 8788 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_04a63cbcd13a48149362dc372ce3cd76" } modify_external_catalogs: true
I20251215 14:55:09.963240 9170 raft_consensus.cc:2468] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:09.964347 9150 tablet_service.cc:1505] Processing CreateTablet for tablet 396fe2752398427f840998609beba351 (DEFAULT_TABLE table=default.Table_6f9a4bda466c4244b9c239e6b4bd7fe0 [id=c79ddfc952124f1eb17830e27bd35861]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:09.965193 9115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 83054.1us
I20251215 14:55:09.965106 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_670861e659694b79a9225aba5f756f78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.965696 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_670861e659694b79a9225aba5f756f78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.966606 9150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 396fe2752398427f840998609beba351. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.967254 9149 tablet_service.cc:1505] Processing CreateTablet for tablet 7fd7f0ff96c54765926c6d45ea6a20a5 (DEFAULT_TABLE table=default.Table_c6d8ee8140464d86871ee6cc6141fce3 [id=b8f83f4568c640608f0c4b93ff59584d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.967495 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_a6e5907883f24cdbb16a9e092c46e70c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:09.967936 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6e5907883f24cdbb16a9e092c46e70c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:09.975234 9155 tablet_service.cc:1505] Processing CreateTablet for tablet bc9c699d00b64239b3190e57f0f42011 (DEFAULT_TABLE table=default.Table_6a2c679c707b486c9d57cc2900b26575 [id=1d04a1d862f24c24bc2e9ae5bb5922f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.975589 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc9c699d00b64239b3190e57f0f42011. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.981045 9426 tablet_bootstrap.cc:492] T 38e50a7f2bdd4907ab41436b59397ea6 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:09.981195 9426 ts_tablet_manager.cc:1403] T 38e50a7f2bdd4907ab41436b59397ea6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.621s user 0.050s sys 0.110s
I20251215 14:55:09.982021 9426 raft_consensus.cc:359] T 38e50a7f2bdd4907ab41436b59397ea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.982213 9426 raft_consensus.cc:385] T 38e50a7f2bdd4907ab41436b59397ea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:09.982295 9426 raft_consensus.cc:740] T 38e50a7f2bdd4907ab41436b59397ea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:09.982488 9426 consensus_queue.cc:260] T 38e50a7f2bdd4907ab41436b59397ea6 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:09.983033 9426 ts_tablet_manager.cc:1434] T 38e50a7f2bdd4907ab41436b59397ea6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:09.986452 9152 tablet_service.cc:1505] Processing CreateTablet for tablet 07fafc0eab704e42a793eeb32ac9a7d6 (DEFAULT_TABLE table=default.Table_c15ea76b3b6f41419688ef6bc1f667cf [id=1225a7d23a0040b0a3103fbc1f9c5962]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.988633 9943 ts_tablet_manager.cc:1929] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:09.989779 9144 tablet_service.cc:1505] Processing CreateTablet for tablet 307f788967bd48e2b442657806e87fc4 (DEFAULT_TABLE table=default.Table_6a398e13d9004d1a9f157e19e8a20496 [id=a21588ac81434f0cb91067532e324086]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.993577 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7fd7f0ff96c54765926c6d45ea6a20a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:09.994001 9143 tablet_service.cc:1505] Processing CreateTablet for tablet bee9a28b78184d4893a845120670e302 (DEFAULT_TABLE table=default.Table_b7af23e2b15b483b86f9bc4b3b65802b [id=5f025e0ed993425393a7475fb52ef5ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.994096 9152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07fafc0eab704e42a793eeb32ac9a7d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.002375 9943 log.cc:1199] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/bcd7d00fa01f4a9cbdf0d505684dab0e
I20251215 14:55:09.953694 9020 tablet_service.cc:1505] Processing CreateTablet for tablet bee9a28b78184d4893a845120670e302 (DEFAULT_TABLE table=default.Table_b7af23e2b15b483b86f9bc4b3b65802b [id=5f025e0ed993425393a7475fb52ef5ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.955489 9011 tablet_service.cc:1505] Processing CreateTablet for tablet 307f788967bd48e2b442657806e87fc4 (DEFAULT_TABLE table=default.Table_6a398e13d9004d1a9f157e19e8a20496 [id=a21588ac81434f0cb91067532e324086]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.003549 10019 raft_consensus.cc:493] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:10.003687 9115 leader_election.cc:343] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099
I20251215 14:55:09.956166 9003 tablet_service.cc:1505] Processing CreateTablet for tablet a7cb14a555914e25a50d98d13267c296 (DEFAULT_TABLE table=default.Table_68741bcb63154f56abf551a2c960108c [id=d82de41de697469ea6aa74cbf359fc4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:09.965654 8976 leader_election.cc:304] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:09.992153 9427 ts_tablet_manager.cc:1434] T 4c96b655cf284326ae3fa2a165e2bf95 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.086s user 0.001s sys 0.001s
I20251215 14:55:10.004225 9426 tablet_bootstrap.cc:492] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:10.004758 9151 tablet_service.cc:1505] Processing CreateTablet for tablet 798eb606957b4cf7a737ec1636437581 (DEFAULT_TABLE table=default.Table_ce00bfcd8c0b40fa8afa1518fece6bbe [id=ffada5142b9a4e76b91fed44a45b5382]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.006332 9145 tablet_service.cc:1505] Processing CreateTablet for tablet a7cb14a555914e25a50d98d13267c296 (DEFAULT_TABLE table=default.Table_68741bcb63154f56abf551a2c960108c [id=d82de41de697469ea6aa74cbf359fc4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.008852 9943 ts_tablet_manager.cc:1950] T bcd7d00fa01f4a9cbdf0d505684dab0e P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:10.009104 10019 raft_consensus.cc:515] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.012960 10003 raft_consensus.cc:493] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:10.013160 10003 raft_consensus.cc:515] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.016065 9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 307f788967bd48e2b442657806e87fc4. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:10.017117 8976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 48052.2us
I20251215 14:55:10.017271 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet f9a0c31abcf046c9b76bea3f946ba9fc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:10.018019 9148 tablet_service.cc:1505] Processing CreateTablet for tablet c902ad68a5c448828eb3ac419ffaca81 (DEFAULT_TABLE table=default.Table_83a4b5504c4e4edbb77b41a026d2e0eb [id=32798bf845984b728fadcd6f367fb82f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.018471 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 6be5f3269d9147d780f782bb5665b8b6 (DEFAULT_TABLE table=default.Table_b45cbd9a2f644f35812619a39ec8dead [id=83e7f51efbc94b839b64eff74405556c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.018675 9427 tablet_bootstrap.cc:492] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:10.020838 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
I20251215 14:55:10.022676 9156 tablet_service.cc:1505] Processing CreateTablet for tablet de24f0b914304135bebcdb09e9b2f2f9 (DEFAULT_TABLE table=default.Table_1cd84143b1334ccabfe606ad41e253e6 [id=b4f431623855476692c2054a6f85dba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.023350 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_76504ec078d84ab089b69c745feea5ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:10.023502 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_47af3ae3eb6842989fb577f2c63e95af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:10.023677 8784 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_719f72c4c7e64ba5b4e1b29b3b9862a0" } modify_external_catalogs: true
I20251215 14:55:10.023816 8784 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_719f72c4c7e64ba5b4e1b29b3b9862a0" } modify_external_catalogs: true
W20251215 14:55:10.023963 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76504ec078d84ab089b69c745feea5ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:10.024044 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47af3ae3eb6842989fb577f2c63e95af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.024303 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_29d5bb2dae4a45a3b86f0e8f5b69dc0a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:10.024772 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_29d5bb2dae4a45a3b86f0e8f5b69dc0a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.025336 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_69b5e5c77c4b4399ba828d29b6f1c05b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:10.026036 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69b5e5c77c4b4399ba828d29b6f1c05b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.026904 9143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee9a28b78184d4893a845120670e302. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.028210 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet c7f760639a664cfb9f4af5578154b981 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:10.028909 10019 leader_election.cc:290] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:10.029794 9283 tablet_service.cc:1505] Processing CreateTablet for tablet 798eb606957b4cf7a737ec1636437581 (DEFAULT_TABLE table=default.Table_ce00bfcd8c0b40fa8afa1518fece6bbe [id=ffada5142b9a4e76b91fed44a45b5382]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.030251 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798eb606957b4cf7a737ec1636437581. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.033757 9145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7cb14a555914e25a50d98d13267c296. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.036021 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_6635d000c2944e4d983b4796c36724bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:10.036679 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6635d000c2944e4d983b4796c36724bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.036690 9970 raft_consensus.cc:493] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:10.037173 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 307f788967bd48e2b442657806e87fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.038374 9160 tablet_service.cc:1505] Processing CreateTablet for tablet df30b9f793bf4232ba848f569100a747 (DEFAULT_TABLE table=default.Table_c1335c74e0f740b08e701ac0246125f0 [id=a4fa8fe05f924de6b14bcc04e80479ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.039884 8787 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_6a2c679c707b486c9d57cc2900b26575" } new_table_name: "default.Table_c01c8c15541e45b98fa0cb0fa7502dac" modify_external_catalogs: true
I20251215 14:55:10.038755 9291 tablet_service.cc:1505] Processing CreateTablet for tablet 307f788967bd48e2b442657806e87fc4 (DEFAULT_TABLE table=default.Table_6a398e13d9004d1a9f157e19e8a20496 [id=a21588ac81434f0cb91067532e324086]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.047204 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95caeaf32d154c0ba4c88dd3f295876d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:10.048429 9981 consensus_queue.cc:1048] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:10.049026 9943 tablet_replica.cc:333] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:10.051106 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 307f788967bd48e2b442657806e87fc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.052152 9676 raft_consensus.cc:493] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:10.054407 9142 tablet_service.cc:1505] Processing CreateTablet for tablet ca2bba36b0f54aadb3980aa41dfd0eb0 (DEFAULT_TABLE table=default.Table_ba8f8beb36af4b6ab3fc11419c5c3531 [id=9db10c7c96104a7fb7ab0c44c2911d2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.058471 9148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c902ad68a5c448828eb3ac419ffaca81. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.058770 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bafc5063058a469bb9c9b3e5345eb1be" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:10.061084 9153 tablet_service.cc:1505] Processing CreateTablet for tablet 437ccec0421f4bdfb8c7e6a2fcb44bca (DEFAULT_TABLE table=default.Table_f1ea3f5f6d5e42d28a025fbdbacc1f34 [id=e6d2d070235642c9850a41eb91546362]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.061460 9943 raft_consensus.cc:2243] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:10.068850 9970 raft_consensus.cc:515] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.069615 9970 leader_election.cc:290] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:10.071642 10021 raft_consensus.cc:493] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:10.071785 10021 raft_consensus.cc:515] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.073661 9315 raft_consensus.cc:2468] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:10.074353 9676 raft_consensus.cc:515] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.074957 9676 leader_election.cc:290] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:10.082795 10134 raft_consensus.cc:2804] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:10.082919 10134 raft_consensus.cc:493] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:10.083026 10134 raft_consensus.cc:3060] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.086752 9944 ts_tablet_manager.cc:1929] T 96b2d20fd2304e7a9995206a043b7944 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:10.087056 9944 log.cc:1199] T 96b2d20fd2304e7a9995206a043b7944 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/96b2d20fd2304e7a9995206a043b7944
I20251215 14:55:10.092125 9016 tablet_service.cc:1505] Processing CreateTablet for tablet 6be5f3269d9147d780f782bb5665b8b6 (DEFAULT_TABLE table=default.Table_b45cbd9a2f644f35812619a39ec8dead [id=83e7f51efbc94b839b64eff74405556c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.088259 9285 tablet_service.cc:1505] Processing CreateTablet for tablet de24f0b914304135bebcdb09e9b2f2f9 (DEFAULT_TABLE table=default.Table_1cd84143b1334ccabfe606ad41e253e6 [id=b4f431623855476692c2054a6f85dba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.092911 10003 leader_election.cc:290] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:10.095440 9285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de24f0b914304135bebcdb09e9b2f2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.096300 9944 ts_tablet_manager.cc:1950] T 96b2d20fd2304e7a9995206a043b7944 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:10.101521 9022 tablet_service.cc:1505] Processing CreateTablet for tablet 798eb606957b4cf7a737ec1636437581 (DEFAULT_TABLE table=default.Table_ce00bfcd8c0b40fa8afa1518fece6bbe [id=ffada5142b9a4e76b91fed44a45b5382]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.102497 9676 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:10.102619 9676 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.103229 9676 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:10.103533 8788 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 5dd36ea0aa53460f9c1fda4b31063fa7
I20251215 14:55:10.103967 9015 tablet_service.cc:1505] Processing CreateTablet for tablet c902ad68a5c448828eb3ac419ffaca81 (DEFAULT_TABLE table=default.Table_83a4b5504c4e4edbb77b41a026d2e0eb [id=32798bf845984b728fadcd6f367fb82f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.104285 8788 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_42e5c1011ba64c0b9602eed064c8ecbd" } new_table_name: "default.Table_5a4daafd564942cfa496f1201983f9e8" modify_external_catalogs: true
I20251215 14:55:10.107888 9019 tablet_service.cc:1552] Processing DeleteTablet for tablet c7f760639a664cfb9f4af5578154b981 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:10.108302 9019 tablet_service.cc:1505] Processing CreateTablet for tablet a1c5659fd65f40b0ab72c164afb8d3fe (DEFAULT_TABLE table=default.Table_0e8139618d4747388370f15f67fc9fa2 [id=31a55ff8938c40279d2091ce1d0598c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.109289 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee9a28b78184d4893a845120670e302. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.113066 9004 tablet_service.cc:1552] Processing DeleteTablet for tablet f9a0c31abcf046c9b76bea3f946ba9fc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:10.115142 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6140a160980d49b09a5fda8475fc144f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.120087 9018 tablet_service.cc:1505] Processing CreateTablet for tablet 437ccec0421f4bdfb8c7e6a2fcb44bca (DEFAULT_TABLE table=default.Table_f1ea3f5f6d5e42d28a025fbdbacc1f34 [id=e6d2d070235642c9850a41eb91546362]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.123008 9006 tablet_service.cc:1505] Processing CreateTablet for tablet de24f0b914304135bebcdb09e9b2f2f9 (DEFAULT_TABLE table=default.Table_1cd84143b1334ccabfe606ad41e253e6 [id=b4f431623855476692c2054a6f85dba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.129629 8782 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_05d3398565e643659ed17d3e282bae1d" } new_table_name: "default.Table_3e9e6e3198074dafb1f68a49d5fe8fbc" modify_external_catalogs: true
I20251215 14:55:10.130025 8779 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_37bdefb7cdb34904ac81a47dd467abe9" } modify_external_catalogs: true
I20251215 14:55:10.130260 8779 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_37bdefb7cdb34904ac81a47dd467abe9" } modify_external_catalogs: true
I20251215 14:55:10.131593 8781 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_70b30cfea42546a2be4d9bcc5925c6f3" } new_table_name: "default.Table_6636b9f6676f4832ad6ddbf09735cbdb" modify_external_catalogs: true
I20251215 14:55:10.131984 8678 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
/tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.121.190:44279
--webserver_interface=127.8.121.190
--webserver_port=40239
--builtin_ntp_servers=127.8.121.148:35915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20251215 14:55:10.132864 8787 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc9c699d00b64239b3190e57f0f42011 consensus state has no leader
I20251215 14:55:10.134038 8787 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c42301ca90e643bdb1c34a89b930c3f9" } modify_external_catalogs: true
I20251215 14:55:10.134224 8787 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c42301ca90e643bdb1c34a89b930c3f9" } modify_external_catalogs: true
I20251215 14:55:10.135443 8786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_52ac8cc4c4294a57a57b129861367764" } modify_external_catalogs: true
I20251215 14:55:10.135577 8784 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet c8b49b3d98ef4e0988e9019fe82f8727
I20251215 14:55:10.135633 8786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_52ac8cc4c4294a57a57b129861367764" } modify_external_catalogs: true
W20251215 14:55:10.145128 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 5f03dfdd546c492185c6c31866a090a5
I20251215 14:55:10.145749 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_cea06d4fba344de4aa4165c004aa5b46"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:10.146366 8780 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_26f1e6862cc04d2d90fa8651f5d7e480" } new_table_name: "default.Table_8c3b34c92edb417c8735a42c25a8ff02" modify_external_catalogs: true
W20251215 14:55:10.146391 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cea06d4fba344de4aa4165c004aa5b46 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:10.153960 8788 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6140a160980d49b09a5fda8475fc144f consensus state has no leader
I20251215 14:55:10.155638 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_197581ae0a7e4231b70573029ab493d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:10.156255 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_197581ae0a7e4231b70573029ab493d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.156909 9147 tablet_service.cc:1505] Processing CreateTablet for tablet 394844a49d254112883c40df9821c075 (DEFAULT_TABLE table=default.Table_15ad0aa39f5048228397e27df88eea2f [id=efe5b2d15f1946cfa19f92b942b760d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.157564 9943 pending_rounds.cc:70] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3: Trying to abort 1 pending ops.
I20251215 14:55:10.157644 9943 pending_rounds.cc:77] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232759845924184064 op_type: NO_OP noop_request { }
I20251215 14:55:10.157800 9943 raft_consensus.cc:2889] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 14:55:10.157857 9435 tablet_bootstrap.cc:492] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:10.157922 9943 raft_consensus.cc:2272] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:10.158028 9435 ts_tablet_manager.cc:1403] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.272s user 0.027s sys 0.058s
I20251215 14:55:10.162282 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18cd1f63d51e4565bb8c55be13e3e099" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:10.163343 9435 raft_consensus.cc:359] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.164383 9435 raft_consensus.cc:385] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.164855 9435 raft_consensus.cc:740] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.162490 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95caeaf32d154c0ba4c88dd3f295876d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:10.166232 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_76f6988924774fdb88994322136b609d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:10.165838 9435 consensus_queue.cc:260] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.166436 9003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7cb14a555914e25a50d98d13267c296. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:10.166790 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76f6988924774fdb88994322136b609d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.166515 9004 tablet_service.cc:1505] Processing CreateTablet for tablet df30b9f793bf4232ba848f569100a747 (DEFAULT_TABLE table=default.Table_c1335c74e0f740b08e701ac0246125f0 [id=a4fa8fe05f924de6b14bcc04e80479ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.167517 9004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df30b9f793bf4232ba848f569100a747. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.168043 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798eb606957b4cf7a737ec1636437581. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.168596 9006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de24f0b914304135bebcdb09e9b2f2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.169618 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c902ad68a5c448828eb3ac419ffaca81. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.171150 8785 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_3f190fdaff1446908955f4b5957a8084 [id=cbafb4499c90447d8f185928d3e58b20]). Expected version 1 got 0
I20251215 14:55:10.172065 10021 leader_election.cc:290] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:10.172405 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 155544us
I20251215 14:55:10.173130 9248 leader_election.cc:304] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:10.173498 9971 raft_consensus.cc:2804] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:10.173581 9971 raft_consensus.cc:493] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:10.173672 9971 raft_consensus.cc:3060] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.174541 8779 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 3db1ef59e1bd4b4b8c7b5ef8123af852
W20251215 14:55:10.174964 8781 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ad2bead71c9a462bbd7888774c608ba9 has no consensus state
W20251215 14:55:10.175763 8782 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb309f7c439740c89470da5636523a69 consensus state has no leader
I20251215 14:55:10.176148 9971 raft_consensus.cc:515] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.176427 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437ccec0421f4bdfb8c7e6a2fcb44bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.177146 9971 leader_election.cc:290] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:10.178136 9248 leader_election.cc:343] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.178334 9248 leader_election.cc:304] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:10.178398 10021 raft_consensus.cc:493] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:10.178655 9971 raft_consensus.cc:2749] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:10.180429 9248 leader_election.cc:343] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:10.180932 9248 leader_election.cc:343] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:10.181319 9248 leader_election.cc:343] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.182648 9971 consensus_queue.cc:1048] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:10.184388 9971 consensus_queue.cc:1048] T 188eb879e7c3479ea71c5b1864400243 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:10.185403 8786 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet f4395440383e4a7089de9f9549b59f9d
I20251215 14:55:10.185631 8787 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 9c270a78a98748dd90dd02caa3bb3a04
W20251215 14:55:10.185796 8780 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8d4d6163853448ceaff5c1954cfc64e7 has no consensus state
I20251215 14:55:10.186173 9435 ts_tablet_manager.cc:1434] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.028s user 0.003s sys 0.000s
I20251215 14:55:10.190542 9426 tablet_bootstrap.cc:654] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.191689 9154 tablet_service.cc:1505] Processing CreateTablet for tablet 6140a160980d49b09a5fda8475fc144f (DEFAULT_TABLE table=default.Table_42e5c1011ba64c0b9602eed064c8ecbd [id=4343a6c3acc545d7be8d3b7ec617da90]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.194056 9115 leader_election.cc:304] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:10.194315 9151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 798eb606957b4cf7a737ec1636437581. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:10.194813 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:10.197614 9147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394844a49d254112883c40df9821c075. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.198132 9155 tablet_service.cc:1505] Processing CreateTablet for tablet a1c5659fd65f40b0ab72c164afb8d3fe (DEFAULT_TABLE table=default.Table_0e8139618d4747388370f15f67fc9fa2 [id=31a55ff8938c40279d2091ce1d0598c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.198493 9943 ts_tablet_manager.cc:1916] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:10.199383 9157 tablet_service.cc:1505] Processing CreateTablet for tablet 032f27e7f6054188a3169a3c10ee4d09 (DEFAULT_TABLE table=default.Table_b2e5b280bc8e450f809d52261090830d [id=c3fa5f731cdc45a4bf38e7981a1f768e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.201773 9141 tablet_service.cc:1505] Processing CreateTablet for tablet 6beaf5ae37ce41fd9123d6b3560351b7 (DEFAULT_TABLE table=default.Table_78c038b3edc449fab589e43dea2d2dbf [id=2f85cc5b73384275ba2c533b1f0eeda2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.203307 9144 tablet_service.cc:1505] Processing CreateTablet for tablet eb309f7c439740c89470da5636523a69 (DEFAULT_TABLE table=default.Table_05d3398565e643659ed17d3e282bae1d [id=40b600a183744fa992c73142cd90120b]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:10.203780 9115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 102121us
I20251215 14:55:10.204242 9507 consensus_queue.cc:1048] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:10.205065 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df30b9f793bf4232ba848f569100a747. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.208945 9007 tablet_service.cc:1505] Processing CreateTablet for tablet 6beaf5ae37ce41fd9123d6b3560351b7 (DEFAULT_TABLE table=default.Table_78c038b3edc449fab589e43dea2d2dbf [id=2f85cc5b73384275ba2c533b1f0eeda2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.210915 10019 raft_consensus.cc:2804] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:10.211035 10019 raft_consensus.cc:493] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:10.211148 10019 raft_consensus.cc:3060] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.211320 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be5f3269d9147d780f782bb5665b8b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.211434 9013 tablet_service.cc:1505] Processing CreateTablet for tablet f9a0c31abcf046c9b76bea3f946ba9fc (DEFAULT_TABLE table=default.Table_a68d34f520064abe9fb31e83e0162483 [id=c0d22f90a4f046feaf4e5b11515a6b2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.213837 10019 raft_consensus.cc:515] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.214491 10019 leader_election.cc:290] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:10.217352 9153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437ccec0421f4bdfb8c7e6a2fcb44bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.220225 8784 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_3f190fdaff1446908955f4b5957a8084 [id=cbafb4499c90447d8f185928d3e58b20]). Expected version 1 got 0
I20251215 14:55:10.221320 9008 tablet_service.cc:1505] Processing CreateTablet for tablet ca2bba36b0f54aadb3980aa41dfd0eb0 (DEFAULT_TABLE table=default.Table_ba8f8beb36af4b6ab3fc11419c5c3531 [id=9db10c7c96104a7fb7ab0c44c2911d2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.223321 9141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6beaf5ae37ce41fd9123d6b3560351b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.225987 9022 tablet_service.cc:1505] Processing CreateTablet for tablet 6947983b19ee4ca59349979c6662bc1c (DEFAULT_TABLE table=default.Table_473211c2c5f644acb11bdea976d43900 [id=7e9e5ed71ca14b9e90cbc1a97a16238b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.230943 9009 tablet_service.cc:1505] Processing CreateTablet for tablet 394844a49d254112883c40df9821c075 (DEFAULT_TABLE table=default.Table_15ad0aa39f5048228397e27df88eea2f [id=efe5b2d15f1946cfa19f92b942b760d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.233639 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c5659fd65f40b0ab72c164afb8d3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.233894 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6947983b19ee4ca59349979c6662bc1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.234023 9006 tablet_service.cc:1505] Processing CreateTablet for tablet eb309f7c439740c89470da5636523a69 (DEFAULT_TABLE table=default.Table_05d3398565e643659ed17d3e282bae1d [id=40b600a183744fa992c73142cd90120b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.234365 9006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb309f7c439740c89470da5636523a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.235314 9004 tablet_service.cc:1505] Processing CreateTablet for tablet 032f27e7f6054188a3169a3c10ee4d09 (DEFAULT_TABLE table=default.Table_b2e5b280bc8e450f809d52261090830d [id=c3fa5f731cdc45a4bf38e7981a1f768e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.235742 9008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca2bba36b0f54aadb3980aa41dfd0eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.240535 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95caeaf32d154c0ba4c88dd3f295876d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
W20251215 14:55:10.240167 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 5bfe8cc0805247de9df4a59d461818f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bfe8cc0805247de9df4a59d461818f3 already in progress: creating tablet
I20251215 14:55:10.248311 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 032f27e7f6054188a3169a3c10ee4d09. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.251434 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb309f7c439740c89470da5636523a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.251672 9156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de24f0b914304135bebcdb09e9b2f2f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.252066 9314 raft_consensus.cc:3060] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.252058 9283 tablet_service.cc:1505] Processing CreateTablet for tablet 6be5f3269d9147d780f782bb5665b8b6 (DEFAULT_TABLE table=default.Table_b45cbd9a2f644f35812619a39ec8dead [id=83e7f51efbc94b839b64eff74405556c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.252485 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be5f3269d9147d780f782bb5665b8b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.252384 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c5659fd65f40b0ab72c164afb8d3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.253705 9146 tablet_service.cc:1505] Processing CreateTablet for tablet f9a0c31abcf046c9b76bea3f946ba9fc (DEFAULT_TABLE table=default.Table_a68d34f520064abe9fb31e83e0162483 [id=c0d22f90a4f046feaf4e5b11515a6b2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.254598 9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca2bba36b0f54aadb3980aa41dfd0eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.254894 9314 raft_consensus.cc:2468] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:10.255367 9115 leader_election.cc:304] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:10.258513 9285 tablet_service.cc:1505] Processing CreateTablet for tablet c902ad68a5c448828eb3ac419ffaca81 (DEFAULT_TABLE table=default.Table_83a4b5504c4e4edbb77b41a026d2e0eb [id=32798bf845984b728fadcd6f367fb82f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.259259 9285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c902ad68a5c448828eb3ac419ffaca81. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:10.260993 9249 leader_election.cc:343] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.261153 9249 leader_election.cc:304] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:10.261600 10144 raft_consensus.cc:2749] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:10.262089 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6140a160980d49b09a5fda8475fc144f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.262458 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet bcd7d00fa01f4a9cbdf0d505684dab0e (table default.Table_f9cf4c41c7b846e88bae24711ee3421a [id=c427c258b3b443eea28d804f57a2bb30]) successfully deleted
I20251215 14:55:10.264153 9146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a0c31abcf046c9b76bea3f946ba9fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.264638 9158 tablet_service.cc:1505] Processing CreateTablet for tablet d09d7ce93d074bfaa830130b31bcc594 (DEFAULT_TABLE table=default.Table_cd6f9353272f406f866b8aea97b47b52 [id=40a32fedadfe44bca3c1013ceb2b84c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.265007 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09d7ce93d074bfaa830130b31bcc594. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.272239 9435 tablet_bootstrap.cc:492] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:10.273914 9435 tablet_bootstrap.cc:654] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.279533 9149 tablet_service.cc:1505] Processing CreateTablet for tablet 6947983b19ee4ca59349979c6662bc1c (DEFAULT_TABLE table=default.Table_473211c2c5f644acb11bdea976d43900 [id=7e9e5ed71ca14b9e90cbc1a97a16238b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.280192 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6947983b19ee4ca59349979c6662bc1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.280659 9291 tablet_service.cc:1552] Processing DeleteTablet for tablet c7f760639a664cfb9f4af5578154b981 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:10.280948 9284 tablet_service.cc:1505] Processing CreateTablet for tablet df30b9f793bf4232ba848f569100a747 (DEFAULT_TABLE table=default.Table_c1335c74e0f740b08e701ac0246125f0 [id=a4fa8fe05f924de6b14bcc04e80479ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.281011 9160 tablet_service.cc:1505] Processing CreateTablet for tablet e9124dd3d98947b29289e0561976ada4 (DEFAULT_TABLE table=default.Table_3b14c63de5274e12a94726cb1c368a36 [id=b4ed9eb24c1246008dc57bf54fcbefc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.281064 9294 tablet_service.cc:1505] Processing CreateTablet for tablet a1c5659fd65f40b0ab72c164afb8d3fe (DEFAULT_TABLE table=default.Table_0e8139618d4747388370f15f67fc9fa2 [id=31a55ff8938c40279d2091ce1d0598c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.281345 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df30b9f793bf4232ba848f569100a747. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.281374 9944 tablet_replica.cc:333] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:10.281571 9944 raft_consensus.cc:2243] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:10.281726 9944 raft_consensus.cc:2272] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:10.282269 9944 ts_tablet_manager.cc:1916] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:10.286723 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c5659fd65f40b0ab72c164afb8d3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.287498 9283 tablet_service.cc:1552] Processing DeleteTablet for tablet f9a0c31abcf046c9b76bea3f946ba9fc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:10.287567 10019 raft_consensus.cc:2804] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:10.291460 9277 tablet_service.cc:1505] Processing CreateTablet for tablet 394844a49d254112883c40df9821c075 (DEFAULT_TABLE table=default.Table_15ad0aa39f5048228397e27df88eea2f [id=efe5b2d15f1946cfa19f92b942b760d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.291872 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394844a49d254112883c40df9821c075. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.292922 9291 tablet_service.cc:1505] Processing CreateTablet for tablet ca2bba36b0f54aadb3980aa41dfd0eb0 (DEFAULT_TABLE table=default.Table_ba8f8beb36af4b6ab3fc11419c5c3531 [id=9db10c7c96104a7fb7ab0c44c2911d2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.293287 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca2bba36b0f54aadb3980aa41dfd0eb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.294675 9943 ts_tablet_manager.cc:1929] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:10.299355 10021 raft_consensus.cc:515] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:10.300530 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet a93d01ea31a64dc2a8d8b03884675024 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a93d01ea31a64dc2a8d8b03884675024 already in progress: creating tablet
W20251215 14:55:10.300887 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet a2a58a13b66641b0bdc710cf5d458689 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2a58a13b66641b0bdc710cf5d458689 already in progress: creating tablet
I20251215 14:55:10.303617 9011 tablet_service.cc:1505] Processing CreateTablet for tablet 9e317c8dc24e481abb709e932fa39c29 (DEFAULT_TABLE table=default.Table_0c66ce7473b248f58f74dd76a8c48045 [id=f735b0a748bf4b35bd47e7b1431994b1]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:10.305864 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet ce0154b24522401b9cc0e37fa502532f
I20251215 14:55:10.306066 8788 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781]). Expected version 2 got 0
I20251215 14:55:10.308374 8788 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_4137cdbc5dba456588ab4ce7aa1382a4" } modify_external_catalogs: true
I20251215 14:55:10.308698 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9124dd3d98947b29289e0561976ada4. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:10.308840 8976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 204323us
I20251215 14:55:10.309304 8788 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_4137cdbc5dba456588ab4ce7aa1382a4" } modify_external_catalogs: true
W20251215 14:55:10.310786 9112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 131722us
I20251215 14:55:10.312510 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6beaf5ae37ce41fd9123d6b3560351b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.312834 9004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 032f27e7f6054188a3169a3c10ee4d09. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.313004 9427 tablet_bootstrap.cc:654] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.312959 10019 raft_consensus.cc:697] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:10.313872 10021 leader_election.cc:290] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:10.313905 9943 log.cc:1199] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:55:10.314438 9943 ts_tablet_manager.cc:1950] T 61aef86a30e842f2a90f9f1c88c84f4d P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
W20251215 14:55:10.315693 8976 leader_election.cc:343] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.316380 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb3b95d32c7044bd8a4451381c19aeba" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:10.317296 10141 tablet_replica.cc:333] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:10.317528 10141 raft_consensus.cc:2243] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:10.320077 10141 raft_consensus.cc:2272] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 14:55:10.320223 8976 leader_election.cc:343] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.320665 10141 ts_tablet_manager.cc:1916] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:10.321133 9151 tablet_service.cc:1505] Processing CreateTablet for tablet 9e317c8dc24e481abb709e932fa39c29 (DEFAULT_TABLE table=default.Table_0c66ce7473b248f58f74dd76a8c48045 [id=f735b0a748bf4b35bd47e7b1431994b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.323218 10003 raft_consensus.cc:493] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:10.321681 9021 tablet_service.cc:1552] Processing DeleteTablet for tablet 5dd36ea0aa53460f9c1fda4b31063fa7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:10.327028 10134 raft_consensus.cc:515] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.326790 10019 consensus_queue.cc:237] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.332638 9034 raft_consensus.cc:2393] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:10.337116 10148 consensus_queue.cc:1048] T 16309efc14e747d09ce6e5de4f3c2784 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
W20251215 14:55:10.337821 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 82ca60c5a63744ffb0a0c0a140ef665e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82ca60c5a63744ffb0a0c0a140ef665e already in progress: creating tablet
I20251215 14:55:10.294514 9284 tablet_service.cc:1505] Processing CreateTablet for tablet 437ccec0421f4bdfb8c7e6a2fcb44bca (DEFAULT_TABLE table=default.Table_f1ea3f5f6d5e42d28a025fbdbacc1f34 [id=e6d2d070235642c9850a41eb91546362]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.332998 10003 raft_consensus.cc:515] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.343885 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 5dd36ea0aa53460f9c1fda4b31063fa7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:10.346132 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 66f2c74e55f04a6fa4b2c238c0a6b901 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 66f2c74e55f04a6fa4b2c238c0a6b901 already in progress: creating tablet
W20251215 14:55:10.347756 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 123361ef48714d859ee5ac85c3c37d08 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 123361ef48714d859ee5ac85c3c37d08 already in progress: creating tablet
I20251215 14:55:10.348464 10144 raft_consensus.cc:493] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:10.349717 9014 tablet_service.cc:1505] Processing CreateTablet for tablet e9124dd3d98947b29289e0561976ada4 (DEFAULT_TABLE table=default.Table_3b14c63de5274e12a94726cb1c368a36 [id=b4ed9eb24c1246008dc57bf54fcbefc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.353879 10003 leader_election.cc:290] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:10.354679 9283 tablet_service.cc:1505] Processing CreateTablet for tablet 6140a160980d49b09a5fda8475fc144f (DEFAULT_TABLE table=default.Table_42e5c1011ba64c0b9602eed064c8ecbd [id=4343a6c3acc545d7be8d3b7ec617da90]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.355448 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_b38cb006fa2b44cbb29424f716b5ec47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:10.356089 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b38cb006fa2b44cbb29424f716b5ec47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.357497 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_b5a947cbfd574aa9b8291c27604daa3f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:10.358075 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5a947cbfd574aa9b8291c27604daa3f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.359380 8782 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d" } new_table_name: "default.Table_e7f7e3604c274a18a83a3fa1213829b7" modify_external_catalogs: true
I20251215 14:55:10.360862 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 032f27e7f6054188a3169a3c10ee4d09 (DEFAULT_TABLE table=default.Table_b2e5b280bc8e450f809d52261090830d [id=c3fa5f731cdc45a4bf38e7981a1f768e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.363337 9021 tablet_service.cc:1552] Processing DeleteTablet for tablet c8b49b3d98ef4e0988e9019fe82f8727 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:10.363715 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_0ab920fea5f34b65b38a501fdc8e199d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:10.364250 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ab920fea5f34b65b38a501fdc8e199d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.364836 9009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 394844a49d254112883c40df9821c075. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.365536 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_6a7ef1364990457b8e316783de244cfc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:10.366024 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a7ef1364990457b8e316783de244cfc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.367573 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_d6b14175291d4c458b8f055e472350e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:10.368213 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6b14175291d4c458b8f055e472350e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.372905 9151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e317c8dc24e481abb709e932fa39c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.373634 10154 consensus_queue.cc:1048] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20251215 14:55:10.375439 10134 leader_election.cc:290] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:10.376941 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet c8b49b3d98ef4e0988e9019fe82f8727 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:10.378368 9112 leader_election.cc:343] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:10.379313 8976 consensus_peers.cc:597] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:10.380752 9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e317c8dc24e481abb709e932fa39c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.388372 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18cd1f63d51e4565bb8c55be13e3e099" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:10.388628 9112 leader_election.cc:304] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:10.391677 10144 raft_consensus.cc:515] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.392431 10144 leader_election.cc:290] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:10.395933 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437ccec0421f4bdfb8c7e6a2fcb44bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.396100 8780 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_5a4daafd564942cfa496f1201983f9e8" } modify_external_catalogs: true
I20251215 14:55:10.396100 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_d12285644d7e481cb7a99358a2696b73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:10.396329 8780 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_5a4daafd564942cfa496f1201983f9e8" } modify_external_catalogs: true
W20251215 14:55:10.396857 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d12285644d7e481cb7a99358a2696b73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.401341 9294 tablet_service.cc:1505] Processing CreateTablet for tablet eb309f7c439740c89470da5636523a69 (DEFAULT_TABLE table=default.Table_05d3398565e643659ed17d3e282bae1d [id=40b600a183744fa992c73142cd90120b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.403868 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 032f27e7f6054188a3169a3c10ee4d09. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.406689 9293 tablet_service.cc:1505] Processing CreateTablet for tablet f9a0c31abcf046c9b76bea3f946ba9fc (DEFAULT_TABLE table=default.Table_a68d34f520064abe9fb31e83e0162483 [id=c0d22f90a4f046feaf4e5b11515a6b2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.407068 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb309f7c439740c89470da5636523a69. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.411250 9170 raft_consensus.cc:3060] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.411319 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a0c31abcf046c9b76bea3f946ba9fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.388233 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4af4cf6ec825467383349098eda661c6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:10.417306 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "38e50a7f2bdd4907ab41436b59397ea6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:10.419329 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95caeaf32d154c0ba4c88dd3f295876d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:10.419660 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_efdad8beee5047ada8b6d4992fa8a978"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:10.419868 9015 tablet_service.cc:1505] Processing CreateTablet for tablet d09d7ce93d074bfaa830130b31bcc594 (DEFAULT_TABLE table=default.Table_cd6f9353272f406f866b8aea97b47b52 [id=40a32fedadfe44bca3c1013ceb2b84c6]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:10.420500 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efdad8beee5047ada8b6d4992fa8a978 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.423710 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a0c31abcf046c9b76bea3f946ba9fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.426903 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6140a160980d49b09a5fda8475fc144f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.428723 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9124dd3d98947b29289e0561976ada4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.429210 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09d7ce93d074bfaa830130b31bcc594. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.431391 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6be5f3269d9147d780f782bb5665b8b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.434705 9179 raft_consensus.cc:2468] T 38e50a7f2bdd4907ab41436b59397ea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:10.449313 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 6beaf5ae37ce41fd9123d6b3560351b7 (DEFAULT_TABLE table=default.Table_78c038b3edc449fab589e43dea2d2dbf [id=2f85cc5b73384275ba2c533b1f0eeda2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.449751 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6beaf5ae37ce41fd9123d6b3560351b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.457015 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95caeaf32d154c0ba4c88dd3f295876d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:10.457557 9944 ts_tablet_manager.cc:1929] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:10.458802 9944 log.cc:1199] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/c7f760639a664cfb9f4af5578154b981
I20251215 14:55:10.459324 9170 raft_consensus.cc:2468] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:10.460573 9435 tablet_bootstrap.cc:492] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:10.461199 9944 ts_tablet_manager.cc:1950] T c7f760639a664cfb9f4af5578154b981 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:10.464428 9034 raft_consensus.cc:3060] T 5f03dfdd546c492185c6c31866a090a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.464905 9294 tablet_service.cc:1505] Processing CreateTablet for tablet e9124dd3d98947b29289e0561976ada4 (DEFAULT_TABLE table=default.Table_3b14c63de5274e12a94726cb1c368a36 [id=b4ed9eb24c1246008dc57bf54fcbefc1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.468297 9277 tablet_service.cc:1505] Processing CreateTablet for tablet 9e317c8dc24e481abb709e932fa39c29 (DEFAULT_TABLE table=default.Table_0c66ce7473b248f58f74dd76a8c48045 [id=f735b0a748bf4b35bd47e7b1431994b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.473063 10148 raft_consensus.cc:2749] T 18cd1f63d51e4565bb8c55be13e3e099 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:10.475092 9112 leader_election.cc:343] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.476737 10141 ts_tablet_manager.cc:1929] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:10.476878 10141 log.cc:1199] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/bcd7d00fa01f4a9cbdf0d505684dab0e
I20251215 14:55:10.477072 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 6947983b19ee4ca59349979c6662bc1c (DEFAULT_TABLE table=default.Table_473211c2c5f644acb11bdea976d43900 [id=7e9e5ed71ca14b9e90cbc1a97a16238b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.477392 10141 ts_tablet_manager.cc:1950] T bcd7d00fa01f4a9cbdf0d505684dab0e P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:10.479107 9289 tablet_service.cc:1505] Processing CreateTablet for tablet d09d7ce93d074bfaa830130b31bcc594 (DEFAULT_TABLE table=default.Table_cd6f9353272f406f866b8aea97b47b52 [id=40a32fedadfe44bca3c1013ceb2b84c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:10.488399 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bafc5063058a469bb9c9b3e5345eb1be" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:10.494086 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9124dd3d98947b29289e0561976ada4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.494978 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e317c8dc24e481abb709e932fa39c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.496052 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6947983b19ee4ca59349979c6662bc1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.496644 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09d7ce93d074bfaa830130b31bcc594. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:10.497332 10161 consensus_queue.cc:1048] T 5f03dfdd546c492185c6c31866a090a5 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20251215 14:55:10.498000 9435 ts_tablet_manager.cc:1403] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.253s user 0.002s sys 0.002s
I20251215 14:55:10.505400 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "194bb745ecb849cb9092fee1afb7dbe6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:10.524494 10169 tablet.cc:1722] T 7f38c44dbc884d74a61c7ed98deaf6aa P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:10.526558 9427 tablet_bootstrap.cc:492] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:10.527201 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0c88310853f47b0aa1af9a3d676bef6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:10.527288 9427 ts_tablet_manager.cc:1403] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.523s user 0.002s sys 0.013s
I20251215 14:55:10.529459 10176 tablet.cc:1722] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20251215 14:55:10.532193 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 61aef86a30e842f2a90f9f1c88c84f4d (table default.Table_38b1c1a82dd441dfa8131162ac117124 [id=c50e99dfae684c81a80bfce95ff35672]) successfully deleted
W20251215 14:55:10.532505 8773 catalog_manager.cc:4952] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet f9a0c31abcf046c9b76bea3f946ba9fc because the tablet was not found. No further retry: Not found: Tablet not found: f9a0c31abcf046c9b76bea3f946ba9fc
W20251215 14:55:10.538391 9249 leader_election.cc:343] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:10.538645 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:55:10.531749 10033 raft_consensus.cc:493] T 4c96b655cf284326ae3fa2a165e2bf95 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:10.541582 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95caeaf32d154c0ba4c88dd3f295876d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:10.547101 10033 raft_consensus.cc:515] T 4c96b655cf284326ae3fa2a165e2bf95 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.547920 10033 leader_election.cc:290] T 4c96b655cf284326ae3fa2a165e2bf95 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:10.548470 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet bcd7d00fa01f4a9cbdf0d505684dab0e (table default.Table_f9cf4c41c7b846e88bae24711ee3421a [id=c427c258b3b443eea28d804f57a2bb30]) successfully deleted
W20251215 14:55:10.548736 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet c7f760639a664cfb9f4af5578154b981 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7f760639a664cfb9f4af5578154b981 already in progress: creating tablet
W20251215 14:55:10.549042 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet c7f760639a664cfb9f4af5578154b981 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c7f760639a664cfb9f4af5578154b981 already in progress: creating tablet
W20251215 14:55:10.549114 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 5dd36ea0aa53460f9c1fda4b31063fa7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dd36ea0aa53460f9c1fda4b31063fa7 already in progress: creating tablet
W20251215 14:55:10.549234 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet f9a0c31abcf046c9b76bea3f946ba9fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9a0c31abcf046c9b76bea3f946ba9fc already in progress: creating tablet
W20251215 14:55:10.549423 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 5dd36ea0aa53460f9c1fda4b31063fa7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dd36ea0aa53460f9c1fda4b31063fa7 already in progress: creating tablet
W20251215 14:55:10.549541 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet c8b49b3d98ef4e0988e9019fe82f8727 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8b49b3d98ef4e0988e9019fe82f8727 already in progress: creating tablet
W20251215 14:55:10.549589 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet c8b49b3d98ef4e0988e9019fe82f8727 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8b49b3d98ef4e0988e9019fe82f8727 already in progress: creating tablet
I20251215 14:55:10.553260 9285 tablet_service.cc:1552] Processing DeleteTablet for tablet 5dd36ea0aa53460f9c1fda4b31063fa7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:09 UTC) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:10.553866 9249 leader_election.cc:343] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:10.555521 9249 leader_election.cc:343] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.555614 9426 tablet_bootstrap.cc:492] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:10.555820 9426 ts_tablet_manager.cc:1403] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.563s user 0.026s sys 0.010s
I20251215 14:55:10.556509 9676 consensus_queue.cc:1048] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:10.556838 9426 raft_consensus.cc:359] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.557077 9426 raft_consensus.cc:385] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.557164 9426 raft_consensus.cc:740] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.557386 9426 consensus_queue.cc:260] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.559962 9284 tablet_service.cc:1552] Processing DeleteTablet for tablet c8b49b3d98ef4e0988e9019fe82f8727 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:10.560487 9435 raft_consensus.cc:359] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.561079 9435 raft_consensus.cc:385] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.561208 9435 raft_consensus.cc:740] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.562614 9435 consensus_queue.cc:260] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.563388 9435 ts_tablet_manager.cc:1434] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.065s user 0.001s sys 0.001s
I20251215 14:55:10.551630 9971 consensus_queue.cc:1048] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20251215 14:55:10.575706 10171 tablet.cc:1722] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20251215 14:55:10.577114 9426 ts_tablet_manager.cc:1434] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.021s user 0.001s sys 0.001s
I20251215 14:55:10.577741 9426 tablet_bootstrap.cc:492] T bfead52afe8040a88ba0d826f482b1bd P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:10.581593 9435 tablet_bootstrap.cc:492] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:10.582549 10171 tablet.cc:1722] T 7f38c44dbc884d74a61c7ed98deaf6aa P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:10.584255 9427 raft_consensus.cc:359] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:10.573004 9115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 171545us
I20251215 14:55:10.590133 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c96b655cf284326ae3fa2a165e2bf95" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:10.600533 9426 tablet_bootstrap.cc:654] T bfead52afe8040a88ba0d826f482b1bd P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:10.603813 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:10.606371 8976 leader_election.cc:343] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.610147 10187 tablet.cc:1722] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20251215 14:55:10.616267 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 96b2d20fd2304e7a9995206a043b7944 (table default.Table_5a4daafd564942cfa496f1201983f9e8 [id=4343a6c3acc545d7be8d3b7ec617da90]) successfully deleted
I20251215 14:55:10.619107 9426 tablet_bootstrap.cc:492] T bfead52afe8040a88ba0d826f482b1bd P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:10.619270 9426 ts_tablet_manager.cc:1403] T bfead52afe8040a88ba0d826f482b1bd P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.000s
I20251215 14:55:10.620092 9426 raft_consensus.cc:359] T bfead52afe8040a88ba0d826f482b1bd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.620306 9426 raft_consensus.cc:385] T bfead52afe8040a88ba0d826f482b1bd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.620404 9426 raft_consensus.cc:740] T bfead52afe8040a88ba0d826f482b1bd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.620626 9426 consensus_queue.cc:260] T bfead52afe8040a88ba0d826f482b1bd P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.620818 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet c7f760639a664cfb9f4af5578154b981 (table default.Table_bec53ce4c0c04be8bb0aabb4ce60974b [id=0ed94690124e4fd7a23a6ddf2291c6d6]) successfully deleted
W20251215 14:55:10.621042 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet f9a0c31abcf046c9b76bea3f946ba9fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f9a0c31abcf046c9b76bea3f946ba9fc already in progress: creating tablet
I20251215 14:55:10.622587 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0c88310853f47b0aa1af9a3d676bef6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:10.632726 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 9bd8d964650a49b08093608abf3e31fa (table default.Table_4372b5372fdf4a0d991207a20dcbca19 [id=640d70bd78554e92823dc104e06227d3], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9bd8d964650a49b08093608abf3e31fa consensus state has no leader
I20251215 14:55:10.642529 8976 leader_election.cc:304] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:10.642593 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "194bb745ecb849cb9092fee1afb7dbe6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:10.642769 9034 raft_consensus.cc:3060] T 194bb745ecb849cb9092fee1afb7dbe6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.642906 8976 leader_election.cc:304] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:10.643443 10021 raft_consensus.cc:2804] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:10.643536 10021 raft_consensus.cc:493] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:10.643630 10021 raft_consensus.cc:3060] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.645721 9034 raft_consensus.cc:2468] T 194bb745ecb849cb9092fee1afb7dbe6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:10.642552 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bafc5063058a469bb9c9b3e5345eb1be" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:10.646152 10021 raft_consensus.cc:515] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.646843 10021 leader_election.cc:290] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:10.646999 10021 raft_consensus.cc:2804] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:10.647905 10021 raft_consensus.cc:697] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:10.648351 10021 consensus_queue.cc:237] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.646158 9037 raft_consensus.cc:2468] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
W20251215 14:55:10.655773 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 5dd36ea0aa53460f9c1fda4b31063fa7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dd36ea0aa53460f9c1fda4b31063fa7 already in progress: creating tablet
W20251215 14:55:10.656072 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet c8b49b3d98ef4e0988e9019fe82f8727 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c8b49b3d98ef4e0988e9019fe82f8727 already in progress: creating tablet
I20251215 14:55:10.659041 9427 raft_consensus.cc:385] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.659246 9427 raft_consensus.cc:740] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.659581 9427 consensus_queue.cc:260] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.660215 9427 ts_tablet_manager.cc:1434] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.132s user 0.002s sys 0.000s
I20251215 14:55:10.660573 9427 tablet_bootstrap.cc:492] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:10.662181 9427 tablet_bootstrap.cc:654] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.665946 8788 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet b9c074f12b3c4abaa39fe3412df7fe02
W20251215 14:55:10.667877 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 15a974e3265a4c88aa6d5005ffa04dc8
W20251215 14:55:10.667963 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 18cd1f63d51e4565bb8c55be13e3e099
W20251215 14:55:10.668027 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 38e50a7f2bdd4907ab41436b59397ea6
W20251215 14:55:10.668120 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 37181f50142f4d8bb88713221a755d50
I20251215 14:55:10.669034 8788 catalog_manager.cc:5654] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129). New cstate: current_term: 1 leader_uuid: "67978ac4539d4b289e53f4eedd9a8156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:10.669463 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet e2104a3530264fa982b20aed20afb0b4 (table default.Table_d92a50e24ad64b9496b0cb3ca5d0dd9a [id=d916193804f94519b84d259c0420e1a1]). Expected version 2 got 0
I20251215 14:55:10.669682 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 4c96b655cf284326ae3fa2a165e2bf95 (table default.Table_99ea47285b994715a5fae3cfb669d229 [id=b7ff2d02e55b4e839049b20b89227526]). Expected version 1 got 0
I20251215 14:55:10.669860 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 7f38c44dbc884d74a61c7ed98deaf6aa (table default.Table_145283350dd24d6ca18a985e25c2758d [id=bec2dd63f0aa4a05961adb6a70fbfd94]). Expected version 2 got 1
I20251215 14:55:10.670017 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet bb3b95d32c7044bd8a4451381c19aeba (table default.Table_7cbbdace45d641d4a9c5b95389d76554 [id=7ec65d77d89d4e40a60b716f721e2940]). Expected version 4 got 0
W20251215 14:55:10.670827 8782 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bafc5063058a469bb9c9b3e5345eb1be consensus state has no leader
I20251215 14:55:10.671402 8782 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_7cbbdace45d641d4a9c5b95389d76554" } new_table_name: "default.Table_3194032074824e83a1f02ad85fbba951" modify_external_catalogs: true
I20251215 14:55:10.671643 8787 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d88499634e6e47fd84ec1fdb6d93c314" } modify_external_catalogs: true
I20251215 14:55:10.671823 8787 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d88499634e6e47fd84ec1fdb6d93c314" } modify_external_catalogs: true
I20251215 14:55:10.673355 8781 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_2b599310beac4f1baef868099196f8ac" } new_table_name: "default.Table_83a70db13a46486d9ab7008ef949a790" modify_external_catalogs: true
I20251215 14:55:10.676812 8779 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_862e5241fcc042d8bf376e55c3c86fa0" } new_table_name: "default.Table_f6164e312b7a4576a27fab2ab89f91ca" modify_external_catalogs: true
I20251215 14:55:10.678295 8784 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ab675320fa5a4421948fc3438902cfd3" } new_table_name: "default.Table_2a74152b6a57456eb270264d0784390e" modify_external_catalogs: true
I20251215 14:55:10.680576 8780 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 6140a160980d49b09a5fda8475fc144f
I20251215 14:55:10.683210 9426 ts_tablet_manager.cc:1434] T bfead52afe8040a88ba0d826f482b1bd P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:10.683350 8785 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f1ea3f5f6d5e42d28a025fbdbacc1f34" } modify_external_catalogs: true
I20251215 14:55:10.683423 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "38e50a7f2bdd4907ab41436b59397ea6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:10.683614 9176 raft_consensus.cc:3060] T 38e50a7f2bdd4907ab41436b59397ea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.684286 8785 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f1ea3f5f6d5e42d28a025fbdbacc1f34" } modify_external_catalogs: true
I20251215 14:55:10.685464 8786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_b2e5b280bc8e450f809d52261090830d" } modify_external_catalogs: true
I20251215 14:55:10.611147 9435 tablet_bootstrap.cc:654] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.686492 9176 raft_consensus.cc:2468] T 38e50a7f2bdd4907ab41436b59397ea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:10.624747 10189 tablet.cc:1722] T 4c96b655cf284326ae3fa2a165e2bf95 P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:10.686937 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_e187e303d6744e46a505a79d4f80a846"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:10.683254 10171 tablet.cc:1722] T 4c96b655cf284326ae3fa2a165e2bf95 P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:10.686633 8786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_b2e5b280bc8e450f809d52261090830d" } modify_external_catalogs: true
W20251215 14:55:10.690389 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
W20251215 14:55:10.690608 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 16309efc14e747d09ce6e5de4f3c2784
I20251215 14:55:10.691025 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_98f7661731924d2994c2f55e3241138b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:10.692099 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98f7661731924d2994c2f55e3241138b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.692117 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet 6140a160980d49b09a5fda8475fc144f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:10.691695 9426 tablet_bootstrap.cc:492] T c7f760639a664cfb9f4af5578154b981 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:10.693995 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e187e303d6744e46a505a79d4f80a846 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:10.696817 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 6140a160980d49b09a5fda8475fc144f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6140a160980d49b09a5fda8475fc144f already in progress: creating tablet
I20251215 14:55:10.625306 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f03dfdd546c492185c6c31866a090a5" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:10.632656 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "188eb879e7c3479ea71c5b1864400243" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:10.651579 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bafc5063058a469bb9c9b3e5345eb1be" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:10.697561 9312 raft_consensus.cc:2468] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:10.652078 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb3b95d32c7044bd8a4451381c19aeba" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:10.652961 9310 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4af4cf6ec825467383349098eda661c6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:10.697952 9310 raft_consensus.cc:2468] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:10.653381 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c96b655cf284326ae3fa2a165e2bf95" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:10.700491 8976 leader_election.cc:304] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:10.703562 9014 tablet_service.cc:1552] Processing DeleteTablet for tablet 6140a160980d49b09a5fda8475fc144f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:10.705538 10021 raft_consensus.cc:2804] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:10.705971 10021 raft_consensus.cc:697] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:10.706491 10021 consensus_queue.cc:237] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:10.707674 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 6140a160980d49b09a5fda8475fc144f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6140a160980d49b09a5fda8475fc144f already in progress: creating tablet
W20251215 14:55:10.708645 8978 leader_election.cc:343] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099
I20251215 14:55:10.709388 10134 consensus_queue.cc:1048] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:10.710362 10134 consensus_queue.cc:1048] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:10.710698 8978 leader_election.cc:343] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6
W20251215 14:55:10.712129 8978 leader_election.cc:343] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099
W20251215 14:55:10.715991 9248 leader_election.cc:343] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.716780 9248 leader_election.cc:304] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:10.718060 10145 raft_consensus.cc:2749] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:10.718698 9427 tablet_bootstrap.cc:492] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:10.718933 9427 ts_tablet_manager.cc:1403] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.004s
I20251215 14:55:10.719877 9427 raft_consensus.cc:359] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:10.719992 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:55:10.720657 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:10.722074 9427 raft_consensus.cc:385] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.722086 10145 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 14:55:10.722441 9427 raft_consensus.cc:740] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.723150 9427 consensus_queue.cc:260] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:10.724984 9248 leader_election.cc:343] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.725611 9248 leader_election.cc:304] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:10.726518 10145 raft_consensus.cc:2749] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:10.728727 9435 tablet_bootstrap.cc:492] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:10.729303 9427 ts_tablet_manager.cc:1434] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20251215 14:55:10.729305 9435 ts_tablet_manager.cc:1403] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.148s user 0.006s sys 0.003s
I20251215 14:55:10.730145 9435 raft_consensus.cc:359] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.730408 9435 raft_consensus.cc:385] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.730594 9435 raft_consensus.cc:740] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.730937 9435 consensus_queue.cc:260] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.731789 9435 ts_tablet_manager.cc:1434] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:10.732630 9435 tablet_bootstrap.cc:492] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:10.733563 9248 leader_election.cc:304] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:10.734547 10145 raft_consensus.cc:2804] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:10.734910 10145 raft_consensus.cc:697] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:10.735239 10145 consensus_queue.cc:237] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.735772 9427 tablet_bootstrap.cc:492] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:10.736335 9248 leader_election.cc:304] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:10.737428 9427 tablet_bootstrap.cc:654] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.737644 10144 raft_consensus.cc:2804] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:10.737728 10144 raft_consensus.cc:493] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:10.737833 10144 raft_consensus.cc:3060] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.739377 9426 tablet_bootstrap.cc:654] T c7f760639a664cfb9f4af5578154b981 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.740518 10144 raft_consensus.cc:515] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.741693 10144 leader_election.cc:290] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:10.742379 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bafc5063058a469bb9c9b3e5345eb1be" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:10.743016 9249 leader_election.cc:343] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:10.744807 9248 consensus_peers.cc:597] T f7af1f66c4f04f649379758ff1b3e387 P e89303a500544272b601d7c29be802b4 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:10.748129 9426 tablet_bootstrap.cc:492] T c7f760639a664cfb9f4af5578154b981 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:10.748523 9426 ts_tablet_manager.cc:1403] T c7f760639a664cfb9f4af5578154b981 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.057s user 0.001s sys 0.002s
I20251215 14:55:10.749133 9427 tablet_bootstrap.cc:492] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:10.749354 9427 ts_tablet_manager.cc:1403] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20251215 14:55:10.749513 9435 tablet_bootstrap.cc:654] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.749656 9426 raft_consensus.cc:359] T c7f760639a664cfb9f4af5578154b981 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.750193 9427 raft_consensus.cc:359] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.750451 9427 raft_consensus.cc:385] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.750566 9427 raft_consensus.cc:740] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.750876 9427 consensus_queue.cc:260] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.751543 9426 raft_consensus.cc:385] T c7f760639a664cfb9f4af5578154b981 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.751699 9426 raft_consensus.cc:740] T c7f760639a664cfb9f4af5578154b981 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.752054 9427 ts_tablet_manager.cc:1434] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:10.752013 9426 consensus_queue.cc:260] T c7f760639a664cfb9f4af5578154b981 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.752766 9427 tablet_bootstrap.cc:492] T 95caeaf32d154c0ba4c88dd3f295876d P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:10.753739 10021 consensus_queue.cc:1048] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:10.755236 8978 leader_election.cc:343] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6
I20251215 14:55:10.755600 8978 leader_election.cc:304] T 5f03dfdd546c492185c6c31866a090a5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:10.756004 8978 leader_election.cc:304] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:10.756140 9426 ts_tablet_manager.cc:1434] T c7f760639a664cfb9f4af5578154b981 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
W20251215 14:55:10.756405 8978 leader_election.cc:343] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.756481 9426 tablet_bootstrap.cc:492] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:10.756521 8978 leader_election.cc:304] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:10.756841 8978 leader_election.cc:304] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:10.757184 8978 leader_election.cc:304] T 4c96b655cf284326ae3fa2a165e2bf95 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:10.757539 8978 leader_election.cc:304] T 188eb879e7c3479ea71c5b1864400243 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:10.757784 10155 raft_consensus.cc:2749] T 5f03dfdd546c492185c6c31866a090a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:10.757985 10155 raft_consensus.cc:2804] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:10.758091 10155 raft_consensus.cc:493] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:10.758206 10155 raft_consensus.cc:3060] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.758226 10033 raft_consensus.cc:2749] T 4c96b655cf284326ae3fa2a165e2bf95 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 14:55:10.758376 10033 raft_consensus.cc:2749] T 188eb879e7c3479ea71c5b1864400243 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:10.759292 10114 raft_consensus.cc:2749] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:10.759322 9426 tablet_bootstrap.cc:654] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.758119 10134 raft_consensus.cc:2804] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:10.759533 10134 raft_consensus.cc:493] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:10.759629 10134 raft_consensus.cc:3060] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.759984 9427 tablet_bootstrap.cc:654] T 95caeaf32d154c0ba4c88dd3f295876d P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.762470 10134 raft_consensus.cc:515] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.763026 10134 leader_election.cc:290] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:10.763576 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4af4cf6ec825467383349098eda661c6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:10.764228 8976 leader_election.cc:343] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.765254 10155 raft_consensus.cc:515] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.765857 10155 leader_election.cc:290] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:10.766505 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bafc5063058a469bb9c9b3e5345eb1be" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:10.768107 9031 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bafc5063058a469bb9c9b3e5345eb1be" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:10.768342 9031 raft_consensus.cc:2393] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:10.770311 10169 tablet.cc:1722] T 4c96b655cf284326ae3fa2a165e2bf95 P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251215 14:55:10.770969 8976 leader_election.cc:343] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.774844 9426 tablet_bootstrap.cc:492] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:10.775069 9426 ts_tablet_manager.cc:1403] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.004s
I20251215 14:55:10.776087 9426 raft_consensus.cc:359] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.776381 9426 raft_consensus.cc:385] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.776530 9426 raft_consensus.cc:740] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.776805 9426 consensus_queue.cc:260] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.777446 9426 ts_tablet_manager.cc:1434] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:10.777832 9426 tablet_bootstrap.cc:492] T fda9eb99ccef4c16a0a947510566ecf4 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:10.781987 9426 tablet_bootstrap.cc:654] T fda9eb99ccef4c16a0a947510566ecf4 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.782269 10155 raft_consensus.cc:493] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:10.782522 10155 raft_consensus.cc:515] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.783527 10155 leader_election.cc:290] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:10.784618 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08ca9ee6b76b4b13b7bc26d65dcc3979" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:10.785141 8976 leader_election.cc:343] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.786047 10189 tablet.cc:1722] T 7f38c44dbc884d74a61c7ed98deaf6aa P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:10.786695 10155 raft_consensus.cc:493] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:10.786849 10155 raft_consensus.cc:515] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.787629 10155 leader_election.cc:290] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:10.787679 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7f760639a664cfb9f4af5578154b981" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:10.787920 9176 raft_consensus.cc:2468] T c7f760639a664cfb9f4af5578154b981 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:10.788288 8976 leader_election.cc:304] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:10.788564 10155 raft_consensus.cc:2804] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:10.788653 10155 raft_consensus.cc:493] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:10.788745 10155 raft_consensus.cc:3060] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.791419 10155 raft_consensus.cc:515] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.792289 10155 leader_election.cc:290] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:10.792268 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c7f760639a664cfb9f4af5578154b981" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:10.792476 9176 raft_consensus.cc:3060] T c7f760639a664cfb9f4af5578154b981 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.795382 9176 raft_consensus.cc:2468] T c7f760639a664cfb9f4af5578154b981 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:10.795799 8976 leader_election.cc:304] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:10.796131 10155 raft_consensus.cc:2804] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:10.796274 10155 raft_consensus.cc:697] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:10.796545 10155 consensus_queue.cc:237] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.798828 9427 tablet_bootstrap.cc:492] T 95caeaf32d154c0ba4c88dd3f295876d P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:10.798961 9427 ts_tablet_manager.cc:1403] T 95caeaf32d154c0ba4c88dd3f295876d P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.047s user 0.004s sys 0.000s
W20251215 14:55:10.799481 8782 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb3b95d32c7044bd8a4451381c19aeba consensus state has no leader
I20251215 14:55:10.799739 9427 raft_consensus.cc:359] T 95caeaf32d154c0ba4c88dd3f295876d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.799899 9427 raft_consensus.cc:385] T 95caeaf32d154c0ba4c88dd3f295876d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.799974 9427 raft_consensus.cc:740] T 95caeaf32d154c0ba4c88dd3f295876d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.800204 9427 consensus_queue.cc:260] T 95caeaf32d154c0ba4c88dd3f295876d P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.800702 9427 ts_tablet_manager.cc:1434] T 95caeaf32d154c0ba4c88dd3f295876d P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:10.800982 9427 tablet_bootstrap.cc:492] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:10.801170 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 38e50a7f2bdd4907ab41436b59397ea6
I20251215 14:55:10.801714 8782 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781]). Expected version 2 got 0
I20251215 14:55:10.801898 8782 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet e2104a3530264fa982b20aed20afb0b4 (table default.Table_d92a50e24ad64b9496b0cb3ca5d0dd9a [id=d916193804f94519b84d259c0420e1a1]). Expected version 2 got 0
I20251215 14:55:10.802088 8782 catalog_manager.cc:5654] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130). New cstate: current_term: 1 leader_uuid: "3ea5306c36594ef4a62211f2bd6669a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:10.802613 9427 tablet_bootstrap.cc:654] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:10.803181 8781 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a71d029bbd88416da1dbcad09dc93115 has no consensus state
W20251215 14:55:10.805119 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet f7af1f66c4f04f649379758ff1b3e387
W20251215 14:55:10.805239 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bf4a899338f4bcfac099b5099a22f05
W20251215 14:55:10.805310 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 5f03dfdd546c492185c6c31866a090a5
W20251215 14:55:10.805362 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 16309efc14e747d09ce6e5de4f3c2784
W20251215 14:55:10.806742 8779 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fda9eb99ccef4c16a0a947510566ecf4 consensus state has no leader
W20251215 14:55:10.807446 8784 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 566fe9bb8a1849749087d840ef1c082d has no consensus state
I20251215 14:55:10.807667 8784 master_service.cc:954] ReplaceTablet: received request to replace tablet 14ac26b3a02449f8a7588151abe7ae10 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:10.808686 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 7634179e7bef4b95ae6e06b4581888e7
I20251215 14:55:10.809243 8787 master_service.cc:954] ReplaceTablet: received request to replace tablet 16309efc14e747d09ce6e5de4f3c2784 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:10.809576 8787 master_service.cc:954] ReplaceTablet: received request to replace tablet fda9eb99ccef4c16a0a947510566ecf4 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:10.810671 8785 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 437ccec0421f4bdfb8c7e6a2fcb44bca
I20251215 14:55:10.811200 8785 master_service.cc:954] ReplaceTablet: received request to replace tablet 3af4f753a04b429a857e018f201ae6ed from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:10.811511 8785 master_service.cc:954] ReplaceTablet: received request to replace tablet fc9bda52c73e4aa6b7e2eb008c63391b from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:10.817860 9426 tablet_bootstrap.cc:492] T fda9eb99ccef4c16a0a947510566ecf4 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:10.818142 9426 ts_tablet_manager.cc:1403] T fda9eb99ccef4c16a0a947510566ecf4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.040s user 0.005s sys 0.004s
I20251215 14:55:10.818575 9151 tablet_service.cc:1552] Processing DeleteTablet for tablet 437ccec0421f4bdfb8c7e6a2fcb44bca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:10.818856 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet 7634179e7bef4b95ae6e06b4581888e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:10.819126 9426 raft_consensus.cc:359] T fda9eb99ccef4c16a0a947510566ecf4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.819376 9426 raft_consensus.cc:385] T fda9eb99ccef4c16a0a947510566ecf4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.819463 9426 raft_consensus.cc:740] T fda9eb99ccef4c16a0a947510566ecf4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.819482 8786 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 032f27e7f6054188a3169a3c10ee4d09
W20251215 14:55:10.819689 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 437ccec0421f4bdfb8c7e6a2fcb44bca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 437ccec0421f4bdfb8c7e6a2fcb44bca already in progress: creating tablet
I20251215 14:55:10.819746 9426 consensus_queue.cc:260] T fda9eb99ccef4c16a0a947510566ecf4 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:10.819970 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 7634179e7bef4b95ae6e06b4581888e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7634179e7bef4b95ae6e06b4581888e7 already in progress: creating tablet
I20251215 14:55:10.820271 9426 ts_tablet_manager.cc:1434] T fda9eb99ccef4c16a0a947510566ecf4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:10.820631 9426 tablet_bootstrap.cc:492] T 194bb745ecb849cb9092fee1afb7dbe6 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:10.807126 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_8021aec3ccb641bca49fd8b5a35a2888"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:10.824271 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8021aec3ccb641bca49fd8b5a35a2888 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.824450 9426 tablet_bootstrap.cc:654] T 194bb745ecb849cb9092fee1afb7dbe6 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.825073 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet 032f27e7f6054188a3169a3c10ee4d09 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:10.828715 9014 tablet_service.cc:1552] Processing DeleteTablet for tablet 7634179e7bef4b95ae6e06b4581888e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:10.828943 9016 tablet_service.cc:1552] Processing DeleteTablet for tablet 437ccec0421f4bdfb8c7e6a2fcb44bca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:10.829456 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet 032f27e7f6054188a3169a3c10ee4d09 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:10.831358 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 032f27e7f6054188a3169a3c10ee4d09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 032f27e7f6054188a3169a3c10ee4d09 already in progress: creating tablet
W20251215 14:55:10.841524 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 7634179e7bef4b95ae6e06b4581888e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7634179e7bef4b95ae6e06b4581888e7 already in progress: creating tablet
W20251215 14:55:10.841768 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 437ccec0421f4bdfb8c7e6a2fcb44bca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 437ccec0421f4bdfb8c7e6a2fcb44bca already in progress: creating tablet
W20251215 14:55:10.841912 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 032f27e7f6054188a3169a3c10ee4d09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 032f27e7f6054188a3169a3c10ee4d09 already in progress: creating tablet
I20251215 14:55:10.841974 9426 tablet_bootstrap.cc:492] T 194bb745ecb849cb9092fee1afb7dbe6 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:10.842136 9426 ts_tablet_manager.cc:1403] T 194bb745ecb849cb9092fee1afb7dbe6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20251215 14:55:10.843108 9426 raft_consensus.cc:359] T 194bb745ecb849cb9092fee1afb7dbe6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.843397 9426 raft_consensus.cc:385] T 194bb745ecb849cb9092fee1afb7dbe6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.843508 9426 raft_consensus.cc:740] T 194bb745ecb849cb9092fee1afb7dbe6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.843782 9426 consensus_queue.cc:260] T 194bb745ecb849cb9092fee1afb7dbe6 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.844491 9426 ts_tablet_manager.cc:1434] T 194bb745ecb849cb9092fee1afb7dbe6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:10.846686 9426 tablet_bootstrap.cc:492] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:10.848570 9426 tablet_bootstrap.cc:654] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.857980 8784 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 14ac26b3a02449f8a7588151abe7ae10
I20251215 14:55:10.858496 8784 catalog_manager.cc:6724] ReplaceTablet: tablet 14ac26b3a02449f8a7588151abe7ae10 deleted and replaced by tablet 6a09ed5b19594fba9e73f7b6e3f7bd4f
I20251215 14:55:10.859300 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet 14ac26b3a02449f8a7588151abe7ae10 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a09ed5b19594fba9e73f7b6e3f7bd4f) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:10.860177 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 14ac26b3a02449f8a7588151abe7ae10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14ac26b3a02449f8a7588151abe7ae10 already in progress: creating tablet
I20251215 14:55:10.860867 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet 14ac26b3a02449f8a7588151abe7ae10 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a09ed5b19594fba9e73f7b6e3f7bd4f) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:10.861637 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 14ac26b3a02449f8a7588151abe7ae10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14ac26b3a02449f8a7588151abe7ae10 already in progress: creating tablet
I20251215 14:55:10.862001 8781 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_99ea47285b994715a5fae3cfb669d229 [id=b7ff2d02e55b4e839049b20b89227526] alter complete (version 1)
I20251215 14:55:10.866271 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bafc5063058a469bb9c9b3e5345eb1be" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:10.866665 9306 raft_consensus.cc:2393] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:10.867918 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08ca9ee6b76b4b13b7bc26d65dcc3979" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:10.868201 9306 raft_consensus.cc:2468] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:10.871425 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 6140a160980d49b09a5fda8475fc144f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:10.871559 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4af4cf6ec825467383349098eda661c6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:10.871778 9314 raft_consensus.cc:3060] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.872552 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 7634179e7bef4b95ae6e06b4581888e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:10.873399 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 437ccec0421f4bdfb8c7e6a2fcb44bca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:10.873521 9426 tablet_bootstrap.cc:492] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:10.873792 9426 ts_tablet_manager.cc:1403] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.002s
I20251215 14:55:10.874473 9314 raft_consensus.cc:2468] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:10.874616 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 032f27e7f6054188a3169a3c10ee4d09 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:10.874632 9426 raft_consensus.cc:359] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.874799 9426 raft_consensus.cc:385] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.874874 9426 raft_consensus.cc:740] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.875110 9426 consensus_queue.cc:260] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.875382 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 14ac26b3a02449f8a7588151abe7ae10 with delete_type TABLET_DATA_DELETED (replaced by tablet 6a09ed5b19594fba9e73f7b6e3f7bd4f) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:10.877574 9426 ts_tablet_manager.cc:1434] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251215 14:55:10.877986 9426 tablet_bootstrap.cc:492] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:10.879213 8978 leader_election.cc:304] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:10.879623 9426 tablet_bootstrap.cc:654] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.879648 10114 raft_consensus.cc:2749] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:10.880900 8978 leader_election.cc:304] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:10.881412 10114 raft_consensus.cc:2804] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:10.881506 10114 raft_consensus.cc:493] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:10.881596 10114 raft_consensus.cc:3060] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.884488 10114 raft_consensus.cc:515] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.885388 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08ca9ee6b76b4b13b7bc26d65dcc3979" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:10.885840 8976 leader_election.cc:343] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.886184 10114 leader_election.cc:290] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:10.893666 9426 tablet_bootstrap.cc:492] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:10.893814 9426 ts_tablet_manager.cc:1403] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.000s
I20251215 14:55:10.894570 9426 raft_consensus.cc:359] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.894752 9426 raft_consensus.cc:385] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.894829 9426 raft_consensus.cc:740] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.895067 9426 consensus_queue.cc:260] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.895315 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_afbea73c46dc454ca7c4be632d7ad3a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:10.895953 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_afbea73c46dc454ca7c4be632d7ad3a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.897657 9426 ts_tablet_manager.cc:1434] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:10.897615 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_6c41f00ff1bf43678335e7917922d7ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:10.898116 9426 tablet_bootstrap.cc:492] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:10.898680 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c41f00ff1bf43678335e7917922d7ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.899686 8786 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_5ed1858b15504f70a200762ea0f213f1" } new_table_name: "default.Table_28b106a5f17b487c951bfa8a28bcd147" modify_external_catalogs: true
I20251215 14:55:10.899937 9426 tablet_bootstrap.cc:654] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.900668 8782 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_73b7bfe544f34dd7b685ab9819f4a52b" } modify_external_catalogs: true
I20251215 14:55:10.901151 8782 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_73b7bfe544f34dd7b685ab9819f4a52b" } modify_external_catalogs: true
I20251215 14:55:10.901844 9435 tablet_bootstrap.cc:492] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:10.903113 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_3d179a88ea834a449251536e388b0891"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:10.903378 8978 leader_election.cc:343] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981
W20251215 14:55:10.903656 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d179a88ea834a449251536e388b0891 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:10.904043 8978 leader_election.cc:343] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981
W20251215 14:55:10.904738 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 6140a160980d49b09a5fda8475fc144f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6140a160980d49b09a5fda8475fc144f already in progress: creating tablet
W20251215 14:55:10.904978 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 7634179e7bef4b95ae6e06b4581888e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7634179e7bef4b95ae6e06b4581888e7 already in progress: creating tablet
W20251215 14:55:10.905197 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 437ccec0421f4bdfb8c7e6a2fcb44bca because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 437ccec0421f4bdfb8c7e6a2fcb44bca already in progress: creating tablet
I20251215 14:55:10.905277 8978 leader_election.cc:304] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:10.905616 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_71fb566bde204f5a9381ce697d4188a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:10.906085 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_71fb566bde204f5a9381ce697d4188a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.906950 10144 raft_consensus.cc:493] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:10.907122 10144 raft_consensus.cc:515] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.907277 10145 raft_consensus.cc:493] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:10.907385 10145 raft_consensus.cc:515] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.907156 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c733908dc722410a9fecd7f50d888e4a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:10.907775 10144 leader_election.cc:290] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:10.907814 10145 leader_election.cc:290] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:10.908145 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c733908dc722410a9fecd7f50d888e4a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.908216 10155 raft_consensus.cc:2804] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:10.908398 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26754a74483c4c9580df93aae10e7de1" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:10.908442 10155 raft_consensus.cc:697] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:10.908699 10155 consensus_queue.cc:237] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:10.909062 9249 leader_election.cc:343] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.909241 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5560a21e16bb43c7903c1fc66429ecdf" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:10.909273 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 032f27e7f6054188a3169a3c10ee4d09 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 032f27e7f6054188a3169a3c10ee4d09 already in progress: creating tablet
W20251215 14:55:10.909510 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 14ac26b3a02449f8a7588151abe7ae10 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14ac26b3a02449f8a7588151abe7ae10 already in progress: creating tablet
I20251215 14:55:10.909569 9435 ts_tablet_manager.cc:1403] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.177s user 0.003s sys 0.005s
W20251215 14:55:10.910136 9249 leader_election.cc:343] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.910801 9248 leader_election.cc:304] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:10.912122 10144 raft_consensus.cc:2749] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:10.913131 9435 raft_consensus.cc:359] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.914580 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet fda9eb99ccef4c16a0a947510566ecf4
I20251215 14:55:10.915077 8787 catalog_manager.cc:6724] ReplaceTablet: tablet fda9eb99ccef4c16a0a947510566ecf4 deleted and replaced by tablet f45f8b2fbf754d359deb666cb605c789
I20251215 14:55:10.915539 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26754a74483c4c9580df93aae10e7de1" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:10.916345 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5560a21e16bb43c7903c1fc66429ecdf" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:10.917323 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet c8af1d0b67424bec90b59863a975254e
W20251215 14:55:10.917407 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 194bb745ecb849cb9092fee1afb7dbe6
W20251215 14:55:10.917487 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet c7f760639a664cfb9f4af5578154b981
W20251215 14:55:10.917546 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 95583eee8a5041b1ade97e8f8f0db271
I20251215 14:55:10.913321 9435 raft_consensus.cc:385] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251215 14:55:10.917608 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 2df2138e41844e9f897e57264b62cc9d
W20251215 14:55:10.917650 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 9425749d471f4f95bbae030977e278e4
I20251215 14:55:10.917173 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08ca9ee6b76b4b13b7bc26d65dcc3979" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
W20251215 14:55:10.917716 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet df70bebdc8ad4f8186ba427e840799cf
I20251215 14:55:10.917729 9435 raft_consensus.cc:740] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
W20251215 14:55:10.917838 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 11a5a6a0895c49648c910fa2ea3ca373
I20251215 14:55:10.917795 9306 raft_consensus.cc:3060] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:10.917901 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 924c9dd0cd9d40189bfe1457040f3d37
W20251215 14:55:10.917945 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 16309efc14e747d09ce6e5de4f3c2784
W20251215 14:55:10.918006 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet f32a6e8df31d482fa9b9686e002d81ff
W20251215 14:55:10.918051 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 5f03dfdd546c492185c6c31866a090a5
I20251215 14:55:10.917979 9435 consensus_queue.cc:260] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:10.918102 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 44bd51f9bf77492b8890fc7c8411c887
W20251215 14:55:10.918138 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet e6aad8bed15a416a925ae8c8870d4e51
W20251215 14:55:10.918285 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet f7af1f66c4f04f649379758ff1b3e387
W20251215 14:55:10.918330 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 32432afc6e8d458bb7ed7abc42fb3dde
W20251215 14:55:10.918437 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 92e21a77ad074572a57b836743903a0b
I20251215 14:55:10.918601 9435 ts_tablet_manager.cc:1434] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20251215 14:55:10.918928 9435 tablet_bootstrap.cc:492] T fda9eb99ccef4c16a0a947510566ecf4 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:10.917237 9248 leader_election.cc:343] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.919099 9248 leader_election.cc:304] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:10.920104 9426 tablet_bootstrap.cc:492] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:10.920177 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet fda9eb99ccef4c16a0a947510566ecf4 with delete_type TABLET_DATA_DELETED (replaced by tablet f45f8b2fbf754d359deb666cb605c789) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:10.920270 9426 ts_tablet_manager.cc:1403] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20251215 14:55:10.920668 9306 raft_consensus.cc:2468] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
W20251215 14:55:10.920908 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet fda9eb99ccef4c16a0a947510566ecf4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fda9eb99ccef4c16a0a947510566ecf4 already in progress: creating tablet
I20251215 14:55:10.920974 9426 raft_consensus.cc:359] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.921198 9426 raft_consensus.cc:385] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.921288 9426 raft_consensus.cc:740] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.921654 9426 consensus_queue.cc:260] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.922145 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet fda9eb99ccef4c16a0a947510566ecf4 with delete_type TABLET_DATA_DELETED (replaced by tablet f45f8b2fbf754d359deb666cb605c789) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:10.922480 9943 tablet_replica.cc:333] T fda9eb99ccef4c16a0a947510566ecf4 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:10.922686 9943 raft_consensus.cc:2243] T fda9eb99ccef4c16a0a947510566ecf4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:10.922869 9943 raft_consensus.cc:2272] T fda9eb99ccef4c16a0a947510566ecf4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:10.923583 9943 ts_tablet_manager.cc:1916] T fda9eb99ccef4c16a0a947510566ecf4 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:10.926571 8787 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet e2104a3530264fa982b20aed20afb0b4 (table default.Table_d92a50e24ad64b9496b0cb3ca5d0dd9a [id=d916193804f94519b84d259c0420e1a1]). Expected version 2 got 0
I20251215 14:55:10.927011 8787 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet f121a14828e6443695960c0e540ae573 (table default.Table_159b0c9ea29840df94432fbee21770fd [id=0e3677e1f3d048ecad508d50304ee56a]). Expected version 2 got 0
W20251215 14:55:10.927776 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 5e80ac7bd98a46119a30bd5d2f3de2f9
W20251215 14:55:10.927886 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet c7f760639a664cfb9f4af5578154b981
W20251215 14:55:10.927961 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 188eb879e7c3479ea71c5b1864400243
W20251215 14:55:10.928066 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet bdfc164128a6413a83d83d05b69fb74a
W20251215 14:55:10.928171 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 5f03dfdd546c492185c6c31866a090a5
W20251215 14:55:10.928227 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet f9695d47e35448fdad95ff3f24bafd03
W20251215 14:55:10.928294 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 16309efc14e747d09ce6e5de4f3c2784
W20251215 14:55:10.928385 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 15a974e3265a4c88aa6d5005ffa04dc8
W20251215 14:55:10.928449 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 18cd1f63d51e4565bb8c55be13e3e099
W20251215 14:55:10.928494 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 38e50a7f2bdd4907ab41436b59397ea6
W20251215 14:55:10.928911 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 37181f50142f4d8bb88713221a755d50
I20251215 14:55:10.930160 8779 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet e2104a3530264fa982b20aed20afb0b4 (table default.Table_d92a50e24ad64b9496b0cb3ca5d0dd9a [id=d916193804f94519b84d259c0420e1a1]). Expected version 2 got 0
I20251215 14:55:10.930408 8779 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1]). Expected version 1 got 0
I20251215 14:55:10.930662 9943 ts_tablet_manager.cc:1929] T fda9eb99ccef4c16a0a947510566ecf4 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:10.930787 9943 log.cc:1199] T fda9eb99ccef4c16a0a947510566ecf4 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/fda9eb99ccef4c16a0a947510566ecf4
I20251215 14:55:10.930886 8779 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781]). Expected version 2 got 0
I20251215 14:55:10.931146 9943 ts_tablet_manager.cc:1950] T fda9eb99ccef4c16a0a947510566ecf4 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:10.932215 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet fda9eb99ccef4c16a0a947510566ecf4 (table default.Table_f6164e312b7a4576a27fab2ab89f91ca [id=c1c5f6c604c24855a17e2dfb4174965b]) successfully deleted
I20251215 14:55:10.932904 9426 ts_tablet_manager.cc:1434] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20251215 14:55:10.933982 9426 tablet_bootstrap.cc:492] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:10.935981 8781 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_a1e03b46c6e04ebbb7a47128968fb6de [id=2bd880b71b174f528054fbc22143c01f] alter complete (version 4)
I20251215 14:55:10.936481 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_4a67b8c805924b398590d08395cfcda2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:10.937013 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a67b8c805924b398590d08395cfcda2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.937281 10144 raft_consensus.cc:2749] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:10.938136 9248 leader_election.cc:343] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:10.938270 9248 leader_election.cc:304] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
W20251215 14:55:10.938799 8786 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 77780f8cfe544db7baee2c761fe52ca2 consensus state has no leader
I20251215 14:55:10.939153 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_2fa3900b9f0b4cb7a4d20f214f84369e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:10.939687 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2fa3900b9f0b4cb7a4d20f214f84369e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:10.940819 9426 tablet_bootstrap.cc:654] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.941254 9435 tablet_bootstrap.cc:654] T fda9eb99ccef4c16a0a947510566ecf4 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.941852 10144 raft_consensus.cc:2749] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:10.943539 8978 leader_election.cc:304] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:10.943924 8782 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 2268222317ec4d568ed56da2e5654387
I20251215 14:55:10.944027 10155 raft_consensus.cc:2804] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:10.944203 10155 raft_consensus.cc:697] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:10.944312 8782 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_8517e4afab414864a30f6afa1d656b2d" } modify_external_catalogs: true
I20251215 14:55:10.944473 8782 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_8517e4afab414864a30f6afa1d656b2d" } modify_external_catalogs: true
I20251215 14:55:10.944492 10155 consensus_queue.cc:237] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.951356 9507 raft_consensus.cc:493] T 194bb745ecb849cb9092fee1afb7dbe6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:10.951560 9507 raft_consensus.cc:515] T 194bb745ecb849cb9092fee1afb7dbe6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:10.951853 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 194bb745ecb849cb9092fee1afb7dbe6
W20251215 14:55:10.951929 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 5560a21e16bb43c7903c1fc66429ecdf
I20251215 14:55:10.952230 9507 leader_election.cc:290] T 194bb745ecb849cb9092fee1afb7dbe6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:10.952746 8785 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet e2104a3530264fa982b20aed20afb0b4 (table default.Table_d92a50e24ad64b9496b0cb3ca5d0dd9a [id=d916193804f94519b84d259c0420e1a1]). Expected version 2 got 0
I20251215 14:55:10.952901 8785 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781]). Expected version 2 got 0
I20251215 14:55:10.952979 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "194bb745ecb849cb9092fee1afb7dbe6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:10.953078 8785 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet bb3b95d32c7044bd8a4451381c19aeba (table default.Table_3194032074824e83a1f02ad85fbba951 [id=7ec65d77d89d4e40a60b716f721e2940]). Expected version 5 got 0
I20251215 14:55:10.953358 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "194bb745ecb849cb9092fee1afb7dbe6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:10.953604 9037 raft_consensus.cc:2393] T 194bb745ecb849cb9092fee1afb7dbe6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:10.953835 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet fda9eb99ccef4c16a0a947510566ecf4 with delete_type TABLET_DATA_DELETED (replaced by tablet f45f8b2fbf754d359deb666cb605c789) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:10.954967 9112 leader_election.cc:304] T 194bb745ecb849cb9092fee1afb7dbe6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
W20251215 14:55:10.955435 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet fda9eb99ccef4c16a0a947510566ecf4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fda9eb99ccef4c16a0a947510566ecf4 already in progress: creating tablet
I20251215 14:55:10.955790 9507 raft_consensus.cc:3060] T 194bb745ecb849cb9092fee1afb7dbe6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:10.958571 9427 tablet_bootstrap.cc:492] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:10.958683 9507 raft_consensus.cc:2749] T 194bb745ecb849cb9092fee1afb7dbe6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:10.958861 9427 ts_tablet_manager.cc:1403] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.158s user 0.010s sys 0.013s
I20251215 14:55:10.960422 9427 raft_consensus.cc:359] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.961584 9427 raft_consensus.cc:385] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.961724 9427 raft_consensus.cc:740] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.962121 9427 consensus_queue.cc:260] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.968693 9427 ts_tablet_manager.cc:1434] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.010s user 0.000s sys 0.003s
I20251215 14:55:10.973467 9427 tablet_bootstrap.cc:492] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:10.982579 9435 tablet_bootstrap.cc:492] T fda9eb99ccef4c16a0a947510566ecf4 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:10.982818 9435 ts_tablet_manager.cc:1403] T fda9eb99ccef4c16a0a947510566ecf4 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.064s user 0.004s sys 0.000s
I20251215 14:55:10.983691 9427 tablet_bootstrap.cc:654] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:10.984768 8787 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_145283350dd24d6ca18a985e25c2758d [id=bec2dd63f0aa4a05961adb6a70fbfd94] alter complete (version 2)
I20251215 14:55:10.984826 9435 raft_consensus.cc:359] T fda9eb99ccef4c16a0a947510566ecf4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.985028 9435 raft_consensus.cc:385] T fda9eb99ccef4c16a0a947510566ecf4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:10.985112 9435 raft_consensus.cc:740] T fda9eb99ccef4c16a0a947510566ecf4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:10.985368 9435 consensus_queue.cc:260] T fda9eb99ccef4c16a0a947510566ecf4 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.986330 9435 ts_tablet_manager.cc:1434] T fda9eb99ccef4c16a0a947510566ecf4 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:10.986678 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet fda9eb99ccef4c16a0a947510566ecf4 with delete_type TABLET_DATA_DELETED (replaced by tablet f45f8b2fbf754d359deb666cb605c789) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:10.989566 8773 catalog_manager.cc:4952] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet fda9eb99ccef4c16a0a947510566ecf4 because the tablet was not found. No further retry: Not found: Tablet not found: fda9eb99ccef4c16a0a947510566ecf4
W20251215 14:55:10.993722 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:55:10.994467 8781 catalog_manager.cc:5654] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129). New cstate: current_term: 1 leader_uuid: "67978ac4539d4b289e53f4eedd9a8156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:10.996703 10019 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:10.997203 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 5560a21e16bb43c7903c1fc66429ecdf
I20251215 14:55:10.997095 10019 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:10.997664 8779 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet a639396098a941249afd9c3560073131 (table default.Table_404807c380fa4483ac5e0545eb3028cd [id=5cc820ec2c8b427db1c89647b295363e]). Expected version 1 got 0
I20251215 14:55:10.997954 10019 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:10.995016 8781 catalog_manager.cc:5654] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129). New cstate: current_term: 1 leader_uuid: "67978ac4539d4b289e53f4eedd9a8156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:10.999012 8781 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1]). Expected version 1 got 0
W20251215 14:55:10.999279 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:55:11.003929 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:55:11.004084 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:11.004652 9507 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:11.005224 9435 tablet_bootstrap.cc:492] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:11.006016 9426 tablet_bootstrap.cc:492] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:11.006155 9426 ts_tablet_manager.cc:1403] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.073s user 0.002s sys 0.008s
I20251215 14:55:11.006878 9426 raft_consensus.cc:359] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.007042 9426 raft_consensus.cc:385] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.007126 9426 raft_consensus.cc:740] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.007476 9426 consensus_queue.cc:260] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.007694 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet fda9eb99ccef4c16a0a947510566ecf4 with delete_type TABLET_DATA_DELETED (replaced by tablet f45f8b2fbf754d359deb666cb605c789) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:11.007943 9944 tablet_replica.cc:333] T fda9eb99ccef4c16a0a947510566ecf4 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:11.007968 9426 ts_tablet_manager.cc:1434] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:11.008123 9944 raft_consensus.cc:2243] T fda9eb99ccef4c16a0a947510566ecf4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:11.008270 9426 tablet_bootstrap.cc:492] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:11.008281 9944 raft_consensus.cc:2272] T fda9eb99ccef4c16a0a947510566ecf4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:11.009851 9426 tablet_bootstrap.cc:654] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.021021 8785 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c3332b4583ce44ee84532c70bbe9eac4" } new_table_name: "default.Table_85664ed43073430ba25d65731ed7ca2e" modify_external_catalogs: true
I20251215 14:55:11.022347 8783 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_28b106a5f17b487c951bfa8a28bcd147" } modify_external_catalogs: true
I20251215 14:55:11.022529 8783 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_28b106a5f17b487c951bfa8a28bcd147" } modify_external_catalogs: true
I20251215 14:55:11.023783 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_1bc862badd3047f59da171da067890ba"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.024309 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1bc862badd3047f59da171da067890ba in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.025379 8787 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e726b47802404f3aaccb61d6aaaa72a5" } modify_external_catalogs: true
I20251215 14:55:11.025527 8787 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e726b47802404f3aaccb61d6aaaa72a5" } modify_external_catalogs: true
I20251215 14:55:11.027420 8784 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_a469ba7678054925965fe69d826f1c16" } new_table_name: "default.Table_6b689570cd944426b4edf8342163ef0e" modify_external_catalogs: true
I20251215 14:55:11.028514 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_b64a7171932e40a98f23a6f17569da03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.029032 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b64a7171932e40a98f23a6f17569da03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:11.030108 8772 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 77780f8cfe544db7baee2c761fe52ca2 (table default.Table_28b106a5f17b487c951bfa8a28bcd147 [id=f2428abb656749d0907096c2df05ef64], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 77780f8cfe544db7baee2c761fe52ca2 consensus state has no leader
I20251215 14:55:11.030612 8786 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_0c66ce7473b248f58f74dd76a8c48045" } new_table_name: "default.Table_5cb40c5780dd4319958f61003a3f06c3" modify_external_catalogs: true
I20251215 14:55:11.033411 8782 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 804ad50f38314be3bf9e118eee9fe748
I20251215 14:55:11.035604 8782 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_3f190fdaff1446908955f4b5957a8084 [id=cbafb4499c90447d8f185928d3e58b20]). Expected version 1 got 0
I20251215 14:55:11.037209 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 804ad50f38314be3bf9e118eee9fe748 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:11.039312 9944 ts_tablet_manager.cc:1916] T fda9eb99ccef4c16a0a947510566ecf4 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:11.040234 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet 804ad50f38314be3bf9e118eee9fe748 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:11.041117 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet f7af1f66c4f04f649379758ff1b3e387
W20251215 14:55:11.041227 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet f9411030d08d40aabbdee6670ba95821
W20251215 14:55:11.041961 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 194bb745ecb849cb9092fee1afb7dbe6
W20251215 14:55:11.042043 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 062a482917794ae5a67ec685a2491ba2
W20251215 14:55:11.042106 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 26876cdffd7e4664bc8f7efb74885776
W20251215 14:55:11.042150 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 1141b9a4cf3e4aa78529bed7f0375ff8
W20251215 14:55:11.042203 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet b329b0abcad742ff94c1a62a72d1b673
W20251215 14:55:11.042244 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet ce0154b24522401b9cc0e37fa502532f
W20251215 14:55:11.042295 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet fc9bda52c73e4aa6b7e2eb008c63391b
W20251215 14:55:11.042346 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 813cfeea5399457e91623fb3abf9fd32
W20251215 14:55:11.042400 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 0db6246dee2643d98094408410618259
W20251215 14:55:11.042484 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet fab39532fe6a403683952057c5ccabd9
W20251215 14:55:11.042546 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 188eb879e7c3479ea71c5b1864400243
W20251215 14:55:11.043429 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 804ad50f38314be3bf9e118eee9fe748 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 804ad50f38314be3bf9e118eee9fe748 already in progress: creating tablet
I20251215 14:55:11.041781 8782 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_efdad8beee5047ada8b6d4992fa8a978" } modify_external_catalogs: true
I20251215 14:55:11.044040 8782 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_efdad8beee5047ada8b6d4992fa8a978" } modify_external_catalogs: true
I20251215 14:55:11.041887 8779 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f88a18e5389a43c181dee6486cd0b5a3" } new_table_name: "default.Table_a8249edeac7a4721850526c72dcb864d" modify_external_catalogs: true
I20251215 14:55:11.046952 9944 ts_tablet_manager.cc:1929] T fda9eb99ccef4c16a0a947510566ecf4 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:11.047128 9944 log.cc:1199] T fda9eb99ccef4c16a0a947510566ecf4 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/fda9eb99ccef4c16a0a947510566ecf4
I20251215 14:55:11.047562 9944 ts_tablet_manager.cc:1950] T fda9eb99ccef4c16a0a947510566ecf4 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:11.049615 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet fda9eb99ccef4c16a0a947510566ecf4 (table default.Table_f6164e312b7a4576a27fab2ab89f91ca [id=c1c5f6c604c24855a17e2dfb4174965b]) successfully deleted
I20251215 14:55:11.050086 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet 804ad50f38314be3bf9e118eee9fe748 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:10 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:11.051148 8785 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a5b0004e03d4c068419eb00ebadf3f9 has no consensus state
W20251215 14:55:11.052278 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 804ad50f38314be3bf9e118eee9fe748 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 804ad50f38314be3bf9e118eee9fe748 already in progress: creating tablet
I20251215 14:55:11.053534 10019 raft_consensus.cc:493] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.053714 10019 raft_consensus.cc:515] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.054308 10019 leader_election.cc:290] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:11.055200 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605da10c8d3049e8b94caa9738576aab" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
W20251215 14:55:11.056516 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 804ad50f38314be3bf9e118eee9fe748 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 804ad50f38314be3bf9e118eee9fe748 already in progress: creating tablet
W20251215 14:55:11.056773 9115 leader_election.cc:343] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:11.057122 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605da10c8d3049e8b94caa9738576aab" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:11.057710 9112 leader_election.cc:343] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:11.057870 9112 leader_election.cc:304] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:11.057956 8783 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 77780f8cfe544db7baee2c761fe52ca2
I20251215 14:55:11.058364 10019 raft_consensus.cc:2749] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:11.059386 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet 77780f8cfe544db7baee2c761fe52ca2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:11.059520 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet 77780f8cfe544db7baee2c761fe52ca2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:11.059724 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 77780f8cfe544db7baee2c761fe52ca2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:11.060277 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 77780f8cfe544db7baee2c761fe52ca2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77780f8cfe544db7baee2c761fe52ca2 already in progress: creating tablet
I20251215 14:55:11.060370 9435 tablet_bootstrap.cc:654] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:11.061326 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 77780f8cfe544db7baee2c761fe52ca2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77780f8cfe544db7baee2c761fe52ca2 already in progress: creating tablet
I20251215 14:55:11.061425 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 95caeaf32d154c0ba4c88dd3f295876d
W20251215 14:55:11.062278 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 77780f8cfe544db7baee2c761fe52ca2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77780f8cfe544db7baee2c761fe52ca2 already in progress: creating tablet
I20251215 14:55:11.062512 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet 95caeaf32d154c0ba4c88dd3f295876d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:11.062819 10141 tablet_replica.cc:333] T 95caeaf32d154c0ba4c88dd3f295876d P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:11.062942 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 95caeaf32d154c0ba4c88dd3f295876d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:11.063036 10141 raft_consensus.cc:2243] T 95caeaf32d154c0ba4c88dd3f295876d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:11.063234 10141 raft_consensus.cc:2272] T 95caeaf32d154c0ba4c88dd3f295876d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:11.063501 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet 95caeaf32d154c0ba4c88dd3f295876d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:11.063815 9943 tablet_replica.cc:333] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:11.064033 9943 raft_consensus.cc:2243] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:11.064088 10141 ts_tablet_manager.cc:1916] T 95caeaf32d154c0ba4c88dd3f295876d P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:11.064270 9943 pending_rounds.cc:70] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3: Trying to abort 1 pending ops.
I20251215 14:55:11.064357 9943 pending_rounds.cc:77] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232759850337976320 op_type: NO_OP noop_request { }
I20251215 14:55:11.064469 9943 raft_consensus.cc:2889] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 14:55:11.064589 9943 raft_consensus.cc:2272] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:11.065544 9943 ts_tablet_manager.cc:1916] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:11.069561 9944 tablet_replica.cc:333] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:11.069866 9944 raft_consensus.cc:2243] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:11.070111 9944 raft_consensus.cc:2272] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:11.070693 9944 ts_tablet_manager.cc:1916] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251215 14:55:11.073633 8784 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e0c88310853f47b0aa1af9a3d676bef6 consensus state has no leader
W20251215 14:55:11.078521 8786 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e317c8dc24e481abb709e932fa39c29 consensus state has no leader
I20251215 14:55:11.078891 8782 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 16f21adcad0140119f7d189ec55c5ded
W20251215 14:55:11.079422 8779 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a7a401d5386499183b6560411f593b6 has no consensus state
I20251215 14:55:11.082480 10141 ts_tablet_manager.cc:1929] T 95caeaf32d154c0ba4c88dd3f295876d P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:11.082885 10141 log.cc:1199] T 95caeaf32d154c0ba4c88dd3f295876d P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/95caeaf32d154c0ba4c88dd3f295876d
I20251215 14:55:11.083559 9427 tablet_bootstrap.cc:492] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:11.084594 9427 ts_tablet_manager.cc:1403] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.113s user 0.004s sys 0.000s
I20251215 14:55:11.084656 10141 ts_tablet_manager.cc:1950] T 95caeaf32d154c0ba4c88dd3f295876d P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:11.093163 9427 raft_consensus.cc:359] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.095608 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 95caeaf32d154c0ba4c88dd3f295876d (table default.Table_e726b47802404f3aaccb61d6aaaa72a5 [id=62dd6789e50a49ca96ec0db0ef20bb44]) successfully deleted
I20251215 14:55:11.102555 8779 master_service.cc:954] ReplaceTablet: received request to replace tablet 9425749d471f4f95bbae030977e278e4 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:11.103914 9427 raft_consensus.cc:385] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.104164 9427 raft_consensus.cc:740] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.104475 9427 consensus_queue.cc:260] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.105283 9427 ts_tablet_manager.cc:1434] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20251215 14:55:11.105620 9427 tablet_bootstrap.cc:492] T f7af1f66c4f04f649379758ff1b3e387 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:11.107417 9427 tablet_bootstrap.cc:654] T f7af1f66c4f04f649379758ff1b3e387 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.109208 9435 tablet_bootstrap.cc:492] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:11.109436 9435 ts_tablet_manager.cc:1403] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.104s user 0.003s sys 0.000s
W20251215 14:55:11.109766 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 30c5c795ea4a4fe591cdf63320ec2521
I20251215 14:55:11.110242 9435 raft_consensus.cc:359] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.110500 9435 raft_consensus.cc:385] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.110601 9435 raft_consensus.cc:740] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.110884 9435 consensus_queue.cc:260] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.114174 9435 ts_tablet_manager.cc:1434] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251215 14:55:11.115865 9943 ts_tablet_manager.cc:1929] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:11.115999 9943 log.cc:1199] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/95caeaf32d154c0ba4c88dd3f295876d
I20251215 14:55:11.116405 9943 ts_tablet_manager.cc:1950] T 95caeaf32d154c0ba4c88dd3f295876d P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
W20251215 14:55:11.117020 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 30c5c795ea4a4fe591cdf63320ec2521
I20251215 14:55:11.118534 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 95caeaf32d154c0ba4c88dd3f295876d (table default.Table_e726b47802404f3aaccb61d6aaaa72a5 [id=62dd6789e50a49ca96ec0db0ef20bb44]) successfully deleted
I20251215 14:55:11.119061 9426 tablet_bootstrap.cc:492] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:11.119246 9426 ts_tablet_manager.cc:1403] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.111s user 0.010s sys 0.011s
I20251215 14:55:11.120020 9426 raft_consensus.cc:359] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.120210 9426 raft_consensus.cc:385] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.120283 9426 raft_consensus.cc:740] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.120383 9435 tablet_bootstrap.cc:492] T 77780f8cfe544db7baee2c761fe52ca2 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:11.122807 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 90c0254840b442a3817171b06f2726c8
I20251215 14:55:11.127358 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_253f83c7caaa4400aa254941b4b6794d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.127954 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_253f83c7caaa4400aa254941b4b6794d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.131441 8782 master_service.cc:954] ReplaceTablet: received request to replace tablet 4a6846144c8c409cad340e99374a38c6 from {username='slave'} at 127.0.0.1:49790
W20251215 14:55:11.134116 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 90c0254840b442a3817171b06f2726c8
I20251215 14:55:11.136358 9435 tablet_bootstrap.cc:654] T 77780f8cfe544db7baee2c761fe52ca2 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.140898 8782 master_service.cc:954] ReplaceTablet: received request to replace tablet 4af4cf6ec825467383349098eda661c6 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:11.143977 9426 consensus_queue.cc:260] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.147661 8779 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_9c3c46c55b45498cbd336827286a69aa" } new_table_name: "default.Table_d1bbae49dd2d4213b53635ea46c07990" modify_external_catalogs: true
I20251215 14:55:11.148998 8786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_cec087c50d3147c1a275c74922342970" } modify_external_catalogs: true
I20251215 14:55:11.149178 8786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_cec087c50d3147c1a275c74922342970" } modify_external_catalogs: true
I20251215 14:55:11.151427 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ef0f1361c40f4d8989e512a06a96e83c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.151964 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef0f1361c40f4d8989e512a06a96e83c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.152752 9426 ts_tablet_manager.cc:1434] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.033s user 0.002s sys 0.000s
I20251215 14:55:11.153074 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_e8365354eaa94ef580c03dcc8a937a81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.153559 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e8365354eaa94ef580c03dcc8a937a81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.155445 9426 tablet_bootstrap.cc:492] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:11.156256 8782 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 4af4cf6ec825467383349098eda661c6
I20251215 14:55:11.156714 8782 catalog_manager.cc:6724] ReplaceTablet: tablet 4af4cf6ec825467383349098eda661c6 deleted and replaced by tablet 3075b730e8ef4461aefaeb338fb5ef8e
I20251215 14:55:11.157895 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 4af4cf6ec825467383349098eda661c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 3075b730e8ef4461aefaeb338fb5ef8e) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:11.158902 8787 master_service.cc:954] ReplaceTablet: received request to replace tablet 95caeaf32d154c0ba4c88dd3f295876d from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:11.159759 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet 4af4cf6ec825467383349098eda661c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 3075b730e8ef4461aefaeb338fb5ef8e) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:11.160128 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ea901dccd4124611b16871022906a3eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.160646 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea901dccd4124611b16871022906a3eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.161041 9426 tablet_bootstrap.cc:654] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.162717 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet 4af4cf6ec825467383349098eda661c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 3075b730e8ef4461aefaeb338fb5ef8e) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:11.162819 8787 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_e7f7e3604c274a18a83a3fa1213829b7 [id=066e8ae14004436cb8b4f3f740b45b19]). Expected version 4 got 0
I20251215 14:55:11.162997 10141 tablet_replica.cc:333] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:11.163211 10141 raft_consensus.cc:2243] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:11.163475 10141 pending_rounds.cc:70] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156: Trying to abort 1 pending ops.
I20251215 14:55:11.163537 10141 pending_rounds.cc:77] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7232759852685938688 op_type: NO_OP noop_request { }
I20251215 14:55:11.163646 10141 raft_consensus.cc:2889] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251215 14:55:11.163739 10141 raft_consensus.cc:2272] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 14:55:11.163785 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 4af4cf6ec825467383349098eda661c6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4af4cf6ec825467383349098eda661c6 already in progress: creating tablet
I20251215 14:55:11.164786 10141 ts_tablet_manager.cc:1916] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:11.145288 9944 ts_tablet_manager.cc:1929] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:11.167415 9944 log.cc:1199] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/95caeaf32d154c0ba4c88dd3f295876d
I20251215 14:55:11.167810 9944 ts_tablet_manager.cc:1950] T 95caeaf32d154c0ba4c88dd3f295876d P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:11.168450 8787 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_e7f7e3604c274a18a83a3fa1213829b7 [id=066e8ae14004436cb8b4f3f740b45b19]). Expected version 4 got 0
I20251215 14:55:11.170446 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_5e843b61cca34828ad50b8a4c43b8195"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.170938 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5e843b61cca34828ad50b8a4c43b8195 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.175045 10141 ts_tablet_manager.cc:1929] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:11.175372 10141 log.cc:1199] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/4af4cf6ec825467383349098eda661c6
I20251215 14:55:11.176555 10141 ts_tablet_manager.cc:1950] T 4af4cf6ec825467383349098eda661c6 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:11.178686 9944 tablet_replica.cc:333] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:11.179385 9944 raft_consensus.cc:2243] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:11.181188 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 4af4cf6ec825467383349098eda661c6 (table default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e [id=6b4b04bb03f04a8a9cd7bc893acf612c]) successfully deleted
I20251215 14:55:11.181264 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 95caeaf32d154c0ba4c88dd3f295876d (table default.Table_e726b47802404f3aaccb61d6aaaa72a5 [id=62dd6789e50a49ca96ec0db0ef20bb44]) successfully deleted
W20251215 14:55:11.181623 8779 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 682cafa003a64138a01024be2573fe34 consensus state has no leader
I20251215 14:55:11.182228 8786 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 15a2d51b67ae4e17b8d4c9261147c755
I20251215 14:55:11.183799 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_6a799de3eef44940b8461740c75bcec3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.184341 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a799de3eef44940b8461740c75bcec3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.184530 9427 tablet_bootstrap.cc:492] T f7af1f66c4f04f649379758ff1b3e387 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:11.184691 9427 ts_tablet_manager.cc:1403] T f7af1f66c4f04f649379758ff1b3e387 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.079s user 0.000s sys 0.007s
I20251215 14:55:11.185449 9427 raft_consensus.cc:359] T f7af1f66c4f04f649379758ff1b3e387 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.185711 9427 raft_consensus.cc:385] T f7af1f66c4f04f649379758ff1b3e387 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.185811 9427 raft_consensus.cc:740] T f7af1f66c4f04f649379758ff1b3e387 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.186086 9427 consensus_queue.cc:260] T f7af1f66c4f04f649379758ff1b3e387 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.186770 9427 ts_tablet_manager.cc:1434] T f7af1f66c4f04f649379758ff1b3e387 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:11.187179 9427 tablet_bootstrap.cc:492] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:11.188931 8779 master_service.cc:954] ReplaceTablet: received request to replace tablet bdfc164128a6413a83d83d05b69fb74a from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:11.189961 10155 raft_consensus.cc:493] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.190130 10155 raft_consensus.cc:515] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.190563 9944 raft_consensus.cc:2272] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 14:55:11.190728 8780 catalog_manager.cc:5487] Ignoring report from unknown tablet f7af1f66c4f04f649379758ff1b3e387
I20251215 14:55:11.190856 10155 leader_election.cc:290] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:11.191483 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e80ac7bd98a46119a30bd5d2f3de2f9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:11.191725 9306 raft_consensus.cc:2468] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:11.192116 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e80ac7bd98a46119a30bd5d2f3de2f9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:11.192634 8976 leader_election.cc:343] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:11.192673 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ae37b3213f06436890e9b2f39a03fc72"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:11.193154 8978 leader_election.cc:304] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
W20251215 14:55:11.193231 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ae37b3213f06436890e9b2f39a03fc72 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.193645 10155 raft_consensus.cc:2804] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:11.193747 10155 raft_consensus.cc:493] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:11.193830 10155 raft_consensus.cc:3060] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:11.195951 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet f7af1f66c4f04f649379758ff1b3e387
I20251215 14:55:11.196154 9427 tablet_bootstrap.cc:654] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.196390 10019 raft_consensus.cc:493] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.196547 10019 raft_consensus.cc:515] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.197247 10019 leader_election.cc:290] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:11.197829 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:11.197949 9426 tablet_bootstrap.cc:492] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:11.198087 9426 ts_tablet_manager.cc:1403] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.043s user 0.006s sys 0.001s
I20251215 14:55:11.198196 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f121a14828e6443695960c0e540ae573" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:11.198432 9306 raft_consensus.cc:2468] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:11.198963 9115 leader_election.cc:304] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:11.199188 9426 raft_consensus.cc:359] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.199452 9426 raft_consensus.cc:385] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.199585 9426 raft_consensus.cc:740] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.199858 9426 consensus_queue.cc:260] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.199831 10155 raft_consensus.cc:515] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.200187 9507 raft_consensus.cc:2804] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:11.200310 9507 raft_consensus.cc:493] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:11.200397 9507 raft_consensus.cc:3060] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:11.203081 9507 raft_consensus.cc:515] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.203994 9507 leader_election.cc:290] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:11.204588 9426 ts_tablet_manager.cc:1434] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20251215 14:55:11.204838 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e80ac7bd98a46119a30bd5d2f3de2f9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:11.205009 9426 tablet_bootstrap.cc:492] T 9bf4a899338f4bcfac099b5099a22f05 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:11.205504 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f121a14828e6443695960c0e540ae573" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:11.205708 9306 raft_consensus.cc:3060] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:11.206200 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
I20251215 14:55:11.206900 9426 tablet_bootstrap.cc:654] T 9bf4a899338f4bcfac099b5099a22f05 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.208665 9306 raft_consensus.cc:2468] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:11.209990 9427 tablet_bootstrap.cc:492] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:11.209964 9115 leader_election.cc:304] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:11.210216 9507 raft_consensus.cc:2804] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:11.210350 9507 raft_consensus.cc:697] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
W20251215 14:55:11.210355 8976 leader_election.cc:343] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:11.210609 9507 consensus_queue.cc:237] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.212054 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f121a14828e6443695960c0e540ae573" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:11.212504 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f121a14828e6443695960c0e540ae573" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:11.213460 9427 ts_tablet_manager.cc:1403] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.001s
I20251215 14:55:11.214484 9427 raft_consensus.cc:359] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.219290 9427 raft_consensus.cc:385] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.219643 9427 raft_consensus.cc:740] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.220311 9427 consensus_queue.cc:260] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.220407 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ce3b9c30c09e4078b51902229c8bebdc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.220991 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce3b9c30c09e4078b51902229c8bebdc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.221873 9427 ts_tablet_manager.cc:1434] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20251215 14:55:11.222159 9427 tablet_bootstrap.cc:492] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:11.222895 9112 leader_election.cc:343] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:11.223302 9112 leader_election.cc:343] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:11.226586 8787 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_3f190fdaff1446908955f4b5957a8084 [id=cbafb4499c90447d8f185928d3e58b20]). Expected version 1 got 0
I20251215 14:55:11.236183 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e80ac7bd98a46119a30bd5d2f3de2f9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:11.236383 9306 raft_consensus.cc:3060] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:11.238943 9306 raft_consensus.cc:2468] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:11.239881 8788 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c6d8ee8140464d86871ee6cc6141fce3" } modify_external_catalogs: true
I20251215 14:55:11.239938 8978 leader_election.cc:304] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:11.240078 8788 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c6d8ee8140464d86871ee6cc6141fce3" } modify_external_catalogs: true
I20251215 14:55:11.240216 10114 raft_consensus.cc:2804] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:11.240351 10114 raft_consensus.cc:697] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:11.240604 10114 consensus_queue.cc:237] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.240815 10155 leader_election.cc:290] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:11.252478 8788 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 7fd7f0ff96c54765926c6d45ea6a20a5
I20251215 14:55:11.253633 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet 7fd7f0ff96c54765926c6d45ea6a20a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:11.254317 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 7fd7f0ff96c54765926c6d45ea6a20a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fd7f0ff96c54765926c6d45ea6a20a5 already in progress: creating tablet
I20251215 14:55:11.254539 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 7fd7f0ff96c54765926c6d45ea6a20a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:11.254595 8788 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_8fe903d6d8e74a54acb4eaf2bc1cbbda" } new_table_name: "default.Table_df5cd1437ab641ea87c1567d9cb6e8f1" modify_external_catalogs: true
I20251215 14:55:11.256489 9427 tablet_bootstrap.cc:654] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.257313 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet 7fd7f0ff96c54765926c6d45ea6a20a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:11.258119 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 7fd7f0ff96c54765926c6d45ea6a20a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fd7f0ff96c54765926c6d45ea6a20a5 already in progress: creating tablet
I20251215 14:55:11.258857 8782 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet bb3b95d32c7044bd8a4451381c19aeba (table default.Table_3194032074824e83a1f02ad85fbba951 [id=7ec65d77d89d4e40a60b716f721e2940]). Expected version 5 got 0
I20251215 14:55:11.259107 8782 catalog_manager.cc:5654] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130). New cstate: current_term: 1 leader_uuid: "3ea5306c36594ef4a62211f2bd6669a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:11.259509 8782 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet f121a14828e6443695960c0e540ae573 (table default.Table_159b0c9ea29840df94432fbee21770fd [id=0e3677e1f3d048ecad508d50304ee56a]). Expected version 2 got 0
I20251215 14:55:11.260823 8780 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_68741bcb63154f56abf551a2c960108c" } modify_external_catalogs: true
I20251215 14:55:11.260982 8780 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_68741bcb63154f56abf551a2c960108c" } modify_external_catalogs: true
I20251215 14:55:11.261759 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_b0aecf72214b481db15755603aab9cfe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.262326 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b0aecf72214b481db15755603aab9cfe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.264966 9944 ts_tablet_manager.cc:1916] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:11.264950 8787 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_a1e03b46c6e04ebbb7a47128968fb6de" } modify_external_catalogs: true
I20251215 14:55:11.265152 8787 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_a1e03b46c6e04ebbb7a47128968fb6de" } modify_external_catalogs: true
I20251215 14:55:11.268080 9426 tablet_bootstrap.cc:492] T 9bf4a899338f4bcfac099b5099a22f05 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
W20251215 14:55:11.268977 8788 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52e93348b205408f83efff27fde48e9b has no consensus state
I20251215 14:55:11.271190 9426 ts_tablet_manager.cc:1403] T 9bf4a899338f4bcfac099b5099a22f05 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.066s user 0.000s sys 0.006s
I20251215 14:55:11.271654 9435 tablet_bootstrap.cc:492] T 77780f8cfe544db7baee2c761fe52ca2 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:11.271809 9435 ts_tablet_manager.cc:1403] T 77780f8cfe544db7baee2c761fe52ca2 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.157s user 0.003s sys 0.000s
I20251215 14:55:11.272207 9426 raft_consensus.cc:359] T 9bf4a899338f4bcfac099b5099a22f05 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.272457 9426 raft_consensus.cc:385] T 9bf4a899338f4bcfac099b5099a22f05 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.272563 9426 raft_consensus.cc:740] T 9bf4a899338f4bcfac099b5099a22f05 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.272591 9435 raft_consensus.cc:359] T 77780f8cfe544db7baee2c761fe52ca2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.272795 9435 raft_consensus.cc:385] T 77780f8cfe544db7baee2c761fe52ca2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.272888 9435 raft_consensus.cc:740] T 77780f8cfe544db7baee2c761fe52ca2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.272934 9426 consensus_queue.cc:260] T 9bf4a899338f4bcfac099b5099a22f05 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.273126 9435 consensus_queue.cc:260] T 77780f8cfe544db7baee2c761fe52ca2 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.275473 9426 ts_tablet_manager.cc:1434] T 9bf4a899338f4bcfac099b5099a22f05 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251215 14:55:11.278144 9426 tablet_bootstrap.cc:492] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:11.282402 9426 tablet_bootstrap.cc:654] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.282634 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 77780f8cfe544db7baee2c761fe52ca2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:11.283766 8779 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e" } modify_external_catalogs: true
I20251215 14:55:11.283872 8784 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e7f7e3604c274a18a83a3fa1213829b7" } new_table_name: "default.Table_66a863188e16424797450ead992a2bba" modify_external_catalogs: true
I20251215 14:55:11.283984 8779 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e" } modify_external_catalogs: true
I20251215 14:55:11.284399 8783 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_baa5664946144147bafee4511b30105f" } new_table_name: "default.Table_e318dee48a27456cbdc9027374e3e97a" modify_external_catalogs: true
I20251215 14:55:11.286145 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_e073cd03acc04d7bbf396abc459c8049"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.286686 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e073cd03acc04d7bbf396abc459c8049 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.289196 8786 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_0593d9b93de9400ba29718af1b328262" } new_table_name: "default.Table_d906d0f5a04a4c73bb02b6621abb99db" modify_external_catalogs: true
W20251215 14:55:11.290445 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 5e80ac7bd98a46119a30bd5d2f3de2f9
I20251215 14:55:11.291639 8780 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet a7cb14a555914e25a50d98d13267c296
I20251215 14:55:11.292516 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet a7cb14a555914e25a50d98d13267c296 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:11.292867 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet a7cb14a555914e25a50d98d13267c296 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:11.292881 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet a7cb14a555914e25a50d98d13267c296 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:11.293205 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet a7cb14a555914e25a50d98d13267c296 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7cb14a555914e25a50d98d13267c296 already in progress: creating tablet
I20251215 14:55:11.293427 9435 ts_tablet_manager.cc:1434] T 77780f8cfe544db7baee2c761fe52ca2 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.022s user 0.002s sys 0.000s
W20251215 14:55:11.293582 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet a7cb14a555914e25a50d98d13267c296 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7cb14a555914e25a50d98d13267c296 already in progress: creating tablet
I20251215 14:55:11.293975 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 3cdfcddd91fe47de8fd14dc718f421a6
I20251215 14:55:11.294574 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet 3cdfcddd91fe47de8fd14dc718f421a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:11.294785 9943 tablet_replica.cc:333] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:11.294986 9943 raft_consensus.cc:2243] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:11.295050 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet 3cdfcddd91fe47de8fd14dc718f421a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:11.295135 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 3cdfcddd91fe47de8fd14dc718f421a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:11.295347 10141 tablet_replica.cc:333] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:11.295359 9943 raft_consensus.cc:2272] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:11.295523 10141 raft_consensus.cc:2243] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:11.295707 10141 raft_consensus.cc:2272] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:11.296629 10141 ts_tablet_manager.cc:1916] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:11.296646 9943 ts_tablet_manager.cc:1916] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:11.297472 9435 tablet_bootstrap.cc:492] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:11.301735 9435 tablet_bootstrap.cc:654] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.303755 9943 ts_tablet_manager.cc:1929] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251215 14:55:11.305716 9943 log.cc:1199] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/3cdfcddd91fe47de8fd14dc718f421a6
W20251215 14:55:11.307394 8783 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6229b8bc8d3d446c944c819670b10d54 consensus state has no leader
I20251215 14:55:11.308326 8779 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 3075b730e8ef4461aefaeb338fb5ef8e
W20251215 14:55:11.312974 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bf4a899338f4bcfac099b5099a22f05
I20251215 14:55:11.313619 9427 tablet_bootstrap.cc:492] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:11.314235 9943 ts_tablet_manager.cc:1950] T 3cdfcddd91fe47de8fd14dc718f421a6 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:11.316679 9427 ts_tablet_manager.cc:1403] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.094s user 0.002s sys 0.002s
I20251215 14:55:11.321427 8779 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet e2104a3530264fa982b20aed20afb0b4 (table default.Table_d92a50e24ad64b9496b0cb3ca5d0dd9a [id=d916193804f94519b84d259c0420e1a1]). Expected version 2 got 0
W20251215 14:55:11.322788 8784 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bafc5063058a469bb9c9b3e5345eb1be consensus state has no leader
I20251215 14:55:11.326694 8784 master_service.cc:954] ReplaceTablet: received request to replace tablet 5dc81eb40614463cb5017475b378eea6 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:11.327335 9427 raft_consensus.cc:359] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.328817 10189 tablet.cc:1722] T e2104a3530264fa982b20aed20afb0b4 P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:11.332922 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 3cdfcddd91fe47de8fd14dc718f421a6 (table default.Table_a1e03b46c6e04ebbb7a47128968fb6de [id=2bd880b71b174f528054fbc22143c01f]) successfully deleted
I20251215 14:55:11.341665 9426 tablet_bootstrap.cc:492] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:11.342136 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_e51fbd4ee3b74a7b8c6be8288d9676f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.342692 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e51fbd4ee3b74a7b8c6be8288d9676f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.342892 9944 ts_tablet_manager.cc:1929] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:11.343015 9944 log.cc:1199] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/4af4cf6ec825467383349098eda661c6
I20251215 14:55:11.343415 9944 ts_tablet_manager.cc:1950] T 4af4cf6ec825467383349098eda661c6 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:11.345304 9944 tablet_replica.cc:333] T 77780f8cfe544db7baee2c761fe52ca2 P e89303a500544272b601d7c29be802b4: stopping tablet replica
W20251215 14:55:11.345273 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 7fd7f0ff96c54765926c6d45ea6a20a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7fd7f0ff96c54765926c6d45ea6a20a5 already in progress: creating tablet
I20251215 14:55:11.345677 9944 raft_consensus.cc:2243] T 77780f8cfe544db7baee2c761fe52ca2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:11.345829 10141 ts_tablet_manager.cc:1929] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251215 14:55:11.345893 9944 raft_consensus.cc:2272] T 77780f8cfe544db7baee2c761fe52ca2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:11.345889 9427 raft_consensus.cc:385] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.345989 10141 log.cc:1199] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/3cdfcddd91fe47de8fd14dc718f421a6
I20251215 14:55:11.346031 9427 raft_consensus.cc:740] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.346450 10141 ts_tablet_manager.cc:1950] T 3cdfcddd91fe47de8fd14dc718f421a6 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:11.346886 9427 consensus_queue.cc:260] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.347869 9944 ts_tablet_manager.cc:1916] T 77780f8cfe544db7baee2c761fe52ca2 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:11.351751 9426 ts_tablet_manager.cc:1403] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.076s user 0.004s sys 0.000s
W20251215 14:55:11.352404 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 96b2d20fd2304e7a9995206a043b7944
I20251215 14:55:11.352723 9426 raft_consensus.cc:359] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.352928 9426 raft_consensus.cc:385] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.353035 9426 raft_consensus.cc:740] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.353272 9426 consensus_queue.cc:260] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.353453 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 3cdfcddd91fe47de8fd14dc718f421a6 (table default.Table_a1e03b46c6e04ebbb7a47128968fb6de [id=2bd880b71b174f528054fbc22143c01f]) successfully deleted
I20251215 14:55:11.353821 9426 ts_tablet_manager.cc:1434] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:11.354137 9426 tablet_bootstrap.cc:492] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:11.354296 9427 ts_tablet_manager.cc:1434] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.035s user 0.003s sys 0.000s
W20251215 14:55:11.359560 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 5e80ac7bd98a46119a30bd5d2f3de2f9
W20251215 14:55:11.359603 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 96b2d20fd2304e7a9995206a043b7944
I20251215 14:55:11.362239 9427 tablet_bootstrap.cc:492] T 5560a21e16bb43c7903c1fc66429ecdf P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:11.364216 8784 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 5dc81eb40614463cb5017475b378eea6
I20251215 14:55:11.364742 8784 catalog_manager.cc:6724] ReplaceTablet: tablet 5dc81eb40614463cb5017475b378eea6 deleted and replaced by tablet 43e9cfdc89b04781b7b5892af07307af
I20251215 14:55:11.365280 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet 5dc81eb40614463cb5017475b378eea6 with delete_type TABLET_DATA_DELETED (replaced by tablet 43e9cfdc89b04781b7b5892af07307af) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:11.365674 9160 tablet_service.cc:1552] Processing DeleteTablet for tablet 5dc81eb40614463cb5017475b378eea6 with delete_type TABLET_DATA_DELETED (replaced by tablet 43e9cfdc89b04781b7b5892af07307af) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:11.366266 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 5dc81eb40614463cb5017475b378eea6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dc81eb40614463cb5017475b378eea6 already in progress: creating tablet
I20251215 14:55:11.367553 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 5dc81eb40614463cb5017475b378eea6 with delete_type TABLET_DATA_DELETED (replaced by tablet 43e9cfdc89b04781b7b5892af07307af) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:11.368858 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 5dc81eb40614463cb5017475b378eea6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dc81eb40614463cb5017475b378eea6 already in progress: creating tablet
I20251215 14:55:11.369524 9427 tablet_bootstrap.cc:654] T 5560a21e16bb43c7903c1fc66429ecdf P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.370772 10019 raft_consensus.cc:493] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.370929 10019 raft_consensus.cc:515] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.372272 8786 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_d92a50e24ad64b9496b0cb3ca5d0dd9a [id=d916193804f94519b84d259c0420e1a1] alter complete (version 2)
I20251215 14:55:11.373589 10019 leader_election.cc:290] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:11.374745 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bafc5063058a469bb9c9b3e5345eb1be" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:11.374982 9034 raft_consensus.cc:2393] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:11.376950 9172 raft_consensus.cc:3060] T bfead52afe8040a88ba0d826f482b1bd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:11.379876 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bafc5063058a469bb9c9b3e5345eb1be" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:11.380156 9306 raft_consensus.cc:2393] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:11.380615 9115 leader_election.cc:304] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:11.381147 10019 raft_consensus.cc:3060] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:11.383776 10019 raft_consensus.cc:2749] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:11.384752 8785 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_a8249edeac7a4721850526c72dcb864d" } new_table_name: "default.Table_e8f8eecfb3344f2993bfc87489b344ed" modify_external_catalogs: true
I20251215 14:55:11.386102 8786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_a5079bcaff9847bf96a580ee3bbeea4d" } modify_external_catalogs: true
I20251215 14:55:11.386302 8786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_a5079bcaff9847bf96a580ee3bbeea4d" } modify_external_catalogs: true
I20251215 14:55:11.395326 10240 tablet.cc:1722] T e2104a3530264fa982b20aed20afb0b4 P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:11.397764 9944 ts_tablet_manager.cc:1929] T 77780f8cfe544db7baee2c761fe52ca2 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20251215 14:55:11.400236 8785 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a7a401d5386499183b6560411f593b6 has no consensus state
I20251215 14:55:11.402752 9944 log.cc:1199] T 77780f8cfe544db7baee2c761fe52ca2 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/77780f8cfe544db7baee2c761fe52ca2
I20251215 14:55:11.406680 8786 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 96859e2f707b46f4b2b98a589c5417a9
I20251215 14:55:11.409946 9944 ts_tablet_manager.cc:1950] T 77780f8cfe544db7baee2c761fe52ca2 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:11.410948 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 77780f8cfe544db7baee2c761fe52ca2 (table default.Table_28b106a5f17b487c951bfa8a28bcd147 [id=f2428abb656749d0907096c2df05ef64]) successfully deleted
W20251215 14:55:11.412050 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet a7cb14a555914e25a50d98d13267c296 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a7cb14a555914e25a50d98d13267c296 already in progress: creating tablet
I20251215 14:55:11.412094 10189 tablet.cc:1722] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:11.413501 9944 tablet_replica.cc:333] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:11.414023 9944 raft_consensus.cc:2243] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:11.414680 9944 raft_consensus.cc:2272] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:11.415992 9944 ts_tablet_manager.cc:1916] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:11.423527 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_d246863c572741ba93765655a7445caf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.424186 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d246863c572741ba93765655a7445caf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.425549 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_34f674e6f3e34e739110435de6af285e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.426090 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34f674e6f3e34e739110435de6af285e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.430894 10240 tablet.cc:1722] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:11.434906 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_eec6fe4b648b481ab6d411e3cf33dcca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:11.435271 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_974ade2140a44f24b046a797944f71f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:11.435770 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_20804605d90d4fba9f88e94a70e903e4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.437808 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_20804605d90d4fba9f88e94a70e903e4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.438287 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_8ad0b32830224acbb2af0187d4e1c783"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.438799 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ad0b32830224acbb2af0187d4e1c783 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:11.437830 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_974ade2140a44f24b046a797944f71f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.440560 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_44ff5f3f5bac4c479d54084f4b377291"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.441107 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_44ff5f3f5bac4c479d54084f4b377291 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:11.442535 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eec6fe4b648b481ab6d411e3cf33dcca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.443239 9426 tablet_bootstrap.cc:654] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.448323 9427 tablet_bootstrap.cc:492] T 5560a21e16bb43c7903c1fc66429ecdf P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:11.448550 9427 ts_tablet_manager.cc:1403] T 5560a21e16bb43c7903c1fc66429ecdf P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.087s user 0.007s sys 0.003s
I20251215 14:55:11.449437 9427 raft_consensus.cc:359] T 5560a21e16bb43c7903c1fc66429ecdf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.449687 9427 raft_consensus.cc:385] T 5560a21e16bb43c7903c1fc66429ecdf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.449828 9427 raft_consensus.cc:740] T 5560a21e16bb43c7903c1fc66429ecdf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.450136 9427 consensus_queue.cc:260] T 5560a21e16bb43c7903c1fc66429ecdf P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.450862 9427 ts_tablet_manager.cc:1434] T 5560a21e16bb43c7903c1fc66429ecdf P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:11.451222 9427 tablet_bootstrap.cc:492] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:11.453250 9427 tablet_bootstrap.cc:654] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.454942 10019 raft_consensus.cc:493] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.455806 8786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_71fb566bde204f5a9381ce697d4188a2" } modify_external_catalogs: true
I20251215 14:55:11.455982 8786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_71fb566bde204f5a9381ce697d4188a2" } modify_external_catalogs: true
W20251215 14:55:11.461151 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 5560a21e16bb43c7903c1fc66429ecdf
W20251215 14:55:11.462132 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:11.467516 9435 tablet_bootstrap.cc:492] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:11.468357 8784 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_d906d0f5a04a4c73bb02b6621abb99db [id=50a94314f5ba46e3a75b5a15e7362299] alter complete (version 2)
I20251215 14:55:11.469647 9427 tablet_bootstrap.cc:492] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:11.470232 9427 ts_tablet_manager.cc:1403] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.000s
I20251215 14:55:11.471350 9427 raft_consensus.cc:359] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.471504 8780 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_41cfaeeb78b544a38b5c116552bbecfa" } new_table_name: "default.Table_12b99071f9224445935f70cba021453f" modify_external_catalogs: true
I20251215 14:55:11.471689 9427 raft_consensus.cc:385] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.471838 9427 raft_consensus.cc:740] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.472128 9427 consensus_queue.cc:260] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.472963 9427 ts_tablet_manager.cc:1434] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:11.476351 9427 tablet_bootstrap.cc:492] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:11.477207 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet ff4508c5a110427eb4d9d2eaaadace0b
I20251215 14:55:11.478068 9427 tablet_bootstrap.cc:654] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.479324 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_72caf0a9fac64b729b0c5a76c38ad7d8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.480333 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72caf0a9fac64b729b0c5a76c38ad7d8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:11.482575 8780 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2811b8ffdb614c91b0d3d4e6e039245b consensus state has no leader
W20251215 14:55:11.482743 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet ff4508c5a110427eb4d9d2eaaadace0b
I20251215 14:55:11.491777 9427 tablet_bootstrap.cc:492] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:11.491931 9427 ts_tablet_manager.cc:1403] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.001s
I20251215 14:55:11.492645 9427 raft_consensus.cc:359] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.495357 8782 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_b7af23e2b15b483b86f9bc4b3b65802b" } modify_external_catalogs: true
I20251215 14:55:11.495563 8782 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_b7af23e2b15b483b86f9bc4b3b65802b" } modify_external_catalogs: true
I20251215 14:55:11.497413 10019 raft_consensus.cc:515] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.499230 9427 raft_consensus.cc:385] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.499490 9427 raft_consensus.cc:740] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.499630 9435 ts_tablet_manager.cc:1403] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.170s user 0.014s sys 0.008s
I20251215 14:55:11.499850 9427 consensus_queue.cc:260] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.500690 9427 ts_tablet_manager.cc:1434] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20251215 14:55:11.500777 9435 raft_consensus.cc:359] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.500981 9435 raft_consensus.cc:385] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.501073 9435 raft_consensus.cc:740] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.501300 9435 consensus_queue.cc:260] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.501852 9435 ts_tablet_manager.cc:1434] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:11.502209 9435 tablet_bootstrap.cc:492] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:11.504709 8780 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_96cdb82e10874b08bd807d3d485cf7bf" } modify_external_catalogs: true
I20251215 14:55:11.504889 8780 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_96cdb82e10874b08bd807d3d485cf7bf" } modify_external_catalogs: true
I20251215 14:55:11.505745 9427 tablet_bootstrap.cc:492] T 5dc81eb40614463cb5017475b378eea6 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:11.507532 9427 tablet_bootstrap.cc:654] T 5dc81eb40614463cb5017475b378eea6 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:11.508320 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 6ae72a1ded6e4faba1ad309d9a0e4a95
I20251215 14:55:11.508602 9435 tablet_bootstrap.cc:654] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.510052 8785 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_9fff09bdf4114198810006599bcf1f3d" } new_table_name: "default.Table_0923c14f03464a8390571358e5de2145" modify_external_catalogs: true
I20251215 14:55:11.511319 8783 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ce3b9c30c09e4078b51902229c8bebdc" } modify_external_catalogs: true
I20251215 14:55:11.511502 8783 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ce3b9c30c09e4078b51902229c8bebdc" } modify_external_catalogs: true
I20251215 14:55:11.511704 9971 raft_consensus.cc:493] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.511853 9971 raft_consensus.cc:515] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.512454 9971 leader_election.cc:290] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:11.513330 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a639396098a941249afd9c3560073131" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:11.513751 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf4a899338f4bcfac099b5099a22f05" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:11.514578 9248 leader_election.cc:343] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:11.517710 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 6ae72a1ded6e4faba1ad309d9a0e4a95
I20251215 14:55:11.518972 9944 ts_tablet_manager.cc:1929] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251215 14:55:11.519091 9944 log.cc:1199] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/3cdfcddd91fe47de8fd14dc718f421a6
W20251215 14:55:11.520771 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 2d75636265f14a428aae592438064ea2
I20251215 14:55:11.523092 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a639396098a941249afd9c3560073131" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:11.525363 8784 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_afbea73c46dc454ca7c4be632d7ad3a8" } new_table_name: "default.Table_0dbbd5bb23f0401981c6073b7212eaab" modify_external_catalogs: true
W20251215 14:55:11.526834 8785 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 605da10c8d3049e8b94caa9738576aab consensus state has no leader
I20251215 14:55:11.525125 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ed2fa3c1ae2e4112a755c1be18a481c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.528944 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed2fa3c1ae2e4112a755c1be18a481c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.531150 8787 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_99268441afd84c5fbfbd1080deabb144" } new_table_name: "default.Table_fa9bdd64a2344e899709bfadad99fd70" modify_external_catalogs: true
I20251215 14:55:11.531854 9427 tablet_bootstrap.cc:492] T 5dc81eb40614463cb5017475b378eea6 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:11.532619 9427 ts_tablet_manager.cc:1403] T 5dc81eb40614463cb5017475b378eea6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.000s
I20251215 14:55:11.533497 9427 raft_consensus.cc:359] T 5dc81eb40614463cb5017475b378eea6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:11.533566 9112 leader_election.cc:343] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:11.533787 9427 raft_consensus.cc:385] T 5dc81eb40614463cb5017475b378eea6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.533875 9427 raft_consensus.cc:740] T 5dc81eb40614463cb5017475b378eea6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.534175 9427 consensus_queue.cc:260] T 5dc81eb40614463cb5017475b378eea6 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:11.535625 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 2d75636265f14a428aae592438064ea2
I20251215 14:55:11.535931 9427 ts_tablet_manager.cc:1434] T 5dc81eb40614463cb5017475b378eea6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:11.536295 10019 leader_election.cc:290] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:11.537026 9427 tablet_bootstrap.cc:492] T f121a14828e6443695960c0e540ae573 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:11.537835 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf4a899338f4bcfac099b5099a22f05" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:11.538196 9180 raft_consensus.cc:2468] T 9bf4a899338f4bcfac099b5099a22f05 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:11.538784 9249 leader_election.cc:304] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:11.539281 9971 raft_consensus.cc:2804] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:11.539383 9971 raft_consensus.cc:493] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251215 14:55:11.539391 9115 leader_election.cc:343] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:11.539500 9971 raft_consensus.cc:3060] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:11.542142 9971 raft_consensus.cc:515] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.544785 9971 leader_election.cc:290] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:11.546141 9115 leader_election.cc:304] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:11.546375 9427 tablet_bootstrap.cc:654] T f121a14828e6443695960c0e540ae573 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.548636 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf4a899338f4bcfac099b5099a22f05" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
W20251215 14:55:11.549539 9248 leader_election.cc:343] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:11.552121 9944 ts_tablet_manager.cc:1950] T 3cdfcddd91fe47de8fd14dc718f421a6 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
W20251215 14:55:11.552798 8784 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 809257b3929a4c2f91132f9315752130 has no consensus state
I20251215 14:55:11.553925 10019 raft_consensus.cc:2749] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:11.561030 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 3cdfcddd91fe47de8fd14dc718f421a6 (table default.Table_a1e03b46c6e04ebbb7a47128968fb6de [id=2bd880b71b174f528054fbc22143c01f]) successfully deleted
W20251215 14:55:11.561367 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 5dc81eb40614463cb5017475b378eea6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5dc81eb40614463cb5017475b378eea6 already in progress: creating tablet
I20251215 14:55:11.564975 9435 tablet_bootstrap.cc:492] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:11.564929 9013 tablet_service.cc:1505] Processing CreateTablet for tablet 88edc14acdad47a3907078d08e118ce7 (DEFAULT_TABLE table=default.Table_b0aecf72214b481db15755603aab9cfe [id=988e29dd61514c8bab87f5ae7c59259d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.565811 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 88edc14acdad47a3907078d08e118ce7 (DEFAULT_TABLE table=default.Table_b0aecf72214b481db15755603aab9cfe [id=988e29dd61514c8bab87f5ae7c59259d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.566193 8783 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 265a8937802a4b9cbf0edaf3e2a41ba8
I20251215 14:55:11.566231 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88edc14acdad47a3907078d08e118ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.565271 9435 ts_tablet_manager.cc:1403] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.063s user 0.006s sys 0.007s
I20251215 14:55:11.567214 9015 tablet_service.cc:1552] Processing DeleteTablet for tablet 265a8937802a4b9cbf0edaf3e2a41ba8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:11.567589 9971 raft_consensus.cc:493] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.567752 9971 raft_consensus.cc:515] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.568073 9435 raft_consensus.cc:359] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.568750 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb3b95d32c7044bd8a4451381c19aeba" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:11.568950 9034 raft_consensus.cc:2468] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:11.573407 8780 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 8eb90003cf02440e9752af134a3670b6
I20251215 14:55:11.573910 9435 raft_consensus.cc:385] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.569444 9248 leader_election.cc:304] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:11.574107 9015 tablet_service.cc:1505] Processing CreateTablet for tablet 49bba2b78f65470182e1d361eb1272a4 (DEFAULT_TABLE table=default.Table_ef0f1361c40f4d8989e512a06a96e83c [id=384cfc28778e4b77846e409a7001beb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.574544 10145 raft_consensus.cc:2804] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:11.574707 10145 raft_consensus.cc:493] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:11.574801 10145 raft_consensus.cc:3060] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:11.575400 9016 tablet_service.cc:1552] Processing DeleteTablet for tablet 8eb90003cf02440e9752af134a3670b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:11.575996 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88edc14acdad47a3907078d08e118ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.577287 10145 raft_consensus.cc:515] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.571636 9289 tablet_service.cc:1552] Processing DeleteTablet for tablet 265a8937802a4b9cbf0edaf3e2a41ba8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:11.579409 10145 leader_election.cc:290] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:11.579751 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49bba2b78f65470182e1d361eb1272a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.580442 9289 tablet_service.cc:1552] Processing DeleteTablet for tablet 8eb90003cf02440e9752af134a3670b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:11.580914 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb3b95d32c7044bd8a4451381c19aeba" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:11.581103 9034 raft_consensus.cc:3060] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:11.581869 9427 tablet_bootstrap.cc:492] T f121a14828e6443695960c0e540ae573 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:11.582019 9427 ts_tablet_manager.cc:1403] T f121a14828e6443695960c0e540ae573 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.045s user 0.004s sys 0.000s
I20251215 14:55:11.582896 9427 raft_consensus.cc:359] T f121a14828e6443695960c0e540ae573 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.583067 9427 raft_consensus.cc:385] T f121a14828e6443695960c0e540ae573 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.583155 9427 raft_consensus.cc:740] T f121a14828e6443695960c0e540ae573 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.583478 8782 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet bee9a28b78184d4893a845120670e302
I20251215 14:55:11.583441 9427 consensus_queue.cc:260] T f121a14828e6443695960c0e540ae573 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.568943 9971 leader_election.cc:290] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:11.584535 9427 ts_tablet_manager.cc:1434] T f121a14828e6443695960c0e540ae573 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
W20251215 14:55:11.584751 8772 catalog_manager.cc:4952] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 265a8937802a4b9cbf0edaf3e2a41ba8 because the tablet was not found. No further retry: Not found: Tablet not found: 265a8937802a4b9cbf0edaf3e2a41ba8
I20251215 14:55:11.584925 9427 tablet_bootstrap.cc:492] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:11.585016 8772 catalog_manager.cc:4952] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 8eb90003cf02440e9752af134a3670b6 because the tablet was not found. No further retry: Not found: Tablet not found: 8eb90003cf02440e9752af134a3670b6
I20251215 14:55:11.585016 9435 raft_consensus.cc:740] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.585486 9016 tablet_service.cc:1552] Processing DeleteTablet for tablet bee9a28b78184d4893a845120670e302 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:11.585493 9435 consensus_queue.cc:260] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.587041 9427 tablet_bootstrap.cc:654] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:11.589020 8775 catalog_manager.cc:4952] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 265a8937802a4b9cbf0edaf3e2a41ba8 because the tablet was not found. No further retry: Not found: Tablet not found: 265a8937802a4b9cbf0edaf3e2a41ba8
W20251215 14:55:11.589303 8775 catalog_manager.cc:4952] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 8eb90003cf02440e9752af134a3670b6 because the tablet was not found. No further retry: Not found: Tablet not found: 8eb90003cf02440e9752af134a3670b6
I20251215 14:55:11.589758 9034 raft_consensus.cc:2468] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:11.590135 9289 tablet_service.cc:1552] Processing DeleteTablet for tablet bee9a28b78184d4893a845120670e302 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:11.590353 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_f85607e14d2647c4a7036f8d5ef7d9f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:11.590166 9248 leader_election.cc:304] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:11.590986 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f85607e14d2647c4a7036f8d5ef7d9f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.591077 10144 raft_consensus.cc:2804] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
W20251215 14:55:11.592155 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet bee9a28b78184d4893a845120670e302 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bee9a28b78184d4893a845120670e302 already in progress: creating tablet
W20251215 14:55:11.592500 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet bee9a28b78184d4893a845120670e302 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bee9a28b78184d4893a845120670e302 already in progress: creating tablet
I20251215 14:55:11.597007 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 49bba2b78f65470182e1d361eb1272a4 (DEFAULT_TABLE table=default.Table_ef0f1361c40f4d8989e512a06a96e83c [id=384cfc28778e4b77846e409a7001beb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.597441 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49bba2b78f65470182e1d361eb1272a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.600477 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb3b95d32c7044bd8a4451381c19aeba" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:11.600728 9179 raft_consensus.cc:2468] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:11.601344 9160 tablet_service.cc:1505] Processing CreateTablet for tablet 88edc14acdad47a3907078d08e118ce7 (DEFAULT_TABLE table=default.Table_b0aecf72214b481db15755603aab9cfe [id=988e29dd61514c8bab87f5ae7c59259d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.601433 9426 tablet_bootstrap.cc:492] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:11.601619 9426 ts_tablet_manager.cc:1403] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.248s user 0.009s sys 0.000s
I20251215 14:55:11.601668 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bb3b95d32c7044bd8a4451381c19aeba" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:11.601863 9170 raft_consensus.cc:3060] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:11.602437 9426 raft_consensus.cc:359] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.602628 9426 raft_consensus.cc:385] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.602697 9426 raft_consensus.cc:740] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.603667 9013 tablet_service.cc:1505] Processing CreateTablet for tablet 06cb17538a7541358548f25303e91d37 (DEFAULT_TABLE table=default.Table_253f83c7caaa4400aa254941b4b6794d [id=3c04856615e7426a8549bf328f132c41]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.604060 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06cb17538a7541358548f25303e91d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.604239 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 06cb17538a7541358548f25303e91d37 (DEFAULT_TABLE table=default.Table_253f83c7caaa4400aa254941b4b6794d [id=3c04856615e7426a8549bf328f132c41]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.603332 9151 tablet_service.cc:1552] Processing DeleteTablet for tablet 265a8937802a4b9cbf0edaf3e2a41ba8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:11.602910 9426 consensus_queue.cc:260] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.604637 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06cb17538a7541358548f25303e91d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.603430 9148 tablet_service.cc:1552] Processing DeleteTablet for tablet 8eb90003cf02440e9752af134a3670b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:11.603766 9145 tablet_service.cc:1552] Processing DeleteTablet for tablet bee9a28b78184d4893a845120670e302 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:11.603832 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf4a899338f4bcfac099b5099a22f05" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:11.603346 10253 tablet.cc:1722] T e2104a3530264fa982b20aed20afb0b4 P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:11.610148 10144 raft_consensus.cc:697] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:11.610874 10144 consensus_queue.cc:237] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.613189 10240 tablet.cc:1722] T ae8a49b9a3bf4845943b1ad8e318ccbb P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251215 14:55:11.613741 9180 raft_consensus.cc:3060] T 9bf4a899338f4bcfac099b5099a22f05 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:11.614634 9435 ts_tablet_manager.cc:1434] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.048s user 0.001s sys 0.001s
I20251215 14:55:11.615937 9015 tablet_service.cc:1505] Processing CreateTablet for tablet 4167c404f73e484abcb2e5b30431b28c (DEFAULT_TABLE table=default.Table_b64a7171932e40a98f23a6f17569da03 [id=eaa4df4948e542c4b4d0b2e7b6470938]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.617058 8783 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_8ee3cade1b94484b8cdf7579a865f570" } new_table_name: "default.Table_122936ccef3e435c8c1f31bf260935d6" modify_external_catalogs: true
I20251215 14:55:11.603665 9158 tablet_service.cc:1505] Processing CreateTablet for tablet 49bba2b78f65470182e1d361eb1272a4 (DEFAULT_TABLE table=default.Table_ef0f1361c40f4d8989e512a06a96e83c [id=384cfc28778e4b77846e409a7001beb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.619257 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4167c404f73e484abcb2e5b30431b28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.619544 10189 tablet.cc:1722] T ae8a49b9a3bf4845943b1ad8e318ccbb P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251215 14:55:11.619907 8787 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_b527fedbc2c14bb3861289fe2b27fd43" } modify_external_catalogs: true
I20251215 14:55:11.620082 8787 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_b527fedbc2c14bb3861289fe2b27fd43" } modify_external_catalogs: true
I20251215 14:55:11.622483 8786 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet e6084ebf2a804bfc9d2c2cde3e0cba98
I20251215 14:55:11.625656 9426 ts_tablet_manager.cc:1434] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s
I20251215 14:55:11.626183 9435 tablet_bootstrap.cc:492] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:11.627262 9016 tablet_service.cc:1552] Processing DeleteTablet for tablet e6084ebf2a804bfc9d2c2cde3e0cba98 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:11.627381 9014 tablet_service.cc:1552] Processing DeleteTablet for tablet 5dc81eb40614463cb5017475b378eea6 with delete_type TABLET_DATA_DELETED (replaced by tablet 43e9cfdc89b04781b7b5892af07307af) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:11.627717 10141 tablet_replica.cc:333] T 5dc81eb40614463cb5017475b378eea6 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:11.627941 10141 raft_consensus.cc:2243] T 5dc81eb40614463cb5017475b378eea6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:11.628096 10141 raft_consensus.cc:2272] T 5dc81eb40614463cb5017475b378eea6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
W20251215 14:55:11.628254 8772 consensus_peers.cc:597] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 -> Peer cad1fca07ac7419cb608c21541f672f3 (127.8.121.190:44279): Couldn't send request to peer cad1fca07ac7419cb608c21541f672f3. Status: Network error: Client connection negotiation failed: client connection to 127.8.121.190:44279: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20251215 14:55:11.629069 8772 catalog_manager.cc:4952] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet e6084ebf2a804bfc9d2c2cde3e0cba98 because the tablet was not found. No further retry: Not found: Tablet not found: e6084ebf2a804bfc9d2c2cde3e0cba98
I20251215 14:55:11.629482 10141 ts_tablet_manager.cc:1916] T 5dc81eb40614463cb5017475b378eea6 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:11.629498 9289 tablet_service.cc:1552] Processing DeleteTablet for tablet e6084ebf2a804bfc9d2c2cde3e0cba98 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:11.630290 8775 catalog_manager.cc:4952] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet e6084ebf2a804bfc9d2c2cde3e0cba98 because the tablet was not found. No further retry: Not found: Tablet not found: e6084ebf2a804bfc9d2c2cde3e0cba98
I20251215 14:55:11.633858 8782 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet f121a14828e6443695960c0e540ae573 (table default.Table_159b0c9ea29840df94432fbee21770fd [id=0e3677e1f3d048ecad508d50304ee56a]). Expected version 2 got 0
I20251215 14:55:11.634617 9435 tablet_bootstrap.cc:654] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.635293 9427 tablet_bootstrap.cc:492] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:11.635461 9427 ts_tablet_manager.cc:1403] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.051s user 0.001s sys 0.006s
I20251215 14:55:11.637188 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 4167c404f73e484abcb2e5b30431b28c (DEFAULT_TABLE table=default.Table_b64a7171932e40a98f23a6f17569da03 [id=eaa4df4948e542c4b4d0b2e7b6470938]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.637392 9014 tablet_service.cc:1505] Processing CreateTablet for tablet ee44c7244b68469183a4e45baeaf5df4 (DEFAULT_TABLE table=default.Table_4a67b8c805924b398590d08395cfcda2 [id=5bc6fa88b2454db2aa1aa31f42e0c621]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.637588 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4167c404f73e484abcb2e5b30431b28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.637768 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee44c7244b68469183a4e45baeaf5df4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.640502 10141 ts_tablet_manager.cc:1929] T 5dc81eb40614463cb5017475b378eea6 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:11.640637 10141 log.cc:1199] T 5dc81eb40614463cb5017475b378eea6 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/5dc81eb40614463cb5017475b378eea6
I20251215 14:55:11.641005 10141 ts_tablet_manager.cc:1950] T 5dc81eb40614463cb5017475b378eea6 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
W20251215 14:55:11.641351 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:11.642248 9435 tablet_bootstrap.cc:492] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:11.642292 10019 raft_consensus.cc:493] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.642596 9435 ts_tablet_manager.cc:1403] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.000s
I20251215 14:55:11.642603 9145 tablet_service.cc:1505] Processing CreateTablet for tablet 06cb17538a7541358548f25303e91d37 (DEFAULT_TABLE table=default.Table_253f83c7caaa4400aa254941b4b6794d [id=3c04856615e7426a8549bf328f132c41]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.643505 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 5dc81eb40614463cb5017475b378eea6 (table default.Table_76a8f78ec8a74aadaf69142df6990dc8 [id=94ddd629cb1e4f5eb0061100187f4202]) successfully deleted
I20251215 14:55:11.644850 9435 raft_consensus.cc:359] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.646152 9014 tablet_service.cc:1505] Processing CreateTablet for tablet 809257b3929a4c2f91132f9315752130 (DEFAULT_TABLE table=default.Table_0dbbd5bb23f0401981c6073b7212eaab [id=9d534758686c45a0aa2ef880a3ec6fe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.646562 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 809257b3929a4c2f91132f9315752130. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.646764 9435 raft_consensus.cc:385] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.646880 9435 raft_consensus.cc:740] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.646889 9283 tablet_service.cc:1505] Processing CreateTablet for tablet ee44c7244b68469183a4e45baeaf5df4 (DEFAULT_TABLE table=default.Table_4a67b8c805924b398590d08395cfcda2 [id=5bc6fa88b2454db2aa1aa31f42e0c621]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.647485 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee44c7244b68469183a4e45baeaf5df4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.647222 9435 consensus_queue.cc:260] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.650312 9435 ts_tablet_manager.cc:1434] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20251215 14:55:11.650959 9170 raft_consensus.cc:2468] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:11.651326 10019 raft_consensus.cc:515] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.651930 10019 leader_election.cc:290] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:11.653010 9148 tablet_service.cc:1552] Processing DeleteTablet for tablet e6084ebf2a804bfc9d2c2cde3e0cba98 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:11.653733 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_8ada3442cb634e7ab02a4866ccbb228f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.654359 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ada3442cb634e7ab02a4866ccbb228f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.656487 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88edc14acdad47a3907078d08e118ce7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.659302 9145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06cb17538a7541358548f25303e91d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.660583 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49bba2b78f65470182e1d361eb1272a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.661415 9180 raft_consensus.cc:2468] T 9bf4a899338f4bcfac099b5099a22f05 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:11.664157 9435 tablet_bootstrap.cc:492] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:11.666355 8783 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a09ed5b19594fba9e73f7b6e3f7bd4f consensus state has no leader
I20251215 14:55:11.667320 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet c00aecc23c6541cbae4abd7cb1b3077b
I20251215 14:55:11.657864 10250 tablet.cc:1722] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:11.668582 8782 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_fa9bdd64a2344e899709bfadad99fd70 [id=02a2b4848c874afe8f9860eee9bc6ce7] alter complete (version 3)
I20251215 14:55:11.673568 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_aee0201b52bb4f58bcde6c4b80d384fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.674226 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aee0201b52bb4f58bcde6c4b80d384fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.675464 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ab3da14c1f8c4acc8c3123098dfe3a00"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.675977 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab3da14c1f8c4acc8c3123098dfe3a00 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.677093 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_08d34aa4d5924089a6b2af6c82ca6dd5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.678025 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08d34aa4d5924089a6b2af6c82ca6dd5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.678740 9151 tablet_service.cc:1505] Processing CreateTablet for tablet ee44c7244b68469183a4e45baeaf5df4 (DEFAULT_TABLE table=default.Table_4a67b8c805924b398590d08395cfcda2 [id=5bc6fa88b2454db2aa1aa31f42e0c621]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.680124 9148 tablet_service.cc:1505] Processing CreateTablet for tablet 4167c404f73e484abcb2e5b30431b28c (DEFAULT_TABLE table=default.Table_b64a7171932e40a98f23a6f17569da03 [id=eaa4df4948e542c4b4d0b2e7b6470938]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.680387 9144 tablet_service.cc:1552] Processing DeleteTablet for tablet c00aecc23c6541cbae4abd7cb1b3077b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:11.680974 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c88aa9616bff4d35942bc6dab8595dd3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.681492 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c88aa9616bff4d35942bc6dab8595dd3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:11.682031 8773 catalog_manager.cc:4952] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 265a8937802a4b9cbf0edaf3e2a41ba8 because the tablet was not found. No further retry: Not found: Tablet not found: 265a8937802a4b9cbf0edaf3e2a41ba8
W20251215 14:55:11.682639 8773 catalog_manager.cc:4952] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 8eb90003cf02440e9752af134a3670b6 because the tablet was not found. No further retry: Not found: Tablet not found: 8eb90003cf02440e9752af134a3670b6
W20251215 14:55:11.683118 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet bee9a28b78184d4893a845120670e302 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bee9a28b78184d4893a845120670e302 already in progress: creating tablet
W20251215 14:55:11.683394 8773 catalog_manager.cc:4952] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet e6084ebf2a804bfc9d2c2cde3e0cba98 because the tablet was not found. No further retry: Not found: Tablet not found: e6084ebf2a804bfc9d2c2cde3e0cba98
I20251215 14:55:11.683627 9943 tablet_replica.cc:333] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:11.683861 9943 raft_consensus.cc:2243] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:11.684890 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_e6fb80aef50c40c6afdb4075838ecfb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.685417 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e6fb80aef50c40c6afdb4075838ecfb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.686012 9943 raft_consensus.cc:2272] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:11.686689 9943 ts_tablet_manager.cc:1916] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:11.687224 8785 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d6b14175291d4c458b8f055e472350e0" } new_table_name: "default.Table_90d85b2eda064ee08a629de633d7f5bf" modify_external_catalogs: true
I20251215 14:55:11.687574 9157 tablet_service.cc:1505] Processing CreateTablet for tablet 809257b3929a4c2f91132f9315752130 (DEFAULT_TABLE table=default.Table_0dbbd5bb23f0401981c6073b7212eaab [id=9d534758686c45a0aa2ef880a3ec6fe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.689095 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_6f7cb4c5d71649b7a375b8eb03570b24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.689833 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f7cb4c5d71649b7a375b8eb03570b24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.691228 9151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee44c7244b68469183a4e45baeaf5df4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.692131 9427 raft_consensus.cc:359] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.692231 9016 tablet_service.cc:1552] Processing DeleteTablet for tablet c00aecc23c6541cbae4abd7cb1b3077b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:11.692375 9427 raft_consensus.cc:385] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.692456 9427 raft_consensus.cc:740] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.692579 9426 tablet_bootstrap.cc:492] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:11.692695 9427 consensus_queue.cc:260] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.693210 9427 ts_tablet_manager.cc:1434] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.058s user 0.000s sys 0.002s
I20251215 14:55:11.693574 9427 tablet_bootstrap.cc:492] T 9bf4a899338f4bcfac099b5099a22f05 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:11.693790 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_d4adfdbe45474b609d1a67c85d378eb4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.694386 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4adfdbe45474b609d1a67c85d378eb4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.695314 10141 tablet_replica.cc:333] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:11.695497 10141 raft_consensus.cc:2243] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:11.695696 10141 raft_consensus.cc:2272] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:11.696198 10141 ts_tablet_manager.cc:1916] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:11.699415 9144 tablet_service.cc:1552] Processing DeleteTablet for tablet 4af4cf6ec825467383349098eda661c6 with delete_type TABLET_DATA_DELETED (replaced by tablet 3075b730e8ef4461aefaeb338fb5ef8e) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:11.708374 9112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 83540.7us
W20251215 14:55:11.711637 8976 consensus_peers.cc:597] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:11.712162 9037 raft_consensus.cc:3060] T f121a14828e6443695960c0e540ae573 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:11.712827 9507 raft_consensus.cc:493] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.712997 9507 raft_consensus.cc:515] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.713634 9507 leader_election.cc:290] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:11.715093 9112 leader_election.cc:343] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 4af4cf6ec825467383349098eda661c6
I20251215 14:55:11.716277 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5560a21e16bb43c7903c1fc66429ecdf" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:11.716471 9040 raft_consensus.cc:2468] T 5560a21e16bb43c7903c1fc66429ecdf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:11.719511 9037 raft_consensus.cc:1275] T f121a14828e6443695960c0e540ae573 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Refusing update from remote peer 3ea5306c36594ef4a62211f2bd6669a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 14:55:11.719869 9112 leader_election.cc:304] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:11.720225 9507 raft_consensus.cc:2804] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:11.720326 9507 raft_consensus.cc:493] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:11.720420 9507 raft_consensus.cc:3060] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:11.720724 8785 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce147d1fcda2480daa557276c33a6096 consensus state has no leader
I20251215 14:55:11.723193 9507 raft_consensus.cc:515] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.724112 9507 leader_election.cc:290] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:11.726786 9507 consensus_queue.cc:1048] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:11.727802 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7
I20251215 14:55:11.729061 8787 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_3e9e6e3198074dafb1f68a49d5fe8fbc" } new_table_name: "default.Table_1b528fe70b3e4803a17a4755e2a7cc86" modify_external_catalogs: true
I20251215 14:55:11.734676 9016 tablet_service.cc:1505] Processing CreateTablet for tablet f0e8dad82b3e4eff971b7b6845970c4f (DEFAULT_TABLE table=default.Table_8021aec3ccb641bca49fd8b5a35a2888 [id=caf8fac49b35421084bdd9826485b2dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.735105 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e8dad82b3e4eff971b7b6845970c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.735561 9007 tablet_service.cc:1505] Processing CreateTablet for tablet ce147d1fcda2480daa557276c33a6096 (DEFAULT_TABLE table=default.Table_90d85b2eda064ee08a629de633d7f5bf [id=7271667c5a2348ee90354f8f9097d791]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.735935 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5560a21e16bb43c7903c1fc66429ecdf" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:11.736186 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce147d1fcda2480daa557276c33a6096. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.737133 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 809257b3929a4c2f91132f9315752130. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.737138 9040 raft_consensus.cc:3060] T 5560a21e16bb43c7903c1fc66429ecdf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:11.738406 9427 tablet_bootstrap.cc:654] T 9bf4a899338f4bcfac099b5099a22f05 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.739280 9153 tablet_service.cc:1505] Processing CreateTablet for tablet ce147d1fcda2480daa557276c33a6096 (DEFAULT_TABLE table=default.Table_90d85b2eda064ee08a629de633d7f5bf [id=7271667c5a2348ee90354f8f9097d791]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.740233 9153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce147d1fcda2480daa557276c33a6096. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.742215 9154 tablet_service.cc:1505] Processing CreateTablet for tablet 5dc9405b80e84ae7a67a595c3596cc92 (DEFAULT_TABLE table=default.Table_d12285644d7e481cb7a99358a2696b73 [id=7a8aae0645284e04a14092965a9fe4b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.744993 9040 raft_consensus.cc:2468] T 5560a21e16bb43c7903c1fc66429ecdf P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:11.745020 9144 tablet_service.cc:1505] Processing CreateTablet for tablet f0e8dad82b3e4eff971b7b6845970c4f (DEFAULT_TABLE table=default.Table_8021aec3ccb641bca49fd8b5a35a2888 [id=caf8fac49b35421084bdd9826485b2dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.748844 9146 tablet_service.cc:1505] Processing CreateTablet for tablet 18054b180c77403387d15fc6ee42f58f (DEFAULT_TABLE table=default.Table_197581ae0a7e4231b70573029ab493d5 [id=508a25f83ead424e867e4b5a62ff7635]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.751652 9148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4167c404f73e484abcb2e5b30431b28c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.752051 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc9405b80e84ae7a67a595c3596cc92. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.754877 9146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18054b180c77403387d15fc6ee42f58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.755141 9016 tablet_service.cc:1505] Processing CreateTablet for tablet 18054b180c77403387d15fc6ee42f58f (DEFAULT_TABLE table=default.Table_197581ae0a7e4231b70573029ab493d5 [id=508a25f83ead424e867e4b5a62ff7635]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.755437 8786 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_5e843b61cca34828ad50b8a4c43b8195" } new_table_name: "default.Table_ac2ccf4d3e5b44de808a7a4108394f9c" modify_external_catalogs: true
I20251215 14:55:11.755581 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18054b180c77403387d15fc6ee42f58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.756347 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e8dad82b3e4eff971b7b6845970c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.758754 8783 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_8ada3442cb634e7ab02a4866ccbb228f" } new_table_name: "default.Table_86c6dc8b4a624840b2920c56cdf1a347" modify_external_catalogs: true
I20251215 14:55:11.759789 9427 tablet_bootstrap.cc:492] T 9bf4a899338f4bcfac099b5099a22f05 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:11.759949 9427 ts_tablet_manager.cc:1403] T 9bf4a899338f4bcfac099b5099a22f05 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.066s user 0.001s sys 0.003s
I20251215 14:55:11.760172 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_76bb79d40aa04a9785bc282e229bd6c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:11.760232 9007 tablet_service.cc:1505] Processing CreateTablet for tablet b4a856793e8b46cfb42110de5d383ff7 (DEFAULT_TABLE table=default.Table_29d5bb2dae4a45a3b86f0e8f5b69dc0a [id=81cf043be94c44afaef4b8c7f1ce1b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.760679 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a856793e8b46cfb42110de5d383ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.761034 9158 tablet_service.cc:1505] Processing CreateTablet for tablet b4a856793e8b46cfb42110de5d383ff7 (DEFAULT_TABLE table=default.Table_29d5bb2dae4a45a3b86f0e8f5b69dc0a [id=81cf043be94c44afaef4b8c7f1ce1b00]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:11.761150 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_76bb79d40aa04a9785bc282e229bd6c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.761406 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a856793e8b46cfb42110de5d383ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.762589 9013 tablet_service.cc:1505] Processing CreateTablet for tablet e79295168c8b456ba4fdc2379fbd0961 (DEFAULT_TABLE table=default.Table_47af3ae3eb6842989fb577f2c63e95af [id=a504c9556de84ec1811b6c022a9732ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.763130 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79295168c8b456ba4fdc2379fbd0961. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.765316 9112 leader_election.cc:304] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:11.768076 8785 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d4adfdbe45474b609d1a67c85d378eb4" } modify_external_catalogs: true
I20251215 14:55:11.768277 8785 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d4adfdbe45474b609d1a67c85d378eb4" } modify_external_catalogs: true
I20251215 14:55:11.768827 9426 tablet_bootstrap.cc:654] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.770928 10145 raft_consensus.cc:493] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.771258 9507 raft_consensus.cc:2804] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:11.771812 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet f121a14828e6443695960c0e540ae573 (table default.Table_159b0c9ea29840df94432fbee21770fd [id=0e3677e1f3d048ecad508d50304ee56a]). Expected version 2 got 0
I20251215 14:55:11.771917 9507 raft_consensus.cc:697] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:11.771139 10145 raft_consensus.cc:515] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.772246 9507 consensus_queue.cc:237] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.775297 9249 leader_election.cc:304] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
W20251215 14:55:11.775673 9249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 93156.9us
I20251215 14:55:11.777052 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "90c0254840b442a3817171b06f2726c8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:11.777904 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "90c0254840b442a3817171b06f2726c8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:11.779251 10253 tablet.cc:1722] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:11.780560 8788 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e318dee48a27456cbdc9027374e3e97a" } modify_external_catalogs: true
I20251215 14:55:11.780866 8788 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e318dee48a27456cbdc9027374e3e97a" } modify_external_catalogs: true
I20251215 14:55:11.782250 9971 raft_consensus.cc:2804] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:11.787608 8784 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f191a21e4c4f41c2910805786164e8ff" } modify_external_catalogs: true
I20251215 14:55:11.787798 8784 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f191a21e4c4f41c2910805786164e8ff" } modify_external_catalogs: true
W20251215 14:55:11.794673 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:11.806834 10021 raft_consensus.cc:493] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.807001 10021 raft_consensus.cc:515] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.808020 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 809257b3929a4c2f91132f9315752130 (DEFAULT_TABLE table=default.Table_0dbbd5bb23f0401981c6073b7212eaab [id=9d534758686c45a0aa2ef880a3ec6fe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.808516 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 809257b3929a4c2f91132f9315752130. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.810101 9142 tablet_service.cc:1505] Processing CreateTablet for tablet e79295168c8b456ba4fdc2379fbd0961 (DEFAULT_TABLE table=default.Table_47af3ae3eb6842989fb577f2c63e95af [id=a504c9556de84ec1811b6c022a9732ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.810534 9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79295168c8b456ba4fdc2379fbd0961. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.811340 9147 tablet_service.cc:1505] Processing CreateTablet for tablet 9c4be1c01418432492268598f97289a0 (DEFAULT_TABLE table=default.Table_b5a947cbfd574aa9b8291c27604daa3f [id=1ae34c7bbec44224a57fcbdf5d1b73b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.811702 9147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4be1c01418432492268598f97289a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.814824 10021 leader_election.cc:290] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:11.817068 10114 raft_consensus.cc:493] T f7af1f66c4f04f649379758ff1b3e387 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.817219 10114 raft_consensus.cc:515] T f7af1f66c4f04f649379758ff1b3e387 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.817468 9149 tablet_service.cc:1505] Processing CreateTablet for tablet 1c989af5bc624699b4cce2b5c95fc90e (DEFAULT_TABLE table=default.Table_a6e5907883f24cdbb16a9e092c46e70c [id=137b4c899daf4ebab526f21c3837f7b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.817808 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c989af5bc624699b4cce2b5c95fc90e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.818943 10114 leader_election.cc:290] T f7af1f66c4f04f649379758ff1b3e387 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:11.819145 9015 tablet_service.cc:1505] Processing CreateTablet for tablet 1c989af5bc624699b4cce2b5c95fc90e (DEFAULT_TABLE table=default.Table_a6e5907883f24cdbb16a9e092c46e70c [id=137b4c899daf4ebab526f21c3837f7b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.819618 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c989af5bc624699b4cce2b5c95fc90e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.817992 9427 raft_consensus.cc:359] T 9bf4a899338f4bcfac099b5099a22f05 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.821444 9013 tablet_service.cc:1505] Processing CreateTablet for tablet 9c4be1c01418432492268598f97289a0 (DEFAULT_TABLE table=default.Table_b5a947cbfd574aa9b8291c27604daa3f [id=1ae34c7bbec44224a57fcbdf5d1b73b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.822052 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4be1c01418432492268598f97289a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.823184 10141 ts_tablet_manager.cc:1929] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:11.823359 10141 log.cc:1199] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/c00aecc23c6541cbae4abd7cb1b3077b
I20251215 14:55:11.824397 8780 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_15ad0aa39f5048228397e27df88eea2f" } modify_external_catalogs: true
I20251215 14:55:11.824493 10141 ts_tablet_manager.cc:1950] T c00aecc23c6541cbae4abd7cb1b3077b P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:11.824585 8780 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_15ad0aa39f5048228397e27df88eea2f" } modify_external_catalogs: true
I20251215 14:55:11.825711 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet c00aecc23c6541cbae4abd7cb1b3077b (table default.Table_b527fedbc2c14bb3861289fe2b27fd43 [id=640d70bd78554e92823dc104e06227d3]) successfully deleted
I20251215 14:55:11.825950 9427 raft_consensus.cc:385] T 9bf4a899338f4bcfac099b5099a22f05 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.826179 9427 raft_consensus.cc:740] T 9bf4a899338f4bcfac099b5099a22f05 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.826458 9427 consensus_queue.cc:260] T 9bf4a899338f4bcfac099b5099a22f05 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.830246 9427 ts_tablet_manager.cc:1434] T 9bf4a899338f4bcfac099b5099a22f05 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.070s user 0.001s sys 0.001s
I20251215 14:55:11.830595 9427 tablet_bootstrap.cc:492] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:11.831542 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bf4a899338f4bcfac099b5099a22f05
I20251215 14:55:11.836369 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7af1f66c4f04f649379758ff1b3e387" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:11.836882 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30c5c795ea4a4fe591cdf63320ec2521" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:11.837487 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bf4a899338f4bcfac099b5099a22f05
W20251215 14:55:11.838001 8976 leader_election.cc:343] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:11.840658 9007 tablet_service.cc:1505] Processing CreateTablet for tablet a51cf25aab09432f92bbd3235c2ada56 (DEFAULT_TABLE table=default.Table_69b5e5c77c4b4399ba828d29b6f1c05b [id=2aaee5b8b00e449b9fbeffe266d94cf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.840936 10114 consensus_queue.cc:1048] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:11.841255 10274 consensus_queue.cc:1048] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 14:55:11.841733 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51cf25aab09432f92bbd3235c2ada56. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.848304 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_567ed696be7f44e7b1dd2a108dcce2b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:11.848838 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_567ed696be7f44e7b1dd2a108dcce2b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:11.849171 9157 tablet_service.cc:1505] Processing CreateTablet for tablet a51cf25aab09432f92bbd3235c2ada56 (DEFAULT_TABLE table=default.Table_69b5e5c77c4b4399ba828d29b6f1c05b [id=2aaee5b8b00e449b9fbeffe266d94cf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.849557 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51cf25aab09432f92bbd3235c2ada56. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.849821 9943 ts_tablet_manager.cc:1929] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:11.849943 9943 log.cc:1199] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/c00aecc23c6541cbae4abd7cb1b3077b
I20251215 14:55:11.850353 9943 ts_tablet_manager.cc:1950] T c00aecc23c6541cbae4abd7cb1b3077b P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:11.850764 9315 raft_consensus.cc:1275] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Refusing update from remote peer 3ea5306c36594ef4a62211f2bd6669a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 14:55:11.850979 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5560a21e16bb43c7903c1fc66429ecdf" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:11.851234 10145 leader_election.cc:290] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:11.851770 9314 raft_consensus.cc:2468] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:11.852509 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5560a21e16bb43c7903c1fc66429ecdf" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:11.852670 9308 raft_consensus.cc:3060] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:11.853180 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet c00aecc23c6541cbae4abd7cb1b3077b (table default.Table_b527fedbc2c14bb3861289fe2b27fd43 [id=640d70bd78554e92823dc104e06227d3]) successfully deleted
I20251215 14:55:11.854148 9943 tablet_replica.cc:333] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
W20251215 14:55:11.855010 9115 leader_election.cc:343] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 4af4cf6ec825467383349098eda661c6
I20251215 14:55:11.855139 9943 raft_consensus.cc:2243] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:11.855195 9115 leader_election.cc:304] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:11.855329 9943 raft_consensus.cc:2272] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Raft consensus is shut down!
W20251215 14:55:11.855464 9115 raft_consensus.cc:2686] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251215 14:55:11.857057 10278 consensus_queue.cc:1048] T f121a14828e6443695960c0e540ae573 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:11.857538 10145 raft_consensus.cc:493] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.857533 10114 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.857707 10114 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.858377 10114 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:11.858950 10145 raft_consensus.cc:515] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.859293 10021 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.859563 10145 leader_election.cc:290] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:11.859812 10021 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.860400 10021 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:11.864671 9427 tablet_bootstrap.cc:654] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.865621 9308 raft_consensus.cc:2468] T 5560a21e16bb43c7903c1fc66429ecdf P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:11.868090 9435 tablet_bootstrap.cc:654] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.859988 9943 ts_tablet_manager.cc:1916] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251215 14:55:11.871579 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:55:11.871820 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:55:11.874970 10253 tablet.cc:1722] T ae8a49b9a3bf4845943b1ad8e318ccbb P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251215 14:55:11.877275 10274 consensus_queue.cc:1048] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:11.895428 9015 tablet_service.cc:1505] Processing CreateTablet for tablet 548e6d35016746e2b8f5184ee44071cb (DEFAULT_TABLE table=default.Table_6a799de3eef44940b8461740c75bcec3 [id=4f1d6428f17545329a705c2295737549]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.895867 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548e6d35016746e2b8f5184ee44071cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.898229 9016 tablet_service.cc:1505] Processing CreateTablet for tablet 2b54d7dcdcc94e58b039b9f231f38d11 (DEFAULT_TABLE table=default.Table_0b5550fc67b74b9e997ee17398719a8b [id=44e7dcb2f95341c4950129b8d93d27c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.898569 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b54d7dcdcc94e58b039b9f231f38d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.900449 9150 tablet_service.cc:1505] Processing CreateTablet for tablet 548e6d35016746e2b8f5184ee44071cb (DEFAULT_TABLE table=default.Table_6a799de3eef44940b8461740c75bcec3 [id=4f1d6428f17545329a705c2295737549]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.901714 10274 raft_consensus.cc:493] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.901863 10274 raft_consensus.cc:515] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.902516 10274 leader_election.cc:290] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:11.903296 10261 raft_consensus.cc:493] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:11.903966 9150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548e6d35016746e2b8f5184ee44071cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.903441 10261 raft_consensus.cc:515] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.907531 9435 tablet_bootstrap.cc:492] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:11.907732 9435 ts_tablet_manager.cc:1403] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.255s user 0.007s sys 0.002s
I20251215 14:55:11.908373 9157 tablet_service.cc:1505] Processing CreateTablet for tablet 26e8a00c0065406d826271d103f892ba (DEFAULT_TABLE table=default.Table_4b3832fa06ed4ca9b9aaaceeb07c1c3b [id=aa01d282391e4b6cbdd1889098d87d88]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.909777 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26e8a00c0065406d826271d103f892ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.910560 9427 tablet_bootstrap.cc:492] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:11.910854 9427 ts_tablet_manager.cc:1403] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.080s user 0.004s sys 0.000s
I20251215 14:55:11.912820 9007 tablet_service.cc:1505] Processing CreateTablet for tablet 26e8a00c0065406d826271d103f892ba (DEFAULT_TABLE table=default.Table_4b3832fa06ed4ca9b9aaaceeb07c1c3b [id=aa01d282391e4b6cbdd1889098d87d88]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.914688 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26e8a00c0065406d826271d103f892ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.920552 9014 tablet_service.cc:1505] Processing CreateTablet for tablet 5dc9405b80e84ae7a67a595c3596cc92 (DEFAULT_TABLE table=default.Table_d12285644d7e481cb7a99358a2696b73 [id=7a8aae0645284e04a14092965a9fe4b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.921099 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc9405b80e84ae7a67a595c3596cc92. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.926110 9435 raft_consensus.cc:359] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.926277 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d75636265f14a428aae592438064ea2" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:11.926371 9435 raft_consensus.cc:385] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.926472 9435 raft_consensus.cc:740] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.929292 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26754a74483c4c9580df93aae10e7de1" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:11.929518 9037 raft_consensus.cc:2468] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
W20251215 14:55:11.929608 8976 leader_election.cc:343] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:11.930065 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26754a74483c4c9580df93aae10e7de1" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:11.930277 9314 raft_consensus.cc:2468] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:11.933331 9435 consensus_queue.cc:260] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.934537 9435 ts_tablet_manager.cc:1434] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20251215 14:55:11.936307 9112 leader_election.cc:304] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:11.936721 10019 raft_consensus.cc:2804] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:11.937887 10240 tablet.cc:1722] T f121a14828e6443695960c0e540ae573 P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:11.936064 10189 tablet.cc:1722] T f121a14828e6443695960c0e540ae573 P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:11.938753 9435 tablet_bootstrap.cc:492] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:11.937229 10019 raft_consensus.cc:493] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:11.939844 10019 raft_consensus.cc:3060] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:11.949857 10261 leader_election.cc:290] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:11.957096 9427 raft_consensus.cc:359] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.957383 9427 raft_consensus.cc:385] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:11.957501 9427 raft_consensus.cc:740] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:11.957796 9427 consensus_queue.cc:260] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:11.958487 9427 ts_tablet_manager.cc:1434] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.047s user 0.002s sys 0.000s
I20251215 14:55:11.962285 9971 raft_consensus.cc:697] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:11.962710 9971 consensus_queue.cc:237] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:11.964666 9249 leader_election.cc:343] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:11.964673 9015 tablet_service.cc:1505] Processing CreateTablet for tablet ebeebb8f49ef4858804e2ed0b31b2196 (DEFAULT_TABLE table=default.Table_8db54f1c2da24f868800c51c6a04bcce [id=a00a409541164ff69ee79bbd2cb8c27e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.965934 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30c5c795ea4a4fe591cdf63320ec2521" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:11.966289 9315 raft_consensus.cc:2468] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:11.965978 9314 raft_consensus.cc:1275] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Refusing update from remote peer 67978ac4539d4b289e53f4eedd9a8156: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 14:55:11.967703 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f7af1f66c4f04f649379758ff1b3e387" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:11.967898 9435 tablet_bootstrap.cc:654] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:11.969516 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d75636265f14a428aae592438064ea2" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:11.972287 9145 tablet_service.cc:1505] Processing CreateTablet for tablet 2b54d7dcdcc94e58b039b9f231f38d11 (DEFAULT_TABLE table=default.Table_0b5550fc67b74b9e997ee17398719a8b [id=44e7dcb2f95341c4950129b8d93d27c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.974128 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a639396098a941249afd9c3560073131" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:11.974977 9145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b54d7dcdcc94e58b039b9f231f38d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.978945 9016 tablet_service.cc:1505] Processing CreateTablet for tablet 6fea3a1616074fdd81242bc44e76cc2c (DEFAULT_TABLE table=default.Table_98f7661731924d2994c2f55e3241138b [id=3d9e24429740468e8fab89e2a82c7564]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.980489 9013 tablet_service.cc:1505] Processing CreateTablet for tablet 4a98e436ade941989e40e34578572e3b (DEFAULT_TABLE table=default.Table_5e843b61cca34828ad50b8a4c43b8195 [id=a057a38dc27c410395778660f2389b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.980485 9007 tablet_service.cc:1505] Processing CreateTablet for tablet d45d6eebc703414fa9028faab9fc993c (DEFAULT_TABLE table=default.Table_670861e659694b79a9225aba5f756f78 [id=3acc29dcf66b4841ba803cfb4eefeec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.984790 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebeebb8f49ef4858804e2ed0b31b2196. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.985057 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45d6eebc703414fa9028faab9fc993c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.985512 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fea3a1616074fdd81242bc44e76cc2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.985772 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a98e436ade941989e40e34578572e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:11.985814 9144 tablet_service.cc:1505] Processing CreateTablet for tablet 4a98e436ade941989e40e34578572e3b (DEFAULT_TABLE table=default.Table_5e843b61cca34828ad50b8a4c43b8195 [id=a057a38dc27c410395778660f2389b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:11.987370 9426 tablet_bootstrap.cc:492] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:11.998525 9943 ts_tablet_manager.cc:1929] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:12.000715 9175 raft_consensus.cc:2468] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:12.000937 9427 tablet_bootstrap.cc:492] T fda9eb99ccef4c16a0a947510566ecf4 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:12.000943 9426 ts_tablet_manager.cc:1403] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.337s user 0.003s sys 0.023s
I20251215 14:55:12.002810 9427 tablet_bootstrap.cc:654] T fda9eb99ccef4c16a0a947510566ecf4 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:12.014420 10144 consensus_queue.cc:1048] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:12.015316 9943 log.cc:1199] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/4af4cf6ec825467383349098eda661c6
I20251215 14:55:12.018467 9249 leader_election.cc:304] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:12.018904 10144 raft_consensus.cc:2804] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:12.019018 10144 raft_consensus.cc:493] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:12.019114 10144 raft_consensus.cc:3060] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:12.019438 9289 tablet_service.cc:1505] Processing CreateTablet for tablet f0e8dad82b3e4eff971b7b6845970c4f (DEFAULT_TABLE table=default.Table_8021aec3ccb641bca49fd8b5a35a2888 [id=caf8fac49b35421084bdd9826485b2dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.019845 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0e8dad82b3e4eff971b7b6845970c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.023823 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet c00aecc23c6541cbae4abd7cb1b3077b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:12.024178 9944 tablet_replica.cc:333] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:12.024431 9944 raft_consensus.cc:2243] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:12.024792 9944 raft_consensus.cc:2272] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:12.025367 9944 ts_tablet_manager.cc:1916] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:12.026005 8782 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781]). Expected version 2 got 0
I20251215 14:55:12.029543 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 605da10c8d3049e8b94caa9738576aab (table default.Table_0923c14f03464a8390571358e5de2145 [id=1a10676eee8b47098cf45bee49e3f502]). Expected version 1 got 0
I20251215 14:55:12.031910 9944 ts_tablet_manager.cc:1929] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:12.032120 9944 log.cc:1199] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/c00aecc23c6541cbae4abd7cb1b3077b
I20251215 14:55:12.032547 9944 ts_tablet_manager.cc:1950] T c00aecc23c6541cbae4abd7cb1b3077b P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:12.024798 9435 tablet_bootstrap.cc:492] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:12.033440 9435 ts_tablet_manager.cc:1403] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.095s user 0.004s sys 0.000s
I20251215 14:55:12.033413 9011 tablet_service.cc:1505] Processing CreateTablet for tablet e4078381658347a6a9d3063cc0cb3a53 (DEFAULT_TABLE table=default.Table_76504ec078d84ab089b69c745feea5ac [id=1de372c96f0043e3b6ee073e94cf0b52]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.034302 9435 raft_consensus.cc:359] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.034487 9435 raft_consensus.cc:385] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:12.034546 9435 raft_consensus.cc:740] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:12.034739 9435 consensus_queue.cc:260] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.035425 9435 ts_tablet_manager.cc:1434] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:12.035579 10144 raft_consensus.cc:515] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.035766 9435 tablet_bootstrap.cc:492] T ff4508c5a110427eb4d9d2eaaadace0b P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:12.036185 10144 leader_election.cc:290] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:12.034960 8782 catalog_manager.cc:5654] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e89303a500544272b601d7c29be802b4 (127.8.121.131). New cstate: current_term: 1 leader_uuid: "e89303a500544272b601d7c29be802b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: HEALTHY } } }
I20251215 14:55:12.036391 9015 tablet_service.cc:1505] Processing CreateTablet for tablet 75d0d009c76d46e8863f7137273acd97 (DEFAULT_TABLE table=default.Table_a6f2c02f62ef431c8a6587853a3548f8 [id=132ed5664fb44792a3d7158995bad224]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.036620 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet bb3b95d32c7044bd8a4451381c19aeba (table default.Table_3194032074824e83a1f02ad85fbba951 [id=7ec65d77d89d4e40a60b716f721e2940]). Expected version 5 got 0
W20251215 14:55:12.037258 8772 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet fda9eb99ccef4c16a0a947510566ecf4 (table default.Table_f6164e312b7a4576a27fab2ab89f91ca [id=c1c5f6c604c24855a17e2dfb4174965b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fda9eb99ccef4c16a0a947510566ecf4 consensus state has no leader
I20251215 14:55:12.037815 9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4078381658347a6a9d3063cc0cb3a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.038172 9283 tablet_service.cc:1505] Processing CreateTablet for tablet 5dc9405b80e84ae7a67a595c3596cc92 (DEFAULT_TABLE table=default.Table_d12285644d7e481cb7a99358a2696b73 [id=7a8aae0645284e04a14092965a9fe4b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.038642 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc9405b80e84ae7a67a595c3596cc92. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.042870 9294 tablet_service.cc:1505] Processing CreateTablet for tablet 18054b180c77403387d15fc6ee42f58f (DEFAULT_TABLE table=default.Table_197581ae0a7e4231b70573029ab493d5 [id=508a25f83ead424e867e4b5a62ff7635]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.043473 9277 tablet_service.cc:1505] Processing CreateTablet for tablet b4a856793e8b46cfb42110de5d383ff7 (DEFAULT_TABLE table=default.Table_29d5bb2dae4a45a3b86f0e8f5b69dc0a [id=81cf043be94c44afaef4b8c7f1ce1b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.043944 9295 tablet_service.cc:1505] Processing CreateTablet for tablet e79295168c8b456ba4fdc2379fbd0961 (DEFAULT_TABLE table=default.Table_47af3ae3eb6842989fb577f2c63e95af [id=a504c9556de84ec1811b6c022a9732ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.044417 9284 tablet_service.cc:1505] Processing CreateTablet for tablet 9c4be1c01418432492268598f97289a0 (DEFAULT_TABLE table=default.Table_b5a947cbfd574aa9b8291c27604daa3f [id=1ae34c7bbec44224a57fcbdf5d1b73b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.045102 9293 tablet_service.cc:1505] Processing CreateTablet for tablet ce147d1fcda2480daa557276c33a6096 (DEFAULT_TABLE table=default.Table_90d85b2eda064ee08a629de633d7f5bf [id=7271667c5a2348ee90354f8f9097d791]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.045799 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18054b180c77403387d15fc6ee42f58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.048444 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce147d1fcda2480daa557276c33a6096. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.051613 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e79295168c8b456ba4fdc2379fbd0961. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.052032 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d0d009c76d46e8863f7137273acd97. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.052265 9291 tablet_service.cc:1505] Processing CreateTablet for tablet 26e8a00c0065406d826271d103f892ba (DEFAULT_TABLE table=default.Table_4b3832fa06ed4ca9b9aaaceeb07c1c3b [id=aa01d282391e4b6cbdd1889098d87d88]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.052749 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26e8a00c0065406d826271d103f892ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.051616 9285 tablet_service.cc:1505] Processing CreateTablet for tablet 1c989af5bc624699b4cce2b5c95fc90e (DEFAULT_TABLE table=default.Table_a6e5907883f24cdbb16a9e092c46e70c [id=137b4c899daf4ebab526f21c3837f7b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.056249 9285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c989af5bc624699b4cce2b5c95fc90e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.057458 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a856793e8b46cfb42110de5d383ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.059113 9289 tablet_service.cc:1505] Processing CreateTablet for tablet a51cf25aab09432f92bbd3235c2ada56 (DEFAULT_TABLE table=default.Table_69b5e5c77c4b4399ba828d29b6f1c05b [id=2aaee5b8b00e449b9fbeffe266d94cf6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.059526 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51cf25aab09432f92bbd3235c2ada56. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.061347 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c4be1c01418432492268598f97289a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.072508 9283 tablet_service.cc:1505] Processing CreateTablet for tablet 4a98e436ade941989e40e34578572e3b (DEFAULT_TABLE table=default.Table_5e843b61cca34828ad50b8a4c43b8195 [id=a057a38dc27c410395778660f2389b76]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.073027 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a98e436ade941989e40e34578572e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.074059 9277 tablet_service.cc:1505] Processing CreateTablet for tablet 2b54d7dcdcc94e58b039b9f231f38d11 (DEFAULT_TABLE table=default.Table_0b5550fc67b74b9e997ee17398719a8b [id=44e7dcb2f95341c4950129b8d93d27c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.074532 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b54d7dcdcc94e58b039b9f231f38d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.076098 9284 tablet_service.cc:1505] Processing CreateTablet for tablet 548e6d35016746e2b8f5184ee44071cb (DEFAULT_TABLE table=default.Table_6a799de3eef44940b8461740c75bcec3 [id=4f1d6428f17545329a705c2295737549]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.076529 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 548e6d35016746e2b8f5184ee44071cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.076676 9294 tablet_service.cc:1505] Processing CreateTablet for tablet 6fea3a1616074fdd81242bc44e76cc2c (DEFAULT_TABLE table=default.Table_98f7661731924d2994c2f55e3241138b [id=3d9e24429740468e8fab89e2a82c7564]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.077214 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fea3a1616074fdd81242bc44e76cc2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.077414 9285 tablet_service.cc:1505] Processing CreateTablet for tablet ebeebb8f49ef4858804e2ed0b31b2196 (DEFAULT_TABLE table=default.Table_8db54f1c2da24f868800c51c6a04bcce [id=a00a409541164ff69ee79bbd2cb8c27e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.078064 9285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebeebb8f49ef4858804e2ed0b31b2196. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.079635 9015 tablet_service.cc:1505] Processing CreateTablet for tablet 0fb37d6a27554a44846e66c3ac2730f0 (DEFAULT_TABLE table=default.Table_c1ab0640e3c44aeab9699e38c97745d6 [id=5ad861e1c9cb49259b7a604c7d813ea3]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:12.079854 8846 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet f080b56cff244a46bfb73d05d3127f31 (table default.Table_371fb0a76bea4b17b74b0eb7dc573f00 [id=a81a53d1daa84a799510d1f4224eb1e1], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet f080b56cff244a46bfb73d05d3127f31 consensus state has no leader
I20251215 14:55:12.080169 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb37d6a27554a44846e66c3ac2730f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.081643 9040 raft_consensus.cc:3060] T f7af1f66c4f04f649379758ff1b3e387 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:12.084712 9145 tablet_service.cc:1505] Processing CreateTablet for tablet 6fea3a1616074fdd81242bc44e76cc2c (DEFAULT_TABLE table=default.Table_98f7661731924d2994c2f55e3241138b [id=3d9e24429740468e8fab89e2a82c7564]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.086634 10274 raft_consensus.cc:493] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:12.086853 8783 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a9ed7d1946ba433eb8b19ccf6a84b7ad has no consensus state
I20251215 14:55:12.086809 10274 raft_consensus.cc:515] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:12.087077 8786 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4a98e436ade941989e40e34578572e3b consensus state has no leader
I20251215 14:55:12.087463 8786 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e8f8eecfb3344f2993bfc87489b344ed" } new_table_name: "default.Table_95871025015c44e4b43a365970584eb5" modify_external_catalogs: true
I20251215 14:55:12.087523 10274 leader_election.cc:290] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:12.089128 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet c7f760639a664cfb9f4af5578154b981
I20251215 14:55:12.089414 8788 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 6229b8bc8d3d446c944c819670b10d54
I20251215 14:55:12.089646 8783 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet a639396098a941249afd9c3560073131 (table default.Table_404807c380fa4483ac5e0545eb3028cd [id=5cc820ec2c8b427db1c89647b295363e]). Expected version 1 got 0
I20251215 14:55:12.090276 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_a9c0cd79373b476ba1ecce82ed68b769"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:12.090554 9014 tablet_service.cc:1552] Processing DeleteTablet for tablet 6229b8bc8d3d446c944c819670b10d54 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:12.090754 8785 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 2f5b6963bd834fb884eef77e820b8248
W20251215 14:55:12.090801 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9c0cd79373b476ba1ecce82ed68b769 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.091065 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_d235d9c21993470fb94702fdd9e0a2e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:12.091466 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 6229b8bc8d3d446c944c819670b10d54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6229b8bc8d3d446c944c819670b10d54 already in progress: creating tablet
W20251215 14:55:12.091614 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d235d9c21993470fb94702fdd9e0a2e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.092108 8779 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_6a398e13d9004d1a9f157e19e8a20496" } modify_external_catalogs: true
I20251215 14:55:12.092305 8779 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_6a398e13d9004d1a9f157e19e8a20496" } modify_external_catalogs: true
W20251215 14:55:12.093312 8787 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet eb309f7c439740c89470da5636523a69 consensus state has no leader
I20251215 14:55:12.093653 8787 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ae37b3213f06436890e9b2f39a03fc72" } new_table_name: "default.Table_9b6added9e534689925855e8aa8248c5" modify_external_catalogs: true
I20251215 14:55:12.095486 9014 tablet_service.cc:1505] Processing CreateTablet for tablet 295325c4a2ca41caaabddbd96d4bce19 (DEFAULT_TABLE table=default.Table_33fa344a68b64dcc901ab7f6ce8de37b [id=d313e9f0a88240f0a37f3c26a066f3d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.095880 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295325c4a2ca41caaabddbd96d4bce19. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.098412 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a98e436ade941989e40e34578572e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.099506 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b65b63ce3ec49f9a0d2d77d69a85fd7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:12.100243 8976 leader_election.cc:343] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:12.101241 9426 raft_consensus.cc:359] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.101472 9426 raft_consensus.cc:385] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:12.102736 9295 tablet_service.cc:1505] Processing CreateTablet for tablet d45d6eebc703414fa9028faab9fc993c (DEFAULT_TABLE table=default.Table_670861e659694b79a9225aba5f756f78 [id=3acc29dcf66b4841ba803cfb4eefeec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.105681 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a639396098a941249afd9c3560073131" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:12.106010 9435 tablet_bootstrap.cc:654] T ff4508c5a110427eb4d9d2eaaadace0b P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:12.106010 9037 raft_consensus.cc:2468] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:12.106647 9291 tablet_service.cc:1505] Processing CreateTablet for tablet 75d0d009c76d46e8863f7137273acd97 (DEFAULT_TABLE table=default.Table_a6f2c02f62ef431c8a6587853a3548f8 [id=132ed5664fb44792a3d7158995bad224]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.107412 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45d6eebc703414fa9028faab9fc993c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.112587 9426 raft_consensus.cc:740] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:12.112950 9426 consensus_queue.cc:260] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.114253 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d0d009c76d46e8863f7137273acd97. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.114514 9011 tablet_service.cc:1505] Processing CreateTablet for tablet 566fe9bb8a1849749087d840ef1c082d (DEFAULT_TABLE table=default.Table_2a74152b6a57456eb270264d0784390e [id=0a1c67a6ec29437ea20291bf3e4d3621]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.114931 9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566fe9bb8a1849749087d840ef1c082d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.115137 9142 tablet_service.cc:1505] Processing CreateTablet for tablet d45d6eebc703414fa9028faab9fc993c (DEFAULT_TABLE table=default.Table_670861e659694b79a9225aba5f756f78 [id=3acc29dcf66b4841ba803cfb4eefeec3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.115687 9426 ts_tablet_manager.cc:1434] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.112s user 0.002s sys 0.000s
I20251215 14:55:12.116019 9426 tablet_bootstrap.cc:492] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:12.116825 9249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 82704.1us
I20251215 14:55:12.119834 9150 tablet_service.cc:1505] Processing CreateTablet for tablet ebeebb8f49ef4858804e2ed0b31b2196 (DEFAULT_TABLE table=default.Table_8db54f1c2da24f868800c51c6a04bcce [id=a00a409541164ff69ee79bbd2cb8c27e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.121461 9146 tablet_service.cc:1552] Processing DeleteTablet for tablet 6229b8bc8d3d446c944c819670b10d54 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:12.122900 9153 tablet_service.cc:1505] Processing CreateTablet for tablet 75d0d009c76d46e8863f7137273acd97 (DEFAULT_TABLE table=default.Table_a6f2c02f62ef431c8a6587853a3548f8 [id=132ed5664fb44792a3d7158995bad224]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.126685 9147 tablet_service.cc:1505] Processing CreateTablet for tablet e4078381658347a6a9d3063cc0cb3a53 (DEFAULT_TABLE table=default.Table_76504ec078d84ab089b69c745feea5ac [id=1de372c96f0043e3b6ee073e94cf0b52]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.127684 9146 tablet_service.cc:1505] Processing CreateTablet for tablet 0fb37d6a27554a44846e66c3ac2730f0 (DEFAULT_TABLE table=default.Table_c1ab0640e3c44aeab9699e38c97745d6 [id=5ad861e1c9cb49259b7a604c7d813ea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.131052 9004 tablet_service.cc:1505] Processing CreateTablet for tablet 14450105328041cdbd93969b756d9fa0 (DEFAULT_TABLE table=default.Table_c733908dc722410a9fecd7f50d888e4a [id=29bee1f420104b78b203ce2fc4a65b77]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.131479 9004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14450105328041cdbd93969b756d9fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.131727 10019 raft_consensus.cc:515] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.134878 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26754a74483c4c9580df93aae10e7de1" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:12.135092 9040 raft_consensus.cc:3060] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:12.138043 9013 tablet_service.cc:1505] Processing CreateTablet for tablet 2ef8c3e099ba4e4d8d661af5c72c5e8c (DEFAULT_TABLE table=default.Table_8aa89f1547a54860886e482f1c87f816 [id=3b9b1d874c7b4cad9986ec2a1065e1d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.138474 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef8c3e099ba4e4d8d661af5c72c5e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.141726 9011 tablet_service.cc:1505] Processing CreateTablet for tablet 404cb1888ca2402ab7a41d0d5efeacd8 (DEFAULT_TABLE table=default.Table_26adf52407f64ad28bfc32668a710cba [id=34f88cb1406f4f03b193a1431a501950]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.142169 9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404cb1888ca2402ab7a41d0d5efeacd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.143965 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26754a74483c4c9580df93aae10e7de1" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:12.144228 9315 raft_consensus.cc:3060] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:12.147145 9315 raft_consensus.cc:2468] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:12.148929 10019 leader_election.cc:290] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:12.149894 9154 tablet_service.cc:1505] Processing CreateTablet for tablet 295325c4a2ca41caaabddbd96d4bce19 (DEFAULT_TABLE table=default.Table_33fa344a68b64dcc901ab7f6ce8de37b [id=d313e9f0a88240f0a37f3c26a066f3d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.150295 9145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fea3a1616074fdd81242bc44e76cc2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.152783 9115 leader_election.cc:304] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:12.153091 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295325c4a2ca41caaabddbd96d4bce19. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.156741 9153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d0d009c76d46e8863f7137273acd97. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.157114 9004 tablet_service.cc:1505] Processing CreateTablet for tablet 25615ca6c21d4d5f8880d3dff4253e61 (DEFAULT_TABLE table=default.Table_d42fe6d18cbb4914a8e4f9049c87ffe8 [id=cd5b1483552c4a039fb74b4c88dc0088]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.157567 9004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25615ca6c21d4d5f8880d3dff4253e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.157778 9175 raft_consensus.cc:3060] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:12.159669 10019 raft_consensus.cc:2804] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:12.161813 9007 tablet_service.cc:1505] Processing CreateTablet for tablet d88741012a814d41ac074e86805f492d (DEFAULT_TABLE table=default.Table_c0657e638f4347278be5c502e7972828 [id=9a061a63f3c54a9bb093c9c41ae79db6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.162266 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88741012a814d41ac074e86805f492d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.163442 10289 consensus_queue.cc:1048] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:12.164125 10019 raft_consensus.cc:697] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:12.164562 10019 consensus_queue.cc:237] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.165230 9146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb37d6a27554a44846e66c3ac2730f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.165421 9435 tablet_bootstrap.cc:492] T ff4508c5a110427eb4d9d2eaaadace0b P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:12.165633 9435 ts_tablet_manager.cc:1403] T ff4508c5a110427eb4d9d2eaaadace0b P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.130s user 0.004s sys 0.000s
I20251215 14:55:12.166487 9435 raft_consensus.cc:359] T ff4508c5a110427eb4d9d2eaaadace0b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.166841 9435 raft_consensus.cc:385] T ff4508c5a110427eb4d9d2eaaadace0b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:12.166983 9435 raft_consensus.cc:740] T ff4508c5a110427eb4d9d2eaaadace0b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:12.167376 9435 consensus_queue.cc:260] T ff4508c5a110427eb4d9d2eaaadace0b P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.167975 9435 ts_tablet_manager.cc:1434] T ff4508c5a110427eb4d9d2eaaadace0b P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:12.168331 9435 tablet_bootstrap.cc:492] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:12.170398 10289 raft_consensus.cc:493] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:12.170591 10289 raft_consensus.cc:515] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.171351 10289 leader_election.cc:290] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:12.179368 9147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4078381658347a6a9d3063cc0cb3a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.184558 9158 tablet_service.cc:1505] Processing CreateTablet for tablet 566fe9bb8a1849749087d840ef1c082d (DEFAULT_TABLE table=default.Table_2a74152b6a57456eb270264d0784390e [id=0a1c67a6ec29437ea20291bf3e4d3621]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.180476 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a639396098a941249afd9c3560073131" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:12.184953 9149 tablet_service.cc:1505] Processing CreateTablet for tablet 2ef8c3e099ba4e4d8d661af5c72c5e8c (DEFAULT_TABLE table=default.Table_8aa89f1547a54860886e482f1c87f816 [id=3b9b1d874c7b4cad9986ec2a1065e1d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.186275 9435 tablet_bootstrap.cc:654] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:12.188201 9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d45d6eebc703414fa9028faab9fc993c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.190771 9160 tablet_service.cc:1505] Processing CreateTablet for tablet 14450105328041cdbd93969b756d9fa0 (DEFAULT_TABLE table=default.Table_c733908dc722410a9fecd7f50d888e4a [id=29bee1f420104b78b203ce2fc4a65b77]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.206070 9014 tablet_service.cc:1505] Processing CreateTablet for tablet ad2bead71c9a462bbd7888774c608ba9 (DEFAULT_TABLE table=default.Table_6636b9f6676f4832ad6ddbf09735cbdb [id=3fefcce09d724174810b8375a8cd7fa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.206593 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2bead71c9a462bbd7888774c608ba9. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:12.209800 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:12.210235 8978 leader_election.cc:304] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:12.210901 10289 raft_consensus.cc:2804] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:12.211019 10289 raft_consensus.cc:493] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:12.211149 10289 raft_consensus.cc:3060] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:12.214210 9004 tablet_service.cc:1505] Processing CreateTablet for tablet 042632f0dabd4a79a36a5f27bef12faa (DEFAULT_TABLE table=default.Table_2c8a749747754618ab3d5e74e5326d98 [id=77d277fc8859444790b8a7cf7cfdbcef]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.214663 9004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042632f0dabd4a79a36a5f27bef12faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.214524 10289 raft_consensus.cc:515] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.215632 10289 leader_election.cc:290] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:12.215849 10274 consensus_queue.cc:1048] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:12.216781 8978 leader_election.cc:304] T f7af1f66c4f04f649379758ff1b3e387 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:12.217739 10269 raft_consensus.cc:2749] T f7af1f66c4f04f649379758ff1b3e387 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:12.218613 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:55:12.218820 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:12.219352 10269 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:12.221235 9011 tablet_service.cc:1505] Processing CreateTablet for tablet 66249f9be0334affb4f4b0e7dd9212ea (DEFAULT_TABLE table=default.Table_c2efd3f029df4f7c9a74f6201cacf057 [id=29a32706181848f58b3e67c0ac5dd399]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.221788 9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66249f9be0334affb4f4b0e7dd9212ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.224078 9040 raft_consensus.cc:2468] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:12.224359 9435 tablet_bootstrap.cc:492] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:12.224547 9435 ts_tablet_manager.cc:1403] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.056s user 0.002s sys 0.001s
I20251215 14:55:12.225330 9435 raft_consensus.cc:359] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.226076 9435 raft_consensus.cc:385] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:12.226154 9435 raft_consensus.cc:740] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:12.226398 9435 consensus_queue.cc:260] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.226994 9435 ts_tablet_manager.cc:1434] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:12.227350 9435 tablet_bootstrap.cc:492] T 5dc81eb40614463cb5017475b378eea6 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:12.229068 9435 tablet_bootstrap.cc:654] T 5dc81eb40614463cb5017475b378eea6 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:12.230612 9175 raft_consensus.cc:3060] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:12.231652 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef8c3e099ba4e4d8d661af5c72c5e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.232414 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff4508c5a110427eb4d9d2eaaadace0b" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:12.232973 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14450105328041cdbd93969b756d9fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.234161 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566fe9bb8a1849749087d840ef1c082d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.234481 9150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebeebb8f49ef4858804e2ed0b31b2196. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:12.235500 8976 leader_election.cc:343] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:12.245465 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:55:12.245757 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:12.246028 9013 tablet_service.cc:1505] Processing CreateTablet for tablet 10cd2cbd7956444cb125d97310d2b102 (DEFAULT_TABLE table=default.Table_cac9287494284dd6b1f7ce317d633368 [id=9b6b92bf5d3549a39b8a5453562c8fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.246419 9943 ts_tablet_manager.cc:1950] T 4af4cf6ec825467383349098eda661c6 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:12.246500 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10cd2cbd7956444cb125d97310d2b102. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.247781 10289 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:12.248216 9151 tablet_service.cc:1505] Processing CreateTablet for tablet 25615ca6c21d4d5f8880d3dff4253e61 (DEFAULT_TABLE table=default.Table_d42fe6d18cbb4914a8e4f9049c87ffe8 [id=cd5b1483552c4a039fb74b4c88dc0088]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.248944 9151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25615ca6c21d4d5f8880d3dff4253e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.249799 9148 tablet_service.cc:1505] Processing CreateTablet for tablet 404cb1888ca2402ab7a41d0d5efeacd8 (DEFAULT_TABLE table=default.Table_26adf52407f64ad28bfc32668a710cba [id=34f88cb1406f4f03b193a1431a501950]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.251503 9007 tablet_service.cc:1505] Processing CreateTablet for tablet 8d4d6163853448ceaff5c1954cfc64e7 (DEFAULT_TABLE table=default.Table_8c3b34c92edb417c8735a42c25a8ff02 [id=c5dbb81788484955a396320dc8cfec8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.251899 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4d6163853448ceaff5c1954cfc64e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.257733 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30c5c795ea4a4fe591cdf63320ec2521" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:12.258596 9157 tablet_service.cc:1505] Processing CreateTablet for tablet d88741012a814d41ac074e86805f492d (DEFAULT_TABLE table=default.Table_c0657e638f4347278be5c502e7972828 [id=9a061a63f3c54a9bb093c9c41ae79db6]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:12.258831 10285 log.cc:927] Time spent T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3: Append to log took a long time: real 0.094s user 0.000s sys 0.000s
I20251215 14:55:12.259089 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88741012a814d41ac074e86805f492d. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:12.264379 8976 leader_election.cc:343] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:12.266209 9016 tablet_service.cc:1505] Processing CreateTablet for tablet cf6e4aa94f79403588dd1916226660fd (DEFAULT_TABLE table=default.Table_37a4070d85974aa6a6cc25f78196a7c7 [id=a532bf60d648405f9c3882b0d54d1296]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.266621 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf6e4aa94f79403588dd1916226660fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.267568 9427 tablet_bootstrap.cc:492] T fda9eb99ccef4c16a0a947510566ecf4 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:12.268559 9427 ts_tablet_manager.cc:1403] T fda9eb99ccef4c16a0a947510566ecf4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.286s user 0.005s sys 0.000s
I20251215 14:55:12.270540 9148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404cb1888ca2402ab7a41d0d5efeacd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.270658 9427 raft_consensus.cc:359] T fda9eb99ccef4c16a0a947510566ecf4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.271006 9427 raft_consensus.cc:385] T fda9eb99ccef4c16a0a947510566ecf4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:12.271257 9427 raft_consensus.cc:740] T fda9eb99ccef4c16a0a947510566ecf4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:12.271791 9426 tablet_bootstrap.cc:654] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:12.271809 9427 consensus_queue.cc:260] T fda9eb99ccef4c16a0a947510566ecf4 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.273000 10240 tablet.cc:1722] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:12.274734 10253 tablet.cc:1722] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:12.275627 9427 ts_tablet_manager.cc:1434] T fda9eb99ccef4c16a0a947510566ecf4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20251215 14:55:12.276399 9427 tablet_bootstrap.cc:492] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:12.279817 9004 tablet_service.cc:1505] Processing CreateTablet for tablet 6a09ed5b19594fba9e73f7b6e3f7bd4f (DEFAULT_TABLE table=default.Table_122936ccef3e435c8c1f31bf260935d6 [id=148c3bbaa3d845efad3703f604e36032]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.280261 9004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a09ed5b19594fba9e73f7b6e3f7bd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.282967 9427 tablet_bootstrap.cc:654] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:12.285370 9435 tablet_bootstrap.cc:492] T 5dc81eb40614463cb5017475b378eea6 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:12.285655 9435 ts_tablet_manager.cc:1403] T 5dc81eb40614463cb5017475b378eea6 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.000s
I20251215 14:55:12.287415 9435 raft_consensus.cc:359] T 5dc81eb40614463cb5017475b378eea6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.287788 9435 raft_consensus.cc:385] T 5dc81eb40614463cb5017475b378eea6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:12.287988 9435 raft_consensus.cc:740] T 5dc81eb40614463cb5017475b378eea6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:12.288369 9435 consensus_queue.cc:260] T 5dc81eb40614463cb5017475b378eea6 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:12.288769 8978 leader_election.cc:343] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:12.289167 8978 leader_election.cc:304] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:12.289698 10289 raft_consensus.cc:2749] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:12.290643 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a639396098a941249afd9c3560073131" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:12.290869 9034 raft_consensus.cc:3060] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:12.290987 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet c00aecc23c6541cbae4abd7cb1b3077b (table default.Table_b527fedbc2c14bb3861289fe2b27fd43 [id=640d70bd78554e92823dc104e06227d3]) successfully deleted
W20251215 14:55:12.291378 9248 leader_election.cc:343] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:12.291512 9248 leader_election.cc:304] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:12.291745 10268 raft_consensus.cc:2749] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:12.292595 9013 tablet_service.cc:1505] Processing CreateTablet for tablet 92ab40be35344612bdf65839e2637d6d (DEFAULT_TABLE table=default.Table_ce491c1e2a09492cbfe26725b319b74e [id=a9ae86fe12db45f0820d8c1924421cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.292758 9285 tablet_service.cc:1505] Processing CreateTablet for tablet e4078381658347a6a9d3063cc0cb3a53 (DEFAULT_TABLE table=default.Table_76504ec078d84ab089b69c745feea5ac [id=1de372c96f0043e3b6ee073e94cf0b52]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.292958 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ab40be35344612bdf65839e2637d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.293134 9285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4078381658347a6a9d3063cc0cb3a53. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.293628 9034 raft_consensus.cc:2468] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:12.293650 9293 tablet_service.cc:1505] Processing CreateTablet for tablet d88741012a814d41ac074e86805f492d (DEFAULT_TABLE table=default.Table_c0657e638f4347278be5c502e7972828 [id=9a061a63f3c54a9bb093c9c41ae79db6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.293998 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88741012a814d41ac074e86805f492d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.294188 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet 6229b8bc8d3d446c944c819670b10d54 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:12.294560 9294 tablet_service.cc:1505] Processing CreateTablet for tablet 0fb37d6a27554a44846e66c3ac2730f0 (DEFAULT_TABLE table=default.Table_c1ab0640e3c44aeab9699e38c97745d6 [id=5ad861e1c9cb49259b7a604c7d813ea3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.294898 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fb37d6a27554a44846e66c3ac2730f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.295490 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 295325c4a2ca41caaabddbd96d4bce19 (DEFAULT_TABLE table=default.Table_33fa344a68b64dcc901ab7f6ce8de37b [id=d313e9f0a88240f0a37f3c26a066f3d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.295820 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295325c4a2ca41caaabddbd96d4bce19. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.299273 9287 tablet_service.cc:1505] Processing CreateTablet for tablet 042632f0dabd4a79a36a5f27bef12faa (DEFAULT_TABLE table=default.Table_2c8a749747754618ab3d5e74e5326d98 [id=77d277fc8859444790b8a7cf7cfdbcef]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.299432 9291 tablet_service.cc:1505] Processing CreateTablet for tablet 566fe9bb8a1849749087d840ef1c082d (DEFAULT_TABLE table=default.Table_2a74152b6a57456eb270264d0784390e [id=0a1c67a6ec29437ea20291bf3e4d3621]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.299664 9287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042632f0dabd4a79a36a5f27bef12faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.299904 9283 tablet_service.cc:1505] Processing CreateTablet for tablet 2ef8c3e099ba4e4d8d661af5c72c5e8c (DEFAULT_TABLE table=default.Table_8aa89f1547a54860886e482f1c87f816 [id=3b9b1d874c7b4cad9986ec2a1065e1d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.300258 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef8c3e099ba4e4d8d661af5c72c5e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.301358 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 404cb1888ca2402ab7a41d0d5efeacd8 (DEFAULT_TABLE table=default.Table_26adf52407f64ad28bfc32668a710cba [id=34f88cb1406f4f03b193a1431a501950]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.301388 9279 tablet_service.cc:1505] Processing CreateTablet for tablet ad2bead71c9a462bbd7888774c608ba9 (DEFAULT_TABLE table=default.Table_6636b9f6676f4832ad6ddbf09735cbdb [id=3fefcce09d724174810b8375a8cd7fa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.301748 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 404cb1888ca2402ab7a41d0d5efeacd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.303041 9286 tablet_service.cc:1505] Processing CreateTablet for tablet 10cd2cbd7956444cb125d97310d2b102 (DEFAULT_TABLE table=default.Table_cac9287494284dd6b1f7ce317d633368 [id=9b6b92bf5d3549a39b8a5453562c8fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.303478 8784 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet c4660d4e5cb84f3a983922c0b4aef90b
I20251215 14:55:12.304416 9282 tablet_service.cc:1505] Processing CreateTablet for tablet cf6e4aa94f79403588dd1916226660fd (DEFAULT_TABLE table=default.Table_37a4070d85974aa6a6cc25f78196a7c7 [id=a532bf60d648405f9c3882b0d54d1296]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.304339 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ced07a78c54f4b61b53992f2cf0e5381"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:12.304987 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ced07a78c54f4b61b53992f2cf0e5381 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.305747 9284 tablet_service.cc:1505] Processing CreateTablet for tablet 14450105328041cdbd93969b756d9fa0 (DEFAULT_TABLE table=default.Table_c733908dc722410a9fecd7f50d888e4a [id=29bee1f420104b78b203ce2fc4a65b77]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.306142 9288 tablet_service.cc:1505] Processing CreateTablet for tablet 25615ca6c21d4d5f8880d3dff4253e61 (DEFAULT_TABLE table=default.Table_d42fe6d18cbb4914a8e4f9049c87ffe8 [id=cd5b1483552c4a039fb74b4c88dc0088]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.306340 8780 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 394844a49d254112883c40df9821c075
I20251215 14:55:12.306490 9290 tablet_service.cc:1505] Processing CreateTablet for tablet 66249f9be0334affb4f4b0e7dd9212ea (DEFAULT_TABLE table=default.Table_c2efd3f029df4f7c9a74f6201cacf057 [id=29a32706181848f58b3e67c0ac5dd399]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.307472 9278 tablet_service.cc:1505] Processing CreateTablet for tablet 6a09ed5b19594fba9e73f7b6e3f7bd4f (DEFAULT_TABLE table=default.Table_122936ccef3e435c8c1f31bf260935d6 [id=148c3bbaa3d845efad3703f604e36032]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.307921 9281 tablet_service.cc:1505] Processing CreateTablet for tablet 92ab40be35344612bdf65839e2637d6d (DEFAULT_TABLE table=default.Table_ce491c1e2a09492cbfe26725b319b74e [id=a9ae86fe12db45f0820d8c1924421cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.309013 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b65b63ce3ec49f9a0d2d77d69a85fd7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:12.309240 9315 raft_consensus.cc:2468] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:12.309473 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_e68dc91a90f94a24a7b878655bc92914"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:12.309988 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e68dc91a90f94a24a7b878655bc92914 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.307051 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_f1d0fc0296494974b6b7f83f6dc2e4ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:12.310297 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff4508c5a110427eb4d9d2eaaadace0b" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:12.310483 9315 raft_consensus.cc:2468] T ff4508c5a110427eb4d9d2eaaadace0b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
W20251215 14:55:12.310680 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1d0fc0296494974b6b7f83f6dc2e4ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:12.311491 8786 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a7a401d5386499183b6560411f593b6 consensus state has no leader
I20251215 14:55:12.311781 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_f3920bdde5354312bfcca61bffe77a6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:12.311902 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_25f19281d4834ce6b6e42c14857433a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:12.312171 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30c5c795ea4a4fe591cdf63320ec2521" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
W20251215 14:55:12.312238 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3920bdde5354312bfcca61bffe77a6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.312340 9315 raft_consensus.cc:3060] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:12.312420 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25f19281d4834ce6b6e42c14857433a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.313261 8783 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_159b0c9ea29840df94432fbee21770fd [id=0e3677e1f3d048ecad508d50304ee56a] alter complete (version 2)
I20251215 14:55:12.313704 8783 master_service.cc:954] ReplaceTablet: received request to replace tablet e6aad8bed15a416a925ae8c8870d4e51 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:12.314087 8783 master_service.cc:954] ReplaceTablet: received request to replace tablet 123361ef48714d859ee5ac85c3c37d08 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:12.314373 8783 master_service.cc:954] ReplaceTablet: received request to replace tablet 92e21a77ad074572a57b836743903a0b from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:12.314677 8783 master_service.cc:954] ReplaceTablet: received request to replace tablet 062a482917794ae5a67ec685a2491ba2 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:12.314966 8783 master_service.cc:954] ReplaceTablet: received request to replace tablet 56816add0a61454c9980ad09f5815b09 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:12.315826 9277 tablet_service.cc:1505] Processing CreateTablet for tablet 8d4d6163853448ceaff5c1954cfc64e7 (DEFAULT_TABLE table=default.Table_8c3b34c92edb417c8735a42c25a8ff02 [id=c5dbb81788484955a396320dc8cfec8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.316680 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566fe9bb8a1849749087d840ef1c082d. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:12.319051 8787 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc3bcd441f1948a5a79d20e2e205d7f2 consensus state has no leader
I20251215 14:55:12.319212 9315 raft_consensus.cc:2468] T 30c5c795ea4a4fe591cdf63320ec2521 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:12.320501 9016 tablet_service.cc:1552] Processing DeleteTablet for tablet 394844a49d254112883c40df9821c075 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:12.321391 9286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10cd2cbd7956444cb125d97310d2b102. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.321399 10274 raft_consensus.cc:493] T 9bf4a899338f4bcfac099b5099a22f05 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:12.321573 10274 raft_consensus.cc:515] T 9bf4a899338f4bcfac099b5099a22f05 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.322216 10274 leader_election.cc:290] T 9bf4a899338f4bcfac099b5099a22f05 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:12.326274 9155 tablet_service.cc:1505] Processing CreateTablet for tablet 66249f9be0334affb4f4b0e7dd9212ea (DEFAULT_TABLE table=default.Table_c2efd3f029df4f7c9a74f6201cacf057 [id=29a32706181848f58b3e67c0ac5dd399]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.326566 9156 tablet_service.cc:1505] Processing CreateTablet for tablet ad2bead71c9a462bbd7888774c608ba9 (DEFAULT_TABLE table=default.Table_6636b9f6676f4832ad6ddbf09735cbdb [id=3fefcce09d724174810b8375a8cd7fa0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.327389 9282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf6e4aa94f79403588dd1916226660fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.329752 9141 tablet_service.cc:1505] Processing CreateTablet for tablet 042632f0dabd4a79a36a5f27bef12faa (DEFAULT_TABLE table=default.Table_2c8a749747754618ab3d5e74e5326d98 [id=77d277fc8859444790b8a7cf7cfdbcef]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.330711 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14450105328041cdbd93969b756d9fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.330914 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66249f9be0334affb4f4b0e7dd9212ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.334141 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf4a899338f4bcfac099b5099a22f05" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:12.334298 9248 leader_election.cc:304] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:12.334533 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:12.334827 10189 tablet.cc:1722] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:12.335714 9288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25615ca6c21d4d5f8880d3dff4253e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.337093 10144 raft_consensus.cc:2804] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:12.337270 10144 raft_consensus.cc:697] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:12.337582 10144 consensus_queue.cc:237] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:12.337965 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 394844a49d254112883c40df9821c075 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 394844a49d254112883c40df9821c075 already in progress: creating tablet
I20251215 14:55:12.339608 9278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a09ed5b19594fba9e73f7b6e3f7bd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.343451 9281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ab40be35344612bdf65839e2637d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.343971 9014 tablet_service.cc:1552] Processing DeleteTablet for tablet c4660d4e5cb84f3a983922c0b4aef90b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:12.344640 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet c4660d4e5cb84f3a983922c0b4aef90b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4660d4e5cb84f3a983922c0b4aef90b already in progress: creating tablet
I20251215 14:55:12.345283 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bf4a899338f4bcfac099b5099a22f05" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:12.347481 9176 raft_consensus.cc:2393] T 9bf4a899338f4bcfac099b5099a22f05 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:12.348372 10272 consensus_queue.cc:1048] T 194bb745ecb849cb9092fee1afb7dbe6 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:12.349179 9011 tablet_service.cc:1505] Processing CreateTablet for tablet 4e1472ce5a464a12a711d513446abe2a (DEFAULT_TABLE table=default.Table_e187e303d6744e46a505a79d4f80a846 [id=ae585634aade4d2aa05ea83d44ff4cb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.350538 8779 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 307f788967bd48e2b442657806e87fc4
I20251215 14:55:12.351212 9014 tablet_service.cc:1552] Processing DeleteTablet for tablet 307f788967bd48e2b442657806e87fc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:12.351207 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 8d4d6163853448ceaff5c1954cfc64e7 (DEFAULT_TABLE table=default.Table_8c3b34c92edb417c8735a42c25a8ff02 [id=c5dbb81788484955a396320dc8cfec8e]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:12.351845 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 307f788967bd48e2b442657806e87fc4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 307f788967bd48e2b442657806e87fc4 already in progress: creating tablet
I20251215 14:55:12.352767 8978 leader_election.cc:304] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:12.353585 9014 tablet_service.cc:1505] Processing CreateTablet for tablet 6a7a401d5386499183b6560411f593b6 (DEFAULT_TABLE table=default.Table_95871025015c44e4b43a365970584eb5 [id=7e8561f684374b289185e72f3027003d]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:12.353742 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet f7af1f66c4f04f649379758ff1b3e387
W20251215 14:55:12.353809 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 38e50a7f2bdd4907ab41436b59397ea6
W20251215 14:55:12.353873 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 18cd1f63d51e4565bb8c55be13e3e099
I20251215 14:55:12.353963 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a7a401d5386499183b6560411f593b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.354099 8978 leader_election.cc:304] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:12.354506 10269 raft_consensus.cc:2804] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:12.354650 10269 raft_consensus.cc:493] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:12.354745 10269 raft_consensus.cc:3060] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:12.354979 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 2d75636265f14a428aae592438064ea2
W20251215 14:55:12.355046 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
W20251215 14:55:12.355110 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet ff4508c5a110427eb4d9d2eaaadace0b
I20251215 14:55:12.355549 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_8866124dc954470da607bb2f70dccb5e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:12.356084 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8866124dc954470da607bb2f70dccb5e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.356742 10274 raft_consensus.cc:2804] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:12.356834 10274 raft_consensus.cc:493] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:12.356922 10274 raft_consensus.cc:3060] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:12.357468 10269 raft_consensus.cc:515] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.358166 10269 leader_election.cc:290] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:12.358832 8787 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_2a74152b6a57456eb270264d0784390e" } new_table_name: "default.Table_240c8831642a4d8b98f711ef0494c9d7" modify_external_catalogs: true
I20251215 14:55:12.359683 8978 leader_election.cc:304] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:12.360056 10269 raft_consensus.cc:2804] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:12.360214 10269 raft_consensus.cc:697] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:12.360497 10269 consensus_queue.cc:237] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.361850 8779 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_90d85b2eda064ee08a629de633d7f5bf" } new_table_name: "default.Table_aa15b16216e74f26a2e14fccb6f83000" modify_external_catalogs: true
I20251215 14:55:12.361302 10274 raft_consensus.cc:515] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.363574 10274 leader_election.cc:290] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:12.364600 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 5bfe8cc0805247de9df4a59d461818f3
W20251215 14:55:12.364830 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7
W20251215 14:55:12.365083 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bf4a899338f4bcfac099b5099a22f05
I20251215 14:55:12.367642 9016 tablet_service.cc:1505] Processing CreateTablet for tablet 39d0bab4179d4af68d2dbcd3e215873e (DEFAULT_TABLE table=default.Table_ea901dccd4124611b16871022906a3eb [id=e7f88ae86b464c9e8b6e928eb3c7df81]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.368048 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39d0bab4179d4af68d2dbcd3e215873e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.368834 8788 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 605da10c8d3049e8b94caa9738576aab (table default.Table_0923c14f03464a8390571358e5de2145 [id=1a10676eee8b47098cf45bee49e3f502]). Expected version 1 got 0
I20251215 14:55:12.369029 8788 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet a639396098a941249afd9c3560073131 (table default.Table_404807c380fa4483ac5e0545eb3028cd [id=5cc820ec2c8b427db1c89647b295363e]). Expected version 1 got 0
I20251215 14:55:12.369465 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4d6163853448ceaff5c1954cfc64e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.370777 8788 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_1cd84143b1334ccabfe606ad41e253e6" } new_table_name: "default.Table_b48e60e1ab5a4d43bd2630839d8bf999" modify_external_catalogs: true
W20251215 14:55:12.373541 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 6229b8bc8d3d446c944c819670b10d54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6229b8bc8d3d446c944c819670b10d54 already in progress: creating tablet
I20251215 14:55:12.375548 9152 tablet_service.cc:1505] Processing CreateTablet for tablet 6a09ed5b19594fba9e73f7b6e3f7bd4f (DEFAULT_TABLE table=default.Table_122936ccef3e435c8c1f31bf260935d6 [id=148c3bbaa3d845efad3703f604e36032]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.375643 8978 leader_election.cc:304] T 9bf4a899338f4bcfac099b5099a22f05 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:12.376012 10289 raft_consensus.cc:3060] T 9bf4a899338f4bcfac099b5099a22f05 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:12.380599 9007 tablet_service.cc:1505] Processing CreateTablet for tablet d39e0db04f3c4bd3831c00b2b4825035 (DEFAULT_TABLE table=default.Table_0ab920fea5f34b65b38a501fdc8e199d [id=0db11a83ace04ee192d1773f5514f0df]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.381422 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d39e0db04f3c4bd3831c00b2b4825035. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.384006 10240 tablet.cc:1722] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:12.385198 9279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2bead71c9a462bbd7888774c608ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.381450 10289 raft_consensus.cc:2749] T 9bf4a899338f4bcfac099b5099a22f05 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:12.382192 10270 consensus_queue.cc:1048] T 5e80ac7bd98a46119a30bd5d2f3de2f9 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:12.385967 9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1472ce5a464a12a711d513446abe2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.394228 9152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a09ed5b19594fba9e73f7b6e3f7bd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.398910 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b65b63ce3ec49f9a0d2d77d69a85fd7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:12.399498 9435 ts_tablet_manager.cc:1434] T 5dc81eb40614463cb5017475b378eea6 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.099s user 0.002s sys 0.000s
I20251215 14:55:12.399860 9435 tablet_bootstrap.cc:492] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:12.399391 9154 tablet_service.cc:1505] Processing CreateTablet for tablet 10cd2cbd7956444cb125d97310d2b102 (DEFAULT_TABLE table=default.Table_cac9287494284dd6b1f7ce317d633368 [id=9b6b92bf5d3549a39b8a5453562c8fa6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.402240 9144 tablet_service.cc:1505] Processing CreateTablet for tablet cf6e4aa94f79403588dd1916226660fd (DEFAULT_TABLE table=default.Table_37a4070d85974aa6a6cc25f78196a7c7 [id=a532bf60d648405f9c3882b0d54d1296]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.403707 9143 tablet_service.cc:1552] Processing DeleteTablet for tablet c4660d4e5cb84f3a983922c0b4aef90b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:12.403959 9143 tablet_service.cc:1552] Processing DeleteTablet for tablet 394844a49d254112883c40df9821c075 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:12.404347 9143 tablet_service.cc:1505] Processing CreateTablet for tablet 92ab40be35344612bdf65839e2637d6d (DEFAULT_TABLE table=default.Table_ce491c1e2a09492cbfe26725b319b74e [id=a9ae86fe12db45f0820d8c1924421cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.406838 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 4af4cf6ec825467383349098eda661c6 (table default.Table_c17ba9bfb1a94bfaa16d69f8dbb46b9e [id=6b4b04bb03f04a8a9cd7bc893acf612c]) successfully deleted
W20251215 14:55:12.407239 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 6229b8bc8d3d446c944c819670b10d54 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6229b8bc8d3d446c944c819670b10d54 already in progress: creating tablet
I20251215 14:55:12.409027 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d4d6163853448ceaff5c1954cfc64e7. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:12.410641 8976 leader_election.cc:343] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:12.411515 10272 raft_consensus.cc:493] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:12.412437 9156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad2bead71c9a462bbd7888774c608ba9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.413408 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66249f9be0334affb4f4b0e7dd9212ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.414346 9141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 042632f0dabd4a79a36a5f27bef12faa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.414541 9016 tablet_service.cc:1505] Processing CreateTablet for tablet 8eb90003cf02440e9752af134a3670b6 (DEFAULT_TABLE table=default.Table_96cdb82e10874b08bd807d3d485cf7bf [id=d50dec3ceeb84a03a5cc34476a7f1519]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.415050 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb90003cf02440e9752af134a3670b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.421303 10272 raft_consensus.cc:515] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.422312 10272 leader_election.cc:290] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:12.423605 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff4508c5a110427eb4d9d2eaaadace0b" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:12.424139 8976 leader_election.cc:343] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:12.425480 9281 tablet_service.cc:1552] Processing DeleteTablet for tablet c4660d4e5cb84f3a983922c0b4aef90b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:12.429947 9015 tablet_service.cc:1505] Processing CreateTablet for tablet 84477b0a4bd14522908cc28e7015e4f9 (DEFAULT_TABLE table=default.Table_3d179a88ea834a449251536e388b0891 [id=e9acdeb2a2b74ef8a7de60d9c3c02bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.430351 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84477b0a4bd14522908cc28e7015e4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.439837 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 4e1472ce5a464a12a711d513446abe2a (DEFAULT_TABLE table=default.Table_e187e303d6744e46a505a79d4f80a846 [id=ae585634aade4d2aa05ea83d44ff4cb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.440363 9435 tablet_bootstrap.cc:654] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:12.440421 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1472ce5a464a12a711d513446abe2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.442386 9014 tablet_service.cc:1505] Processing CreateTablet for tablet 022c9c0d19ac450cb270319004886fe2 (DEFAULT_TABLE table=default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.443792 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022c9c0d19ac450cb270319004886fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.455616 9427 tablet_bootstrap.cc:492] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:12.455955 9427 ts_tablet_manager.cc:1403] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.180s user 0.008s sys 0.011s
I20251215 14:55:12.457687 9427 raft_consensus.cc:359] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.458124 9427 raft_consensus.cc:385] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:12.458305 9427 raft_consensus.cc:740] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:12.458858 9427 consensus_queue.cc:260] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.459187 9011 tablet_service.cc:1505] Processing CreateTablet for tablet be4393dc706f45a89b9b2c9727cd7726 (DEFAULT_TABLE table=default.Table_1bc862badd3047f59da171da067890ba [id=edaa72aef7f34ba0b7dc7b5e64d20407]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.459627 9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be4393dc706f45a89b9b2c9727cd7726. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.459293 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605da10c8d3049e8b94caa9738576aab" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:12.460837 9427 ts_tablet_manager.cc:1434] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:12.462344 9427 tablet_bootstrap.cc:492] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:12.463627 9153 tablet_service.cc:1505] Processing CreateTablet for tablet 4e1472ce5a464a12a711d513446abe2a (DEFAULT_TABLE table=default.Table_e187e303d6744e46a505a79d4f80a846 [id=ae585634aade4d2aa05ea83d44ff4cb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.467532 9007 tablet_service.cc:1505] Processing CreateTablet for tablet a71d029bbd88416da1dbcad09dc93115 (DEFAULT_TABLE table=default.Table_83a70db13a46486d9ab7008ef949a790 [id=d9742d85ec7d4f2585a5a9b8ba41505f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.468001 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71d029bbd88416da1dbcad09dc93115. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.469352 9427 tablet_bootstrap.cc:654] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:12.469471 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf6e4aa94f79403588dd1916226660fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.476802 9013 tablet_service.cc:1505] Processing CreateTablet for tablet fc3bcd441f1948a5a79d20e2e205d7f2 (DEFAULT_TABLE table=default.Table_9b6added9e534689925855e8aa8248c5 [id=5e604c3616694d44b52b5d27953d508c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.477353 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3bcd441f1948a5a79d20e2e205d7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.482784 9427 tablet_bootstrap.cc:492] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:12.483139 9427 ts_tablet_manager.cc:1403] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.004s
I20251215 14:55:12.483563 9176 raft_consensus.cc:2468] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:12.484336 9016 tablet_service.cc:1505] Processing CreateTablet for tablet 3bd33107c2ed4b27841f3e1ece1df152 (DEFAULT_TABLE table=default.Table_152b267c68cb4172a6257b9978784879 [id=78e6675d27304f3abebf11d1634f5440]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.484889 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bd33107c2ed4b27841f3e1ece1df152. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.484650 9427 raft_consensus.cc:359] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.485196 9427 raft_consensus.cc:385] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:12.485384 9427 raft_consensus.cc:740] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:12.485816 9427 consensus_queue.cc:260] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.486241 9143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ab40be35344612bdf65839e2637d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.488196 9427 ts_tablet_manager.cc:1434] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20251215 14:55:12.489720 9427 tablet_bootstrap.cc:492] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:12.493793 9150 tablet_service.cc:1505] Processing CreateTablet for tablet 022c9c0d19ac450cb270319004886fe2 (DEFAULT_TABLE table=default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.493945 9004 tablet_service.cc:1505] Processing CreateTablet for tablet 5c025355716a43569a1bebb46de7dd93 (DEFAULT_TABLE table=default.Table_e8365354eaa94ef580c03dcc8a937a81 [id=47665b21005d4b5eb4d9ae0b1be2caf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.494405 9004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c025355716a43569a1bebb46de7dd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.495754 9427 tablet_bootstrap.cc:654] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:12.498624 9147 tablet_service.cc:1552] Processing DeleteTablet for tablet 307f788967bd48e2b442657806e87fc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:12.498899 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10cd2cbd7956444cb125d97310d2b102. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.505766 9158 tablet_service.cc:1505] Processing CreateTablet for tablet d39e0db04f3c4bd3831c00b2b4825035 (DEFAULT_TABLE table=default.Table_0ab920fea5f34b65b38a501fdc8e199d [id=0db11a83ace04ee192d1773f5514f0df]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.506667 9427 tablet_bootstrap.cc:492] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:12.506974 9427 ts_tablet_manager.cc:1403] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.009s
I20251215 14:55:12.507547 9147 tablet_service.cc:1505] Processing CreateTablet for tablet be4393dc706f45a89b9b2c9727cd7726 (DEFAULT_TABLE table=default.Table_1bc862badd3047f59da171da067890ba [id=edaa72aef7f34ba0b7dc7b5e64d20407]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.508661 9427 raft_consensus.cc:359] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.509060 9427 raft_consensus.cc:385] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:12.509224 9427 raft_consensus.cc:740] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:12.509750 9427 consensus_queue.cc:260] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.511480 9427 ts_tablet_manager.cc:1434] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20251215 14:55:12.511920 9151 tablet_service.cc:1505] Processing CreateTablet for tablet 84477b0a4bd14522908cc28e7015e4f9 (DEFAULT_TABLE table=default.Table_3d179a88ea834a449251536e388b0891 [id=e9acdeb2a2b74ef8a7de60d9c3c02bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.512210 9427 tablet_bootstrap.cc:492] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:12.514966 9427 tablet_bootstrap.cc:654] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:12.519235 9160 tablet_service.cc:1505] Processing CreateTablet for tablet a71d029bbd88416da1dbcad09dc93115 (DEFAULT_TABLE table=default.Table_83a70db13a46486d9ab7008ef949a790 [id=d9742d85ec7d4f2585a5a9b8ba41505f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.523947 9014 tablet_service.cc:1505] Processing CreateTablet for tablet 10890fcab7204cc7b7468402952f824c (DEFAULT_TABLE table=default.Table_764ac5e43afb4f7b92907c505f8c2d6f [id=668273e68337433d9d40680e98382656]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.524461 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10890fcab7204cc7b7468402952f824c. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:12.528877 10267 log.cc:927] Time spent T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3: Append to log took a long time: real 0.140s user 0.000s sys 0.000s
W20251215 14:55:12.540468 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet c4660d4e5cb84f3a983922c0b4aef90b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4660d4e5cb84f3a983922c0b4aef90b already in progress: creating tablet
I20251215 14:55:12.543045 9281 tablet_service.cc:1552] Processing DeleteTablet for tablet 394844a49d254112883c40df9821c075 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:11 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:12.547134 9249 leader_election.cc:304] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:12.548295 9249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 56264.9us
I20251215 14:55:12.549005 10272 raft_consensus.cc:2804] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:12.549119 10272 raft_consensus.cc:493] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:12.549233 10272 raft_consensus.cc:3060] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:12.563974 9157 tablet_service.cc:1505] Processing CreateTablet for tablet 6a7a401d5386499183b6560411f593b6 (DEFAULT_TABLE table=default.Table_95871025015c44e4b43a365970584eb5 [id=7e8561f684374b289185e72f3027003d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.564517 9011 tablet_service.cc:1505] Processing CreateTablet for tablet 7a29174caad24ebc9d26b4169085dc08 (DEFAULT_TABLE table=default.Table_b38cb006fa2b44cbb29424f716b5ec47 [id=5b015a230b8b42879166a4496e5922a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.565346 9146 tablet_service.cc:1505] Processing CreateTablet for tablet 8eb90003cf02440e9752af134a3670b6 (DEFAULT_TABLE table=default.Table_96cdb82e10874b08bd807d3d485cf7bf [id=d50dec3ceeb84a03a5cc34476a7f1519]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.567018 9015 tablet_service.cc:1505] Processing CreateTablet for tablet 86f18ff40af547da85de8966b12f76f4 (DEFAULT_TABLE table=default.Table_e073cd03acc04d7bbf396abc459c8049 [id=892a9c1f46e542daa424c7c28038f2a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.567576 9020 tablet_service.cc:1505] Processing CreateTablet for tablet 265a8937802a4b9cbf0edaf3e2a41ba8 (DEFAULT_TABLE table=default.Table_ce3b9c30c09e4078b51902229c8bebdc [id=c79c63f9101545e2aa9783c2fee2ecbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.569031 9007 tablet_service.cc:1505] Processing CreateTablet for tablet cd025ffa766d45f8bc6c42c6eaa3418c (DEFAULT_TABLE table=default.Table_cea06d4fba344de4aa4165c004aa5b46 [id=5ef3a8ef2a24423d89c8a77dffd849c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.574615 9013 tablet_service.cc:1505] Processing CreateTablet for tablet 0fed3b34844e4e5b8518c0165df342d1 (DEFAULT_TABLE table=default.Table_e51fbd4ee3b74a7b8c6be8288d9676f9 [id=7cd0187c26854291a0616bae7d19f70a]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:12.576007 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 5560a21e16bb43c7903c1fc66429ecdf
I20251215 14:55:12.576558 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_2a1b8255b8b348e7b88eacbd41d5231a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:12.576714 9004 tablet_service.cc:1505] Processing CreateTablet for tablet d20ffd43dce84ffe8c770053e5705cbd (DEFAULT_TABLE table=default.Table_76f6988924774fdb88994322136b609d [id=b295c392fa854ae18f3ee4fdddf2271b]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:12.577121 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a1b8255b8b348e7b88eacbd41d5231a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.577226 9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a29174caad24ebc9d26b4169085dc08. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.578631 8782 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_6f9a4bda466c4244b9c239e6b4bd7fe0" } modify_external_catalogs: true
I20251215 14:55:12.578819 8782 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_6f9a4bda466c4244b9c239e6b4bd7fe0" } modify_external_catalogs: true
I20251215 14:55:12.579293 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265a8937802a4b9cbf0edaf3e2a41ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.579339 9427 tablet_bootstrap.cc:492] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:12.579546 9427 ts_tablet_manager.cc:1403] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.067s user 0.016s sys 0.015s
I20251215 14:55:12.579924 8783 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781] alter complete (version 2)
I20251215 14:55:12.580514 8783 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_6c41f00ff1bf43678335e7917922d7ab" } modify_external_catalogs: true
I20251215 14:55:12.580655 8783 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_6c41f00ff1bf43678335e7917922d7ab" } modify_external_catalogs: true
I20251215 14:55:12.582135 8780 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_7624bbb38e9c499390f53c92673ed169" } modify_external_catalogs: true
I20251215 14:55:12.582340 8780 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_7624bbb38e9c499390f53c92673ed169" } modify_external_catalogs: true
I20251215 14:55:12.583362 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86f18ff40af547da85de8966b12f76f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:12.583601 8787 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 566fe9bb8a1849749087d840ef1c082d consensus state has no leader
I20251215 14:55:12.583912 8787 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_6635d000c2944e4d983b4796c36724bc" } modify_external_catalogs: true
I20251215 14:55:12.584071 8787 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_6635d000c2944e4d983b4796c36724bc" } modify_external_catalogs: true
I20251215 14:55:12.584681 9014 tablet_service.cc:1552] Processing DeleteTablet for tablet fda9eb99ccef4c16a0a947510566ecf4 with delete_type TABLET_DATA_DELETED (replaced by tablet f45f8b2fbf754d359deb666cb605c789) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:12.584951 10141 tablet_replica.cc:333] T fda9eb99ccef4c16a0a947510566ecf4 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:12.585181 10141 raft_consensus.cc:2243] T fda9eb99ccef4c16a0a947510566ecf4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:12.585353 10141 raft_consensus.cc:2272] T fda9eb99ccef4c16a0a947510566ecf4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:12.586166 9427 raft_consensus.cc:359] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.586588 9427 raft_consensus.cc:385] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:12.586898 9427 raft_consensus.cc:740] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:12.587291 9004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d20ffd43dce84ffe8c770053e5705cbd. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:12.587370 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 6ae72a1ded6e4faba1ad309d9a0e4a95
W20251215 14:55:12.587462 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 5e80ac7bd98a46119a30bd5d2f3de2f9
W20251215 14:55:12.587510 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 194bb745ecb849cb9092fee1afb7dbe6
W20251215 14:55:12.587604 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 30c5c795ea4a4fe591cdf63320ec2521
W20251215 14:55:12.587654 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 5bfe8cc0805247de9df4a59d461818f3
I20251215 14:55:12.587795 9427 consensus_queue.cc:260] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.588775 8785 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_6a799de3eef44940b8461740c75bcec3" } new_table_name: "default.Table_aa885863620a4610ac00d0c8b0406b38" modify_external_catalogs: true
I20251215 14:55:12.590204 9427 ts_tablet_manager.cc:1434] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20251215 14:55:12.591053 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fed3b34844e4e5b8518c0165df342d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.591795 10141 ts_tablet_manager.cc:1916] T fda9eb99ccef4c16a0a947510566ecf4 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:12.593218 8784 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet e0c88310853f47b0aa1af9a3d676bef6 (table default.Table_6b689570cd944426b4edf8342163ef0e [id=d0891c1ad38b48348b350482a3298f39]). Expected version 1 got 0
W20251215 14:55:12.598874 8779 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce147d1fcda2480daa557276c33a6096 consensus state has no leader
I20251215 14:55:12.599982 10141 ts_tablet_manager.cc:1929] T fda9eb99ccef4c16a0a947510566ecf4 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:12.600410 9016 tablet_service.cc:1505] Processing CreateTablet for tablet 43e9cfdc89b04781b7b5892af07307af (DEFAULT_TABLE table=default.Table_76a8f78ec8a74aadaf69142df6990dc8 [id=94ddd629cb1e4f5eb0061100187f4202]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.600579 8779 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_59a89434b3b24db2905384e5da65e1a0" } new_table_name: "default.Table_eadbf387a9344a44866d99c147155c8c" modify_external_catalogs: true
I20251215 14:55:12.600968 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e9cfdc89b04781b7b5892af07307af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.601819 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_2e2c247d317f40768e0fdafb990b1266"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:12.602716 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e2c247d317f40768e0fdafb990b1266 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.602643 10141 log.cc:1199] T fda9eb99ccef4c16a0a947510566ecf4 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/fda9eb99ccef4c16a0a947510566ecf4
I20251215 14:55:12.603914 10141 ts_tablet_manager.cc:1950] T fda9eb99ccef4c16a0a947510566ecf4 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:12.605832 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet fda9eb99ccef4c16a0a947510566ecf4 (table default.Table_f6164e312b7a4576a27fab2ab89f91ca [id=c1c5f6c604c24855a17e2dfb4174965b]) successfully deleted
I20251215 14:55:12.607030 9427 tablet_bootstrap.cc:492] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:12.609871 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd025ffa766d45f8bc6c42c6eaa3418c. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:12.611217 8788 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet de24f0b914304135bebcdb09e9b2f2f9 consensus state has no leader
I20251215 14:55:12.612107 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_086a011ce2d24a8e80197a41b046c8e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:12.612665 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_086a011ce2d24a8e80197a41b046c8e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.615540 9148 tablet_service.cc:1505] Processing CreateTablet for tablet fc3bcd441f1948a5a79d20e2e205d7f2 (DEFAULT_TABLE table=default.Table_9b6added9e534689925855e8aa8248c5 [id=5e604c3616694d44b52b5d27953d508c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.616109 9153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1472ce5a464a12a711d513446abe2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.616622 9148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3bcd441f1948a5a79d20e2e205d7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.617580 9144 tablet_service.cc:1505] Processing CreateTablet for tablet 3bd33107c2ed4b27841f3e1ece1df152 (DEFAULT_TABLE table=default.Table_152b267c68cb4172a6257b9978784879 [id=78e6675d27304f3abebf11d1634f5440]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.621595 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 6a7a401d5386499183b6560411f593b6 (DEFAULT_TABLE table=default.Table_95871025015c44e4b43a365970584eb5 [id=7e8561f684374b289185e72f3027003d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.624048 9281 tablet_service.cc:1552] Processing DeleteTablet for tablet 307f788967bd48e2b442657806e87fc4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:12.626392 9294 tablet_service.cc:1505] Processing CreateTablet for tablet d39e0db04f3c4bd3831c00b2b4825035 (DEFAULT_TABLE table=default.Table_0ab920fea5f34b65b38a501fdc8e199d [id=0db11a83ace04ee192d1773f5514f0df]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.612612 9156 tablet_service.cc:1505] Processing CreateTablet for tablet 39d0bab4179d4af68d2dbcd3e215873e (DEFAULT_TABLE table=default.Table_ea901dccd4124611b16871022906a3eb [id=e7f88ae86b464c9e8b6e928eb3c7df81]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.629518 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a7a401d5386499183b6560411f593b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.631526 9288 tablet_service.cc:1505] Processing CreateTablet for tablet 39d0bab4179d4af68d2dbcd3e215873e (DEFAULT_TABLE table=default.Table_ea901dccd4124611b16871022906a3eb [id=e7f88ae86b464c9e8b6e928eb3c7df81]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.632740 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d39e0db04f3c4bd3831c00b2b4825035. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.637205 9426 tablet_bootstrap.cc:492] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:12.640094 9152 tablet_service.cc:1505] Processing CreateTablet for tablet 10890fcab7204cc7b7468402952f824c (DEFAULT_TABLE table=default.Table_764ac5e43afb4f7b92907c505f8c2d6f [id=668273e68337433d9d40680e98382656]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.640982 9426 ts_tablet_manager.cc:1403] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.521s user 0.019s sys 0.050s
I20251215 14:55:12.623311 10272 raft_consensus.cc:515] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.641778 9426 raft_consensus.cc:359] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.641961 9426 raft_consensus.cc:385] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:12.642040 9426 raft_consensus.cc:740] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:12.642233 9426 consensus_queue.cc:260] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.642729 9426 ts_tablet_manager.cc:1434] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:12.642946 9288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39d0bab4179d4af68d2dbcd3e215873e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.643543 9160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71d029bbd88416da1dbcad09dc93115. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.643857 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bd33107c2ed4b27841f3e1ece1df152. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.646119 9147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be4393dc706f45a89b9b2c9727cd7726. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.646871 9150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022c9c0d19ac450cb270319004886fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.648012 9146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb90003cf02440e9752af134a3670b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.648643 9149 tablet_service.cc:1505] Processing CreateTablet for tablet 5c025355716a43569a1bebb46de7dd93 (DEFAULT_TABLE table=default.Table_e8365354eaa94ef580c03dcc8a937a81 [id=47665b21005d4b5eb4d9ae0b1be2caf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.653455 10272 leader_election.cc:290] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:12.654089 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 394844a49d254112883c40df9821c075 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 394844a49d254112883c40df9821c075 already in progress: creating tablet
W20251215 14:55:12.654332 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 307f788967bd48e2b442657806e87fc4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 307f788967bd48e2b442657806e87fc4 already in progress: creating tablet
I20251215 14:55:12.657003 8782 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 396fe2752398427f840998609beba351
I20251215 14:55:12.657567 8783 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 84f036eb44a44e0597bc9af88d81a017
I20251215 14:55:12.657851 8780 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 35326e99d413431583b25d11269d09dc
I20251215 14:55:12.658390 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet a723f46302f34465a214714e98e47de7
W20251215 14:55:12.659370 8785 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 548e6d35016746e2b8f5184ee44071cb consensus state has no leader
I20251215 14:55:12.659727 8785 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_33fa344a68b64dcc901ab7f6ce8de37b" } modify_external_catalogs: true
I20251215 14:55:12.659917 8785 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_33fa344a68b64dcc901ab7f6ce8de37b" } modify_external_catalogs: true
W20251215 14:55:12.661520 8779 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f4ec165149a74778aee1fb39c4d96871 consensus state has no leader
I20251215 14:55:12.661901 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_bc2a4de45b6c48838b6c80eb0c0a12b1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:12.662555 8784 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1] alter complete (version 1)
I20251215 14:55:12.663830 9281 tablet_service.cc:1505] Processing CreateTablet for tablet be4393dc706f45a89b9b2c9727cd7726 (DEFAULT_TABLE table=default.Table_1bc862badd3047f59da171da067890ba [id=edaa72aef7f34ba0b7dc7b5e64d20407]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.664366 10272 raft_consensus.cc:493] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:12.664525 9281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be4393dc706f45a89b9b2c9727cd7726. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.667850 8781 catalog_manager.cc:5654] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e89303a500544272b601d7c29be802b4 (127.8.121.131). New cstate: current_term: 1 leader_uuid: "e89303a500544272b601d7c29be802b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: HEALTHY } } }
I20251215 14:55:12.668236 8781 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet a639396098a941249afd9c3560073131 (table default.Table_404807c380fa4483ac5e0545eb3028cd [id=5cc820ec2c8b427db1c89647b295363e]). Expected version 1 got 0
I20251215 14:55:12.668439 8781 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1]). Expected version 1 got 0
W20251215 14:55:12.672068 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bc2a4de45b6c48838b6c80eb0c0a12b1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.673965 9278 tablet_service.cc:1505] Processing CreateTablet for tablet fc3bcd441f1948a5a79d20e2e205d7f2 (DEFAULT_TABLE table=default.Table_9b6added9e534689925855e8aa8248c5 [id=5e604c3616694d44b52b5d27953d508c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.674616 9278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc3bcd441f1948a5a79d20e2e205d7f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.675802 9277 tablet_service.cc:1505] Processing CreateTablet for tablet 022c9c0d19ac450cb270319004886fe2 (DEFAULT_TABLE table=default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.676113 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022c9c0d19ac450cb270319004886fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.677289 10272 raft_consensus.cc:515] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.677884 10272 leader_election.cc:290] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:12.678869 9279 tablet_service.cc:1505] Processing CreateTablet for tablet 3bd33107c2ed4b27841f3e1ece1df152 (DEFAULT_TABLE table=default.Table_152b267c68cb4172a6257b9978784879 [id=78e6675d27304f3abebf11d1634f5440]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.679365 9279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bd33107c2ed4b27841f3e1ece1df152. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.680064 9289 tablet_service.cc:1552] Processing DeleteTablet for tablet 5dc81eb40614463cb5017475b378eea6 with delete_type TABLET_DATA_DELETED (replaced by tablet 43e9cfdc89b04781b7b5892af07307af) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:12.680438 9944 tablet_replica.cc:333] T 5dc81eb40614463cb5017475b378eea6 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:12.680652 9944 raft_consensus.cc:2243] T 5dc81eb40614463cb5017475b378eea6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:12.680819 9944 raft_consensus.cc:2272] T 5dc81eb40614463cb5017475b378eea6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:12.681480 9944 ts_tablet_manager.cc:1916] T 5dc81eb40614463cb5017475b378eea6 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:12.683629 9281 tablet_service.cc:1505] Processing CreateTablet for tablet a71d029bbd88416da1dbcad09dc93115 (DEFAULT_TABLE table=default.Table_83a70db13a46486d9ab7008ef949a790 [id=d9742d85ec7d4f2585a5a9b8ba41505f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.684415 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a7a401d5386499183b6560411f593b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.684902 9151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84477b0a4bd14522908cc28e7015e4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.686496 9281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a71d029bbd88416da1dbcad09dc93115. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.687300 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d39e0db04f3c4bd3831c00b2b4825035. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.684015 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 8eb90003cf02440e9752af134a3670b6 (DEFAULT_TABLE table=default.Table_96cdb82e10874b08bd807d3d485cf7bf [id=d50dec3ceeb84a03a5cc34476a7f1519]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.687691 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb90003cf02440e9752af134a3670b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.689210 9288 tablet_service.cc:1505] Processing CreateTablet for tablet 84477b0a4bd14522908cc28e7015e4f9 (DEFAULT_TABLE table=default.Table_3d179a88ea834a449251536e388b0891 [id=e9acdeb2a2b74ef8a7de60d9c3c02bbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.689548 9288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84477b0a4bd14522908cc28e7015e4f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.690208 9155 tablet_service.cc:1505] Processing CreateTablet for tablet 7a29174caad24ebc9d26b4169085dc08 (DEFAULT_TABLE table=default.Table_b38cb006fa2b44cbb29424f716b5ec47 [id=5b015a230b8b42879166a4496e5922a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.690583 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a29174caad24ebc9d26b4169085dc08. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.690824 9143 tablet_service.cc:1505] Processing CreateTablet for tablet cd025ffa766d45f8bc6c42c6eaa3418c (DEFAULT_TABLE table=default.Table_cea06d4fba344de4aa4165c004aa5b46 [id=5ef3a8ef2a24423d89c8a77dffd849c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.691145 9143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd025ffa766d45f8bc6c42c6eaa3418c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.694136 9149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c025355716a43569a1bebb46de7dd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.700187 9156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39d0bab4179d4af68d2dbcd3e215873e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.700440 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bfe8cc0805247de9df4a59d461818f3" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:12.700987 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605da10c8d3049e8b94caa9738576aab" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:12.705711 8785 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 295325c4a2ca41caaabddbd96d4bce19
I20251215 14:55:12.707438 9020 tablet_service.cc:1505] Processing CreateTablet for tablet f45f8b2fbf754d359deb666cb605c789 (DEFAULT_TABLE table=default.Table_f6164e312b7a4576a27fab2ab89f91ca [id=c1c5f6c604c24855a17e2dfb4174965b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.711947 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 2a5b0004e03d4c068419eb00ebadf3f9 (DEFAULT_TABLE table=default.Table_85664ed43073430ba25d65731ed7ca2e [id=590eaf55a8f84825980ad3485ae6b281]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.712322 9014 tablet_service.cc:1505] Processing CreateTablet for tablet 82575517299b4e69a0871714dde9aacc (DEFAULT_TABLE table=default.Table_6a7ef1364990457b8e316783de244cfc [id=37ae880d9c194f9bbe6793ac9a68b0c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.712661 9008 tablet_service.cc:1505] Processing CreateTablet for tablet 84f036eb44a44e0597bc9af88d81a017 (DEFAULT_TABLE table=default.Table_6c41f00ff1bf43678335e7917922d7ab [id=2ab94e1dc2054eba9293fca4eaebdbe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.712035 9003 tablet_service.cc:1552] Processing DeleteTablet for tablet 396fe2752398427f840998609beba351 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:12.711953 9427 tablet_bootstrap.cc:654] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:12.713712 9010 tablet_service.cc:1552] Processing DeleteTablet for tablet 35326e99d413431583b25d11269d09dc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:12.713920 9022 tablet_service.cc:1505] Processing CreateTablet for tablet a723f46302f34465a214714e98e47de7 (DEFAULT_TABLE table=default.Table_6635d000c2944e4d983b4796c36724bc [id=3c809110ab2f4e4abc98c37e89133d03]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.714062 9018 tablet_service.cc:1505] Processing CreateTablet for tablet e6084ebf2a804bfc9d2c2cde3e0cba98 (DEFAULT_TABLE table=default.Table_71fb566bde204f5a9381ce697d4188a2 [id=aa5f00ae0cad4993adf993890f7e9372]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.713953 9009 tablet_service.cc:1505] Processing CreateTablet for tablet 1dde4fcdf3104154936f70977e5378bd (DEFAULT_TABLE table=default.Table_2fa3900b9f0b4cb7a4d20f214f84369e [id=e67b0c10ec244372b1f79c35e7993555]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.713928 9006 tablet_service.cc:1505] Processing CreateTablet for tablet 90c7925890474a76b35a3ce5e6db8ebf (DEFAULT_TABLE table=default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.717532 9012 tablet_service.cc:1552] Processing DeleteTablet for tablet 295325c4a2ca41caaabddbd96d4bce19 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:12.718999 9170 raft_consensus.cc:3060] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:12.719007 9003 tablet_service.cc:1552] Processing DeleteTablet for tablet a723f46302f34465a214714e98e47de7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:12.720702 9249 leader_election.cc:343] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:12.721033 9010 tablet_service.cc:1552] Processing DeleteTablet for tablet 84f036eb44a44e0597bc9af88d81a017 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:12.721706 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82575517299b4e69a0871714dde9aacc. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:12.725029 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 5e80ac7bd98a46119a30bd5d2f3de2f9
W20251215 14:55:12.725121 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 5dc81eb40614463cb5017475b378eea6
W20251215 14:55:12.725215 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 11a5a6a0895c49648c910fa2ea3ca373
W20251215 14:55:12.725267 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 194bb745ecb849cb9092fee1afb7dbe6
W20251215 14:55:12.725327 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet c7f760639a664cfb9f4af5578154b981
W20251215 14:55:12.725409 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 38e50a7f2bdd4907ab41436b59397ea6
W20251215 14:55:12.725467 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 18cd1f63d51e4565bb8c55be13e3e099
I20251215 14:55:12.726135 8779 catalog_manager.cc:5654] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130). New cstate: current_term: 1 leader_uuid: "3ea5306c36594ef4a62211f2bd6669a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:12.726528 8779 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_3f190fdaff1446908955f4b5957a8084 [id=cbafb4499c90447d8f185928d3e58b20]). Expected version 1 got 0
I20251215 14:55:12.726850 8779 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet e0c88310853f47b0aa1af9a3d676bef6 (table default.Table_6b689570cd944426b4edf8342163ef0e [id=d0891c1ad38b48348b350482a3298f39]). Expected version 1 got 0
I20251215 14:55:12.732421 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 10890fcab7204cc7b7468402952f824c (DEFAULT_TABLE table=default.Table_764ac5e43afb4f7b92907c505f8c2d6f [id=668273e68337433d9d40680e98382656]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.735061 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10890fcab7204cc7b7468402952f824c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.741686 9291 tablet_service.cc:1505] Processing CreateTablet for tablet 7a29174caad24ebc9d26b4169085dc08 (DEFAULT_TABLE table=default.Table_b38cb006fa2b44cbb29424f716b5ec47 [id=5b015a230b8b42879166a4496e5922a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.742900 9290 tablet_service.cc:1505] Processing CreateTablet for tablet cd025ffa766d45f8bc6c42c6eaa3418c (DEFAULT_TABLE table=default.Table_cea06d4fba344de4aa4165c004aa5b46 [id=5ef3a8ef2a24423d89c8a77dffd849c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.742902 9291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a29174caad24ebc9d26b4169085dc08. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.743907 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 5c025355716a43569a1bebb46de7dd93 (DEFAULT_TABLE table=default.Table_e8365354eaa94ef580c03dcc8a937a81 [id=47665b21005d4b5eb4d9ae0b1be2caf5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.748953 9507 consensus_queue.cc:1048] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20251215 14:55:12.749058 9141 tablet_service.cc:1505] Processing CreateTablet for tablet 0fed3b34844e4e5b8518c0165df342d1 (DEFAULT_TABLE table=default.Table_e51fbd4ee3b74a7b8c6be8288d9676f9 [id=7cd0187c26854291a0616bae7d19f70a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.748621 9175 raft_consensus.cc:2468] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:12.751765 9150 tablet_service.cc:1505] Processing CreateTablet for tablet 82575517299b4e69a0871714dde9aacc (DEFAULT_TABLE table=default.Table_6a7ef1364990457b8e316783de244cfc [id=37ae880d9c194f9bbe6793ac9a68b0c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.755571 9145 tablet_service.cc:1505] Processing CreateTablet for tablet d20ffd43dce84ffe8c770053e5705cbd (DEFAULT_TABLE table=default.Table_76f6988924774fdb88994322136b609d [id=b295c392fa854ae18f3ee4fdddf2271b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.758656 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd025ffa766d45f8bc6c42c6eaa3418c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.762450 9944 ts_tablet_manager.cc:1929] T 5dc81eb40614463cb5017475b378eea6 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:12.762588 9944 log.cc:1199] T 5dc81eb40614463cb5017475b378eea6 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/5dc81eb40614463cb5017475b378eea6
I20251215 14:55:12.762960 9944 ts_tablet_manager.cc:1950] T 5dc81eb40614463cb5017475b378eea6 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:12.764102 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c025355716a43569a1bebb46de7dd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.764761 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 43e9cfdc89b04781b7b5892af07307af (DEFAULT_TABLE table=default.Table_76a8f78ec8a74aadaf69142df6990dc8 [id=94ddd629cb1e4f5eb0061100187f4202]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.767773 9283 tablet_service.cc:1505] Processing CreateTablet for tablet 0fed3b34844e4e5b8518c0165df342d1 (DEFAULT_TABLE table=default.Table_e51fbd4ee3b74a7b8c6be8288d9676f9 [id=7cd0187c26854291a0616bae7d19f70a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.781209 9015 tablet_service.cc:1505] Processing CreateTablet for tablet 52e93348b205408f83efff27fde48e9b (DEFAULT_TABLE table=default.Table_df5cd1437ab641ea87c1567d9cb6e8f1 [id=88f7fcbc20b94bc1bf6f911c475ee98d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.786228 10269 raft_consensus.cc:493] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:12.786623 10269 raft_consensus.cc:515] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.788264 10274 raft_consensus.cc:493] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:12.793503 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_908bf3eb9e4d45daa3e63b9fb069fcf7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:12.793759 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c543b8dc67f5414f8d8796af21b0f077"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:12.794209 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_908bf3eb9e4d45daa3e63b9fb069fcf7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:12.794399 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c543b8dc67f5414f8d8796af21b0f077 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.795467 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_961210c318cf477d87a5d6f9dae90d3d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:12.795998 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_961210c318cf477d87a5d6f9dae90d3d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.797403 8782 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_26adf52407f64ad28bfc32668a710cba" } new_table_name: "default.Table_f4b76ffdb5334ac2b6cd96375894f889" modify_external_catalogs: true
I20251215 14:55:12.797899 9426 tablet_bootstrap.cc:492] T 2d75636265f14a428aae592438064ea2 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:12.801147 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_5d98ed2bfc54418c8a8fe7d0694708b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:12.801781 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d98ed2bfc54418c8a8fe7d0694708b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.802456 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_d254592e0f274292acd8700ab11b09dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:12.802649 9147 tablet_service.cc:1505] Processing CreateTablet for tablet f45f8b2fbf754d359deb666cb605c789 (DEFAULT_TABLE table=default.Table_f6164e312b7a4576a27fab2ab89f91ca [id=c1c5f6c604c24855a17e2dfb4174965b]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:12.803027 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d254592e0f274292acd8700ab11b09dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.804373 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c50f337fe1ac4ea4bb935c8d64bfc244"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:12.804903 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c50f337fe1ac4ea4bb935c8d64bfc244 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.806825 9144 tablet_service.cc:1505] Processing CreateTablet for tablet 86f18ff40af547da85de8966b12f76f4 (DEFAULT_TABLE table=default.Table_e073cd03acc04d7bbf396abc459c8049 [id=892a9c1f46e542daa424c7c28038f2a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.807147 9152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10890fcab7204cc7b7468402952f824c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.807358 8786 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_5cb40c5780dd4319958f61003a3f06c3" } new_table_name: "default.Table_c5e74b5e0e27496faba60875b5541547" modify_external_catalogs: true
I20251215 14:55:12.812925 8788 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_0923c14f03464a8390571358e5de2145" } new_table_name: "default.Table_2e1e3e730bbb4364b0f1f86d7d89056a" modify_external_catalogs: true
I20251215 14:55:12.819027 9148 tablet_service.cc:1505] Processing CreateTablet for tablet 52e93348b205408f83efff27fde48e9b (DEFAULT_TABLE table=default.Table_df5cd1437ab641ea87c1567d9cb6e8f1 [id=88f7fcbc20b94bc1bf6f911c475ee98d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.821246 9147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45f8b2fbf754d359deb666cb605c789. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:12.821657 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:12.822495 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e9cfdc89b04781b7b5892af07307af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.823200 9507 consensus_queue.cc:1048] T 5560a21e16bb43c7903c1fc66429ecdf P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.054s
I20251215 14:55:12.826939 9283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fed3b34844e4e5b8518c0165df342d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.829505 10144 consensus_queue.cc:1048] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20251215 14:55:12.833374 10274 raft_consensus.cc:515] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.834141 10274 leader_election.cc:290] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:12.835072 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45f8b2fbf754d359deb666cb605c789. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.836751 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a723f46302f34465a214714e98e47de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.828117 9142 tablet_service.cc:1505] Processing CreateTablet for tablet 265a8937802a4b9cbf0edaf3e2a41ba8 (DEFAULT_TABLE table=default.Table_ce3b9c30c09e4078b51902229c8bebdc [id=c79c63f9101545e2aa9783c2fee2ecbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.839641 9008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f036eb44a44e0597bc9af88d81a017. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.842065 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a5b0004e03d4c068419eb00ebadf3f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.842399 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 43e9cfdc89b04781b7b5892af07307af (DEFAULT_TABLE table=default.Table_76a8f78ec8a74aadaf69142df6990dc8 [id=94ddd629cb1e4f5eb0061100187f4202]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.843114 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6084ebf2a804bfc9d2c2cde3e0cba98. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.844348 9009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dde4fcdf3104154936f70977e5378bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.844563 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86f18ff40af547da85de8966b12f76f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.845045 9006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c7925890474a76b35a3ce5e6db8ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.846109 9285 tablet_service.cc:1505] Processing CreateTablet for tablet d20ffd43dce84ffe8c770053e5705cbd (DEFAULT_TABLE table=default.Table_76f6988924774fdb88994322136b609d [id=b295c392fa854ae18f3ee4fdddf2271b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.852159 9286 tablet_service.cc:1505] Processing CreateTablet for tablet 86f18ff40af547da85de8966b12f76f4 (DEFAULT_TABLE table=default.Table_e073cd03acc04d7bbf396abc459c8049 [id=892a9c1f46e542daa424c7c28038f2a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.852953 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e9cfdc89b04781b7b5892af07307af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.853744 9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265a8937802a4b9cbf0edaf3e2a41ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.854395 9158 tablet_service.cc:1505] Processing CreateTablet for tablet a723f46302f34465a214714e98e47de7 (DEFAULT_TABLE table=default.Table_6635d000c2944e4d983b4796c36724bc [id=3c809110ab2f4e4abc98c37e89133d03]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.854808 9145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d20ffd43dce84ffe8c770053e5705cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.855381 9148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e93348b205408f83efff27fde48e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.857342 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c9ff0075955547bfba3e55a69194c7e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:12.857903 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9ff0075955547bfba3e55a69194c7e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.858660 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a723f46302f34465a214714e98e47de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.863265 9285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d20ffd43dce84ffe8c770053e5705cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.863981 9286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86f18ff40af547da85de8966b12f76f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.872700 9287 tablet_service.cc:1505] Processing CreateTablet for tablet 265a8937802a4b9cbf0edaf3e2a41ba8 (DEFAULT_TABLE table=default.Table_ce3b9c30c09e4078b51902229c8bebdc [id=c79c63f9101545e2aa9783c2fee2ecbc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.872714 9158 tablet_service.cc:1505] Processing CreateTablet for tablet 2a5b0004e03d4c068419eb00ebadf3f9 (DEFAULT_TABLE table=default.Table_85664ed43073430ba25d65731ed7ca2e [id=590eaf55a8f84825980ad3485ae6b281]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.873106 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a5b0004e03d4c068419eb00ebadf3f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.873775 9287 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265a8937802a4b9cbf0edaf3e2a41ba8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.876926 9282 tablet_service.cc:1505] Processing CreateTablet for tablet f45f8b2fbf754d359deb666cb605c789 (DEFAULT_TABLE table=default.Table_f6164e312b7a4576a27fab2ab89f91ca [id=c1c5f6c604c24855a17e2dfb4174965b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.877331 9282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f45f8b2fbf754d359deb666cb605c789. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.885099 9146 tablet_service.cc:1505] Processing CreateTablet for tablet 84f036eb44a44e0597bc9af88d81a017 (DEFAULT_TABLE table=default.Table_6c41f00ff1bf43678335e7917922d7ab [id=2ab94e1dc2054eba9293fca4eaebdbe7]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:12.845939 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 396fe2752398427f840998609beba351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 396fe2752398427f840998609beba351 already in progress: creating tablet
W20251215 14:55:12.885689 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 35326e99d413431583b25d11269d09dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35326e99d413431583b25d11269d09dc already in progress: creating tablet
W20251215 14:55:12.886063 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 295325c4a2ca41caaabddbd96d4bce19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 295325c4a2ca41caaabddbd96d4bce19 already in progress: creating tablet
W20251215 14:55:12.886322 8772 catalog_manager.cc:4952] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet a723f46302f34465a214714e98e47de7 because the tablet was not found. No further retry: Not found: Tablet not found: a723f46302f34465a214714e98e47de7
W20251215 14:55:12.886626 8772 catalog_manager.cc:4952] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 84f036eb44a44e0597bc9af88d81a017 because the tablet was not found. No further retry: Not found: Tablet not found: 84f036eb44a44e0597bc9af88d81a017
I20251215 14:55:12.891944 9284 tablet_service.cc:1505] Processing CreateTablet for tablet 82575517299b4e69a0871714dde9aacc (DEFAULT_TABLE table=default.Table_6a7ef1364990457b8e316783de244cfc [id=37ae880d9c194f9bbe6793ac9a68b0c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.892825 9294 tablet_service.cc:1505] Processing CreateTablet for tablet 52e93348b205408f83efff27fde48e9b (DEFAULT_TABLE table=default.Table_df5cd1437ab641ea87c1567d9cb6e8f1 [id=88f7fcbc20b94bc1bf6f911c475ee98d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.898468 9294 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e93348b205408f83efff27fde48e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.898846 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82575517299b4e69a0871714dde9aacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.904505 9435 tablet_bootstrap.cc:492] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:12.907047 9435 ts_tablet_manager.cc:1403] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.505s user 0.007s sys 0.004s
I20251215 14:55:12.907469 9141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fed3b34844e4e5b8518c0165df342d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.909575 9146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f036eb44a44e0597bc9af88d81a017. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.911375 9290 tablet_service.cc:1505] Processing CreateTablet for tablet a723f46302f34465a214714e98e47de7 (DEFAULT_TABLE table=default.Table_6635d000c2944e4d983b4796c36724bc [id=3c809110ab2f4e4abc98c37e89133d03]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.913394 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a723f46302f34465a214714e98e47de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.914932 9278 tablet_service.cc:1505] Processing CreateTablet for tablet 84f036eb44a44e0597bc9af88d81a017 (DEFAULT_TABLE table=default.Table_6c41f00ff1bf43678335e7917922d7ab [id=2ab94e1dc2054eba9293fca4eaebdbe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.929411 9291 tablet_service.cc:1552] Processing DeleteTablet for tablet 84f036eb44a44e0597bc9af88d81a017 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:12.930078 9279 tablet_service.cc:1505] Processing CreateTablet for tablet 2a5b0004e03d4c068419eb00ebadf3f9 (DEFAULT_TABLE table=default.Table_85664ed43073430ba25d65731ed7ca2e [id=590eaf55a8f84825980ad3485ae6b281]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.930162 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52e93348b205408f83efff27fde48e9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.932890 10269 leader_election.cc:290] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:12.944059 9278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84f036eb44a44e0597bc9af88d81a017. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.944820 9280 tablet_service.cc:1505] Processing CreateTablet for tablet 1dde4fcdf3104154936f70977e5378bd (DEFAULT_TABLE table=default.Table_2fa3900b9f0b4cb7a4d20f214f84369e [id=e67b0c10ec244372b1f79c35e7993555]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.945523 9276 tablet_service.cc:1505] Processing CreateTablet for tablet e6084ebf2a804bfc9d2c2cde3e0cba98 (DEFAULT_TABLE table=default.Table_71fb566bde204f5a9381ce697d4188a2 [id=aa5f00ae0cad4993adf993890f7e9372]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.946648 9292 tablet_service.cc:1505] Processing CreateTablet for tablet 90c7925890474a76b35a3ce5e6db8ebf (DEFAULT_TABLE table=default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:12.947633 9279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a5b0004e03d4c068419eb00ebadf3f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.947985 9292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c7925890474a76b35a3ce5e6db8ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.950369 9276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6084ebf2a804bfc9d2c2cde3e0cba98. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:12.951853 9435 raft_consensus.cc:359] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.954985 9280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dde4fcdf3104154936f70977e5378bd. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:12.956069 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet c4660d4e5cb84f3a983922c0b4aef90b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4660d4e5cb84f3a983922c0b4aef90b already in progress: creating tablet
W20251215 14:55:12.956751 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 394844a49d254112883c40df9821c075 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 394844a49d254112883c40df9821c075 already in progress: creating tablet
W20251215 14:55:12.956974 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 307f788967bd48e2b442657806e87fc4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 307f788967bd48e2b442657806e87fc4 already in progress: creating tablet
I20251215 14:55:12.957463 9427 tablet_bootstrap.cc:492] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:12.957643 9427 ts_tablet_manager.cc:1403] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.351s user 0.004s sys 0.013s
I20251215 14:55:12.958460 9427 raft_consensus.cc:359] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.959992 9427 raft_consensus.cc:385] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:12.960110 9427 raft_consensus.cc:740] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:12.960352 9427 consensus_queue.cc:260] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.961100 9427 ts_tablet_manager.cc:1434] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20251215 14:55:12.962451 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605da10c8d3049e8b94caa9738576aab" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:12.962544 9427 tablet_bootstrap.cc:492] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:12.964424 9427 tablet_bootstrap.cc:654] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:12.966457 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605da10c8d3049e8b94caa9738576aab" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
W20251215 14:55:12.970903 8782 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 404cb1888ca2402ab7a41d0d5efeacd8 consensus state has no leader
W20251215 14:55:12.972913 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 194bb745ecb849cb9092fee1afb7dbe6
W20251215 14:55:12.972992 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 5dc81eb40614463cb5017475b378eea6
W20251215 14:55:12.973264 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 77780f8cfe544db7baee2c761fe52ca2
I20251215 14:55:12.973905 8785 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_2c8a749747754618ab3d5e74e5326d98" } new_table_name: "default.Table_4ab2ab5a74644bd69cd192d03772905d" modify_external_catalogs: true
W20251215 14:55:12.975068 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 11a5a6a0895c49648c910fa2ea3ca373
W20251215 14:55:12.975512 8786 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9e317c8dc24e481abb709e932fa39c29 consensus state has no leader
I20251215 14:55:12.975584 8783 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_567ed696be7f44e7b1dd2a108dcce2b3" } new_table_name: "default.Table_5a1f6846c5344a53b59844dbc4f6a24f" modify_external_catalogs: true
W20251215 14:55:12.976858 8788 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 605da10c8d3049e8b94caa9738576aab consensus state has no leader
I20251215 14:55:12.977195 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_d89eda12e44643bb9eb29e87f1562d49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:12.977269 8788 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c1335c74e0f740b08e701ac0246125f0" } modify_external_catalogs: true
I20251215 14:55:12.977421 8788 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c1335c74e0f740b08e701ac0246125f0" } modify_external_catalogs: true
W20251215 14:55:12.977759 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d89eda12e44643bb9eb29e87f1562d49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.979063 8784 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_6636b9f6676f4832ad6ddbf09735cbdb" } modify_external_catalogs: true
I20251215 14:55:12.979236 8784 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_6636b9f6676f4832ad6ddbf09735cbdb" } modify_external_catalogs: true
I20251215 14:55:12.980944 8779 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_3d179a88ea834a449251536e388b0891" } modify_external_catalogs: true
I20251215 14:55:12.981007 8780 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_3b14c63de5274e12a94726cb1c368a36" } modify_external_catalogs: true
I20251215 14:55:12.981106 8779 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_3d179a88ea834a449251536e388b0891" } modify_external_catalogs: true
I20251215 14:55:12.981163 8780 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_3b14c63de5274e12a94726cb1c368a36" } modify_external_catalogs: true
I20251215 14:55:12.982502 8787 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_1c4625e0c84d45528a90ab30fb24012d" } modify_external_catalogs: true
I20251215 14:55:12.982685 8787 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_1c4625e0c84d45528a90ab30fb24012d" } modify_external_catalogs: true
I20251215 14:55:12.984035 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_1e4d9ebb532f4e8c9ffc36b6b690d502"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:12.984604 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1e4d9ebb532f4e8c9ffc36b6b690d502 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:12.985584 10274 raft_consensus.cc:493] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:12.985754 10274 raft_consensus.cc:515] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.986385 10274 leader_election.cc:290] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:12.997788 9427 tablet_bootstrap.cc:492] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:12.998008 9427 ts_tablet_manager.cc:1403] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.001s
I20251215 14:55:12.998306 8782 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet e0c88310853f47b0aa1af9a3d676bef6 (table default.Table_6b689570cd944426b4edf8342163ef0e [id=d0891c1ad38b48348b350482a3298f39]). Expected version 1 got 0
I20251215 14:55:12.998941 9427 raft_consensus.cc:359] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:12.999450 9427 raft_consensus.cc:385] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:12.999574 9427 raft_consensus.cc:740] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:12.999858 9427 consensus_queue.cc:260] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.000573 9427 ts_tablet_manager.cc:1434] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:13.000896 9427 tablet_bootstrap.cc:492] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:13.004913 8783 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b32d996521dd4330b84ff4e1951f5124 has no consensus state
I20251215 14:55:13.005357 9427 tablet_bootstrap.cc:654] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:13.005306 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_4b3ae2f8a28c4a47bbd2580e884cec40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:13.005460 8788 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet df30b9f793bf4232ba848f569100a747
I20251215 14:55:13.005877 8780 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet e9124dd3d98947b29289e0561976ada4
W20251215 14:55:13.006203 8785 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 042632f0dabd4a79a36a5f27bef12faa consensus state has no leader
I20251215 14:55:13.006572 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 05e70b4070b6437e9b934af4e6b93f6a
I20251215 14:55:13.006883 8784 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet ad2bead71c9a462bbd7888774c608ba9
I20251215 14:55:13.008795 8779 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 84477b0a4bd14522908cc28e7015e4f9
I20251215 14:55:13.015573 9435 raft_consensus.cc:385] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.015686 9435 raft_consensus.cc:740] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.016395 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 5dc81eb40614463cb5017475b378eea6 (table default.Table_76a8f78ec8a74aadaf69142df6990dc8 [id=94ddd629cb1e4f5eb0061100187f4202]) successfully deleted
W20251215 14:55:13.017021 8775 catalog_manager.cc:4952] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 84f036eb44a44e0597bc9af88d81a017 because the tablet was not found. No further retry: Not found: Tablet not found: 84f036eb44a44e0597bc9af88d81a017
I20251215 14:55:13.018903 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bfe8cc0805247de9df4a59d461818f3" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:13.019282 9040 raft_consensus.cc:2468] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:13.020411 9149 tablet_service.cc:1552] Processing DeleteTablet for tablet 396fe2752398427f840998609beba351 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:13.029672 9435 consensus_queue.cc:260] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.030294 9435 ts_tablet_manager.cc:1434] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.123s user 0.002s sys 0.000s
W20251215 14:55:13.031634 10152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
I20251215 14:55:13.031992 9435 tablet_bootstrap.cc:492] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:13.032141 10152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251215 14:55:13.032270 10152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20251215 14:55:13.033599 10272 raft_consensus.cc:493] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:13.033741 10272 raft_consensus.cc:515] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.035243 10272 leader_election.cc:290] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:13.035488 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b65b63ce3ec49f9a0d2d77d69a85fd7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:13.036106 9315 raft_consensus.cc:3060] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.034337 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0c88310853f47b0aa1af9a3d676bef6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:13.036725 9150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82575517299b4e69a0871714dde9aacc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:13.041062 10266 raft_consensus.cc:493] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:13.042186 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ae72a1ded6e4faba1ad309d9a0e4a95" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:13.045931 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 605da10c8d3049e8b94caa9738576aab (table default.Table_2e1e3e730bbb4364b0f1f86d7d89056a [id=1a10676eee8b47098cf45bee49e3f502], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 605da10c8d3049e8b94caa9738576aab consensus state has no leader
W20251215 14:55:13.046012 10152 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20251215 14:55:13.046772 10152 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
I20251215 14:55:13.046936 9310 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff4508c5a110427eb4d9d2eaaadace0b" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
W20251215 14:55:13.047091 10152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251215 14:55:13.047401 10152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251215 14:55:13.047562 10152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251215 14:55:13.047683 10152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251215 14:55:13.050098 9015 tablet_service.cc:1552] Processing DeleteTablet for tablet df30b9f793bf4232ba848f569100a747 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:13.050865 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet df30b9f793bf4232ba848f569100a747 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df30b9f793bf4232ba848f569100a747 already in progress: creating tablet
W20251215 14:55:13.057641 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b3ae2f8a28c4a47bbd2580e884cec40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.058034 9020 tablet_service.cc:1552] Processing DeleteTablet for tablet 84477b0a4bd14522908cc28e7015e4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:13.059860 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 90c0254840b442a3817171b06f2726c8
W20251215 14:55:13.060065 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 5560a21e16bb43c7903c1fc66429ecdf
W20251215 14:55:13.060096 9248 leader_election.cc:343] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:13.060133 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bfe8cc0805247de9df4a59d461818f3" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
W20251215 14:55:13.060890 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 84477b0a4bd14522908cc28e7015e4f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84477b0a4bd14522908cc28e7015e4f9 already in progress: creating tablet
I20251215 14:55:13.061616 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ae72a1ded6e4faba1ad309d9a0e4a95" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:13.065034 10152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.121.148:35915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.121.190:44279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.121.190
--webserver_port=40239
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type FASTDEBUG
built by None at 15 Dec 2025 14:43:20 UTC on 24a791456cd2
build id 9528
ASAN enabled
I20251215 14:55:13.065181 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet e9124dd3d98947b29289e0561976ada4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:13.065891 9020 tablet_service.cc:1552] Processing DeleteTablet for tablet ad2bead71c9a462bbd7888774c608ba9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:13.067304 10152 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251215 14:55:13.067341 9310 raft_consensus.cc:3060] T ff4508c5a110427eb4d9d2eaaadace0b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.067734 9311 raft_consensus.cc:2468] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:13.067945 9305 raft_consensus.cc:2468] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:13.068099 9971 consensus_queue.cc:1048] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20251215 14:55:13.068869 8780 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 605da10c8d3049e8b94caa9738576aab (table default.Table_2e1e3e730bbb4364b0f1f86d7d89056a [id=1a10676eee8b47098cf45bee49e3f502]). Expected version 2 got 0
W20251215 14:55:13.069830 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet e9124dd3d98947b29289e0561976ada4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9124dd3d98947b29289e0561976ada4 already in progress: creating tablet
W20251215 14:55:13.070102 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet ad2bead71c9a462bbd7888774c608ba9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad2bead71c9a462bbd7888774c608ba9 already in progress: creating tablet
I20251215 14:55:13.070098 9015 tablet_service.cc:1552] Processing DeleteTablet for tablet 05e70b4070b6437e9b934af4e6b93f6a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:13.070367 10141 tablet_replica.cc:333] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:13.070353 10152 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251215 14:55:13.070590 10141 raft_consensus.cc:2243] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:13.070961 10141 raft_consensus.cc:2272] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:13.072019 10141 ts_tablet_manager.cc:1916] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:13.080070 10141 ts_tablet_manager.cc:1929] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:13.080308 10141 log.cc:1199] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/05e70b4070b6437e9b934af4e6b93f6a
I20251215 14:55:13.080807 10141 ts_tablet_manager.cc:1950] T 05e70b4070b6437e9b934af4e6b93f6a P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:13.081966 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781]) successfully deleted
W20251215 14:55:13.088649 8780 catalog_manager.cc:5487] Ignoring report from unknown tablet 5560a21e16bb43c7903c1fc66429ecdf
W20251215 14:55:13.089869 10335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 14:55:13.094835 10269 raft_consensus.cc:493] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:13.095114 10269 raft_consensus.cc:515] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.096110 10269 leader_election.cc:290] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:13.097347 8780 catalog_manager.cc:5487] Ignoring report from unknown tablet f7af1f66c4f04f649379758ff1b3e387
W20251215 14:55:13.097345 10336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251215 14:55:13.097450 8780 catalog_manager.cc:5487] Ignoring report from unknown tablet 194bb745ecb849cb9092fee1afb7dbe6
W20251215 14:55:13.097506 8780 catalog_manager.cc:5487] Ignoring report from unknown tablet 5e80ac7bd98a46119a30bd5d2f3de2f9
W20251215 14:55:13.097587 8780 catalog_manager.cc:5487] Ignoring report from unknown tablet 82ca60c5a63744ffb0a0c0a140ef665e
I20251215 14:55:13.100327 9310 raft_consensus.cc:2468] T ff4508c5a110427eb4d9d2eaaadace0b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
W20251215 14:55:13.108858 10339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 14:55:13.056058 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0c88310853f47b0aa1af9a3d676bef6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:13.109691 9303 raft_consensus.cc:2468] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
W20251215 14:55:13.110579 9248 leader_election.cc:343] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:13.109454 10152 server_base.cc:1047] running on GCE node
I20251215 14:55:13.111680 9283 tablet_service.cc:1552] Processing DeleteTablet for tablet 35326e99d413431583b25d11269d09dc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:13.112090 10152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251215 14:55:13.113140 9435 tablet_bootstrap.cc:654] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:13.114511 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 48060us
I20251215 14:55:13.117551 10152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251215 14:55:13.121654 10152 hybrid_clock.cc:648] HybridClock initialized: now 1765810513121571 us; error 90 us; skew 500 ppm
I20251215 14:55:13.122418 10152 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 14:55:13.122694 9155 tablet_service.cc:1505] Processing CreateTablet for tablet 1dde4fcdf3104154936f70977e5378bd (DEFAULT_TABLE table=default.Table_2fa3900b9f0b4cb7a4d20f214f84369e [id=e67b0c10ec244372b1f79c35e7993555]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:13.124943 9157 tablet_service.cc:1505] Processing CreateTablet for tablet e6084ebf2a804bfc9d2c2cde3e0cba98 (DEFAULT_TABLE table=default.Table_71fb566bde204f5a9381ce697d4188a2 [id=aa5f00ae0cad4993adf993890f7e9372]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:13.127139 9315 raft_consensus.cc:2468] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:13.132820 9141 tablet_service.cc:1552] Processing DeleteTablet for tablet 84f036eb44a44e0597bc9af88d81a017 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:13.133074 9141 tablet_service.cc:1552] Processing DeleteTablet for tablet a723f46302f34465a214714e98e47de7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:13.133224 9141 tablet_service.cc:1552] Processing DeleteTablet for tablet 295325c4a2ca41caaabddbd96d4bce19 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:13.133419 9149 tablet_service.cc:1552] Processing DeleteTablet for tablet 35326e99d413431583b25d11269d09dc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:13.133632 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bfe8cc0805247de9df4a59d461818f3" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:13.134428 9427 tablet_bootstrap.cc:492] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:13.134640 9427 ts_tablet_manager.cc:1403] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.134s user 0.002s sys 0.004s
W20251215 14:55:13.138106 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 96b2d20fd2304e7a9995206a043b7944 (table default.Table_42e5c1011ba64c0b9602eed064c8ecbd [id=4343a6c3acc545d7be8d3b7ec617da90], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 96b2d20fd2304e7a9995206a043b7944 consensus state has no leader
W20251215 14:55:13.139511 8976 leader_election.cc:343] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:13.139752 8976 leader_election.cc:343] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:13.150557 9427 raft_consensus.cc:359] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.150972 9146 tablet_service.cc:1505] Processing CreateTablet for tablet 90c7925890474a76b35a3ce5e6db8ebf (DEFAULT_TABLE table=default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:13.150990 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605da10c8d3049e8b94caa9738576aab" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:13.151415 9427 raft_consensus.cc:385] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.151523 9427 raft_consensus.cc:740] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.151782 9427 consensus_queue.cc:260] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.152346 9427 ts_tablet_manager.cc:1434] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20251215 14:55:13.153100 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dde4fcdf3104154936f70977e5378bd. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:13.155238 8976 consensus_peers.cc:597] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:13.157469 9291 tablet_service.cc:1552] Processing DeleteTablet for tablet a723f46302f34465a214714e98e47de7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:13.156929 10266 raft_consensus.cc:515] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.161077 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6084ebf2a804bfc9d2c2cde3e0cba98. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:13.164433 9426 tablet_bootstrap.cc:654] T 2d75636265f14a428aae592438064ea2 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:13.165153 9170 raft_consensus.cc:2468] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:13.174418 9175 raft_consensus.cc:2468] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
W20251215 14:55:13.174940 8780 catalog_manager.cc:5487] Ignoring report from unknown tablet 5560a21e16bb43c7903c1fc66429ecdf
I20251215 14:55:13.183851 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_f0bf7f4e35d747908b76aee9f98a7a5a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.184564 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f0bf7f4e35d747908b76aee9f98a7a5a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.184793 9146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90c7925890474a76b35a3ce5e6db8ebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:13.185774 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_f898e8de467442898e4adb8820306601"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.186267 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f898e8de467442898e4adb8820306601 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.187350 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_1371ea4ec00049d0b1653642d8cccf63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.187881 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1371ea4ec00049d0b1653642d8cccf63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.189105 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ac906fad456547a58529672569b9bb2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.189611 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ac906fad456547a58529672569b9bb2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.190671 8781 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_aa885863620a4610ac00d0c8b0406b38" } new_table_name: "default.Table_882b905fdf18495b8a6044986590f470" modify_external_catalogs: true
I20251215 14:55:13.192862 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0c88310853f47b0aa1af9a3d676bef6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:13.193089 9042 raft_consensus.cc:2468] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:13.196751 8976 leader_election.cc:304] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:13.197053 10269 raft_consensus.cc:2804] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:13.197139 10269 raft_consensus.cc:493] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:13.197252 10269 raft_consensus.cc:3060] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.197736 10266 leader_election.cc:290] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:13.198899 8783 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ce00bfcd8c0b40fa8afa1518fece6bbe" } new_table_name: "default.Table_2f427312900a49008b3119b4008c5658" modify_external_catalogs: true
I20251215 14:55:13.199571 10019 consensus_queue.cc:1048] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20251215 14:55:13.199882 10269 raft_consensus.cc:515] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.200150 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_7f1131563cdd40e6a3e28615d4340538"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.200713 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7f1131563cdd40e6a3e28615d4340538 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.201743 10274 raft_consensus.cc:493] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:13.201901 10274 raft_consensus.cc:515] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.202050 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_66af3d0e5e85432cb28ab3db9b0fd01b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:13.202499 10274 leader_election.cc:290] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:13.202584 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66af3d0e5e85432cb28ab3db9b0fd01b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.202850 10269 leader_election.cc:290] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:13.204298 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_d7b6fa9c5de14f49bd548e60d9d1b4b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.204800 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7b6fa9c5de14f49bd548e60d9d1b4b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.205639 8782 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c543b8dc67f5414f8d8796af21b0f077" } new_table_name: "default.Table_0433e5253cac46ecbc41c52ec16dc574" modify_external_catalogs: true
I20251215 14:55:13.220408 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0c88310853f47b0aa1af9a3d676bef6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:13.220621 9175 raft_consensus.cc:3060] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.223037 9175 raft_consensus.cc:2468] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
W20251215 14:55:13.223181 8781 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 548e6d35016746e2b8f5184ee44071cb consensus state has no leader
I20251215 14:55:13.223228 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "90c0254840b442a3817171b06f2726c8" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:13.223662 8781 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_29d5bb2dae4a45a3b86f0e8f5b69dc0a" } new_table_name: "default.Table_8bca373710104ce89200ac1c18f9a622" modify_external_catalogs: true
W20251215 14:55:13.224740 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 65ea0509d8eb42bdb2291ff01e8d3bd6
I20251215 14:55:13.225139 8787 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c0657e638f4347278be5c502e7972828" } new_table_name: "default.Table_6c09c786139c45b7aafd6b42938df236" modify_external_catalogs: true
I20251215 14:55:13.225306 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_28b26a7c5358471e9bd8528c1380cdf3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.225814 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28b26a7c5358471e9bd8528c1380cdf3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.226488 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_200e2ab348de44b888070f1a12e8e30e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.226962 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_200e2ab348de44b888070f1a12e8e30e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:13.227552 8976 leader_election.cc:343] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:13.227900 8783 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 798eb606957b4cf7a737ec1636437581 consensus state has no leader
I20251215 14:55:13.229662 8976 leader_election.cc:304] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
W20251215 14:55:13.229735 8782 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 20f30d23a43f43749f6f9054a18a84a8 has no consensus state
I20251215 14:55:13.230055 10269 raft_consensus.cc:2804] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:13.230208 10269 raft_consensus.cc:697] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:13.230468 10269 consensus_queue.cc:237] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.238294 9248 leader_election.cc:304] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:13.238459 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0c88310853f47b0aa1af9a3d676bef6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:13.238618 10268 raft_consensus.cc:2804] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:13.238732 10268 raft_consensus.cc:493] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:13.238790 9971 raft_consensus.cc:493] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:13.238829 10268 raft_consensus.cc:3060] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.238937 9971 raft_consensus.cc:515] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.243108 9284 tablet_service.cc:1552] Processing DeleteTablet for tablet 295325c4a2ca41caaabddbd96d4bce19 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:13.241375 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet 396fe2752398427f840998609beba351 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:13.238724 9315 raft_consensus.cc:2468] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
W20251215 14:55:13.238711 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 121207us
I20251215 14:55:13.246387 9971 leader_election.cc:290] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:13.252945 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 65ea0509d8eb42bdb2291ff01e8d3bd6
I20251215 14:55:13.253605 8785 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_0b5550fc67b74b9e997ee17398719a8b" } modify_external_catalogs: true
I20251215 14:55:13.253818 8785 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_0b5550fc67b74b9e997ee17398719a8b" } modify_external_catalogs: true
I20251215 14:55:13.255280 8782 catalog_manager.cc:5654] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129). New cstate: current_term: 1 leader_uuid: "67978ac4539d4b289e53f4eedd9a8156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:13.255798 8782 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet e0c88310853f47b0aa1af9a3d676bef6 (table default.Table_6b689570cd944426b4edf8342163ef0e [id=d0891c1ad38b48348b350482a3298f39]). Expected version 1 got 0
I20251215 14:55:13.256537 9112 leader_election.cc:304] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:13.258260 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
I20251215 14:55:13.259681 8784 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f4b76ffdb5334ac2b6cd96375894f889" } modify_external_catalogs: true
I20251215 14:55:13.259833 8784 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f4b76ffdb5334ac2b6cd96375894f889" } modify_external_catalogs: true
I20251215 14:55:13.259910 10019 raft_consensus.cc:2764] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20251215 14:55:13.261857 9427 tablet_bootstrap.cc:492] T 82ca60c5a63744ffb0a0c0a140ef665e P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:13.262943 8783 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_8021aec3ccb641bca49fd8b5a35a2888" } modify_external_catalogs: true
W20251215 14:55:13.262964 9112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 62388.7us
I20251215 14:55:13.263126 8783 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_8021aec3ccb641bca49fd8b5a35a2888" } modify_external_catalogs: true
I20251215 14:55:13.271487 9427 tablet_bootstrap.cc:654] T 82ca60c5a63744ffb0a0c0a140ef665e P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:13.277571 8786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_72caf0a9fac64b729b0c5a76c38ad7d8" } modify_external_catalogs: true
I20251215 14:55:13.277843 8786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_72caf0a9fac64b729b0c5a76c38ad7d8" } modify_external_catalogs: true
I20251215 14:55:13.283253 10268 raft_consensus.cc:515] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.284056 10268 leader_election.cc:290] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:13.289721 10351 tablet.cc:1722] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:13.291204 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ae72a1ded6e4faba1ad309d9a0e4a95" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:13.291445 9042 raft_consensus.cc:2468] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:13.292021 10152 webserver.cc:492] Webserver started at http://127.8.121.190:40239/ using document root <none> and password file <none>
I20251215 14:55:13.293253 10152 fs_manager.cc:362] Metadata directory not provided
I20251215 14:55:13.293447 10152 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 14:55:13.296962 8978 leader_election.cc:304] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:13.297513 8978 leader_election.cc:304] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:13.298877 10274 raft_consensus.cc:2804] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:13.298975 10274 raft_consensus.cc:493] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:13.299091 10274 raft_consensus.cc:3060] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.301405 10274 raft_consensus.cc:515] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.301995 10274 leader_election.cc:290] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:13.297523 10289 raft_consensus.cc:2804] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:13.302558 10289 raft_consensus.cc:493] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:13.302630 10289 raft_consensus.cc:3060] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.304692 10289 raft_consensus.cc:515] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.305266 10289 leader_election.cc:290] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:13.305271 9427 tablet_bootstrap.cc:492] T 82ca60c5a63744ffb0a0c0a140ef665e P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:13.306121 9427 ts_tablet_manager.cc:1403] T 82ca60c5a63744ffb0a0c0a140ef665e P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.126s user 0.004s sys 0.000s
W20251215 14:55:13.306617 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 35326e99d413431583b25d11269d09dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35326e99d413431583b25d11269d09dc already in progress: creating tablet
I20251215 14:55:13.306653 8978 leader_election.cc:304] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:13.307315 8978 leader_election.cc:304] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
W20251215 14:55:13.307366 8775 catalog_manager.cc:4952] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet a723f46302f34465a214714e98e47de7 because the tablet was not found. No further retry: Not found: Tablet not found: a723f46302f34465a214714e98e47de7
I20251215 14:55:13.307667 10269 raft_consensus.cc:2804] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:13.307780 10269 raft_consensus.cc:697] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:13.307888 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet ad2bead71c9a462bbd7888774c608ba9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:13.308077 10269 consensus_queue.cc:237] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.308763 9427 raft_consensus.cc:359] T 82ca60c5a63744ffb0a0c0a140ef665e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.308923 9427 raft_consensus.cc:385] T 82ca60c5a63744ffb0a0c0a140ef665e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.309005 9427 raft_consensus.cc:740] T 82ca60c5a63744ffb0a0c0a140ef665e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.309181 9427 consensus_queue.cc:260] T 82ca60c5a63744ffb0a0c0a140ef665e P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.309355 10289 raft_consensus.cc:2804] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:13.309728 9427 ts_tablet_manager.cc:1434] T 82ca60c5a63744ffb0a0c0a140ef665e P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20251215 14:55:13.309859 10289 raft_consensus.cc:697] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:13.310034 9427 tablet_bootstrap.cc:492] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:13.310165 10289 consensus_queue.cc:237] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.316303 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 84477b0a4bd14522908cc28e7015e4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:13.316991 9427 tablet_bootstrap.cc:654] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:13.318199 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet 05e70b4070b6437e9b934af4e6b93f6a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:13.318476 9944 tablet_replica.cc:333] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:13.318691 9944 raft_consensus.cc:2243] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:13.318874 9944 raft_consensus.cc:2272] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:13.319873 9944 ts_tablet_manager.cc:1916] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:13.322407 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ae72a1ded6e4faba1ad309d9a0e4a95" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:13.323007 8976 leader_election.cc:343] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:13.324690 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bfe8cc0805247de9df4a59d461818f3" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:13.325131 8976 leader_election.cc:343] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:13.326231 9944 ts_tablet_manager.cc:1929] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:13.326450 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet df30b9f793bf4232ba848f569100a747 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:13.330265 9427 tablet_bootstrap.cc:492] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:13.330830 9427 ts_tablet_manager.cc:1403] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.002s
I20251215 14:55:13.332135 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet e9124dd3d98947b29289e0561976ada4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:13.332476 9427 raft_consensus.cc:359] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.332698 9427 raft_consensus.cc:385] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.332774 9427 raft_consensus.cc:740] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.333030 9427 consensus_queue.cc:260] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.333191 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d75636265f14a428aae592438064ea2" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:13.333531 9427 ts_tablet_manager.cc:1434] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:13.333851 9427 tablet_bootstrap.cc:492] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:13.336097 10152 fs_manager.cc:714] Time spent opening directory manager: real 0.040s user 0.003s sys 0.001s
W20251215 14:55:13.339320 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 396fe2752398427f840998609beba351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 396fe2752398427f840998609beba351 already in progress: creating tablet
I20251215 14:55:13.339663 9249 leader_election.cc:304] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
W20251215 14:55:13.339890 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 84f036eb44a44e0597bc9af88d81a017 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84f036eb44a44e0597bc9af88d81a017 already in progress: creating tablet
W20251215 14:55:13.340080 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet a723f46302f34465a214714e98e47de7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a723f46302f34465a214714e98e47de7 already in progress: creating tablet
W20251215 14:55:13.340281 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 295325c4a2ca41caaabddbd96d4bce19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 295325c4a2ca41caaabddbd96d4bce19 already in progress: creating tablet
W20251215 14:55:13.340473 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 35326e99d413431583b25d11269d09dc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 35326e99d413431583b25d11269d09dc already in progress: creating tablet
I20251215 14:55:13.341641 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ae72a1ded6e4faba1ad309d9a0e4a95" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:13.342141 10345 raft_consensus.cc:2804] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:13.342309 10345 raft_consensus.cc:697] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:13.345280 10272 consensus_queue.cc:1048] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:13.346192 10144 consensus_queue.cc:1048] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:13.346216 9249 leader_election.cc:343] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:13.347669 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bfe8cc0805247de9df4a59d461818f3" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:13.348865 10345 consensus_queue.cc:237] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.351964 10323 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:13.352119 10323 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.352326 9427 tablet_bootstrap.cc:654] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:13.353179 9426 tablet_bootstrap.cc:492] T 2d75636265f14a428aae592438064ea2 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:13.354949 10269 raft_consensus.cc:493] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:13.355208 10269 raft_consensus.cc:515] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.355568 9426 ts_tablet_manager.cc:1403] T 2d75636265f14a428aae592438064ea2 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.648s user 0.013s sys 0.013s
I20251215 14:55:13.356407 10269 leader_election.cc:290] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:13.357043 10364 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20251215 14:55:13.357524 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:55:13.357698 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:55:13.357975 9176 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77780f8cfe544db7baee2c761fe52ca2" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:13.358521 8976 leader_election.cc:343] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:13.360160 9427 tablet_bootstrap.cc:492] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:13.362478 9147 tablet_service.cc:1552] Processing DeleteTablet for tablet e9124dd3d98947b29289e0561976ada4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:13.363384 9249 leader_election.cc:343] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:13.363709 9249 leader_election.cc:343] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:13.364288 10152 fs_manager.cc:730] Time spent opening block manager: real 0.014s user 0.002s sys 0.000s
I20251215 14:55:13.365190 9144 tablet_service.cc:1552] Processing DeleteTablet for tablet 05e70b4070b6437e9b934af4e6b93f6a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:13.365545 10351 tablet.cc:1722] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20251215 14:55:13.366609 9435 tablet_bootstrap.cc:492] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:13.366822 9435 ts_tablet_manager.cc:1403] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.336s user 0.003s sys 0.016s
I20251215 14:55:13.367709 9435 raft_consensus.cc:359] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.368016 9435 raft_consensus.cc:385] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251215 14:55:13.368103 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:13.353395 10323 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:13.368260 9435 raft_consensus.cc:740] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.368739 9435 consensus_queue.cc:260] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.368901 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:13.369181 10323 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:13.369796 9142 tablet_service.cc:1552] Processing DeleteTablet for tablet df30b9f793bf4232ba848f569100a747 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:13.362310 9427 ts_tablet_manager.cc:1403] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.004s
W20251215 14:55:13.371438 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 295325c4a2ca41caaabddbd96d4bce19 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 295325c4a2ca41caaabddbd96d4bce19 already in progress: creating tablet
W20251215 14:55:13.371708 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 396fe2752398427f840998609beba351 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 396fe2752398427f840998609beba351 already in progress: creating tablet
W20251215 14:55:13.372253 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet ad2bead71c9a462bbd7888774c608ba9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad2bead71c9a462bbd7888774c608ba9 already in progress: creating tablet
I20251215 14:55:13.372236 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bfe8cc0805247de9df4a59d461818f3" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
W20251215 14:55:13.372450 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 84477b0a4bd14522908cc28e7015e4f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84477b0a4bd14522908cc28e7015e4f9 already in progress: creating tablet
I20251215 14:55:13.372486 9041 raft_consensus.cc:2393] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:13.373394 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d75636265f14a428aae592438064ea2" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:13.373600 9038 raft_consensus.cc:2468] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:13.374436 9427 raft_consensus.cc:359] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.364491 10152 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data,/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
uuid: "cad1fca07ac7419cb608c21541f672f3"
format_stamp: "Formatted at 2025-12-15 14:54:58 on dist-test-slave-z089"
I20251215 14:55:13.379393 9427 raft_consensus.cc:385] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.379813 9427 raft_consensus.cc:740] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.380251 9427 consensus_queue.cc:260] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.380627 9157 tablet_service.cc:1552] Processing DeleteTablet for tablet ad2bead71c9a462bbd7888774c608ba9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:13.380693 10152 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 14:55:13.381623 9155 tablet_service.cc:1552] Processing DeleteTablet for tablet 84477b0a4bd14522908cc28e7015e4f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:13.369403 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "605da10c8d3049e8b94caa9738576aab" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:13.370820 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bfe8cc0805247de9df4a59d461818f3" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:13.370913 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ae72a1ded6e4faba1ad309d9a0e4a95" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:13.383997 9305 raft_consensus.cc:3060] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.384001 9308 raft_consensus.cc:2393] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:13.385504 9435 ts_tablet_manager.cc:1434] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20251215 14:55:13.385824 9435 tablet_bootstrap.cc:492] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:13.387535 9435 tablet_bootstrap.cc:654] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:13.388337 9427 ts_tablet_manager.cc:1434] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20251215 14:55:13.388682 9427 tablet_bootstrap.cc:492] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:13.389182 9305 raft_consensus.cc:2468] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:13.374869 9944 log.cc:1199] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/05e70b4070b6437e9b934af4e6b93f6a
I20251215 14:55:13.380192 10272 consensus_queue.cc:1048] T 9bf4a899338f4bcfac099b5099a22f05 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:13.394991 10323 consensus_queue.cc:1048] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 14:55:13.395377 9944 ts_tablet_manager.cc:1950] T 05e70b4070b6437e9b934af4e6b93f6a P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:13.380623 9248 leader_election.cc:304] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:13.372713 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0c88310853f47b0aa1af9a3d676bef6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:13.396126 8780 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_3f190fdaff1446908955f4b5957a8084 [id=cbafb4499c90447d8f185928d3e58b20]). Expected version 1 got 0
I20251215 14:55:13.396201 9303 raft_consensus.cc:3060] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.396266 10272 raft_consensus.cc:2764] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20251215 14:55:13.396315 8780 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1]). Expected version 1 got 0
I20251215 14:55:13.398161 8780 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ab3da14c1f8c4acc8c3123098dfe3a00" } modify_external_catalogs: true
I20251215 14:55:13.398313 8780 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ab3da14c1f8c4acc8c3123098dfe3a00" } modify_external_catalogs: true
I20251215 14:55:13.398998 9303 raft_consensus.cc:2468] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
W20251215 14:55:13.403059 8683 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 44352.7us
I20251215 14:55:13.403818 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "90c0254840b442a3817171b06f2726c8" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:13.404011 9314 raft_consensus.cc:2468] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
W20251215 14:55:13.407908 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet e9124dd3d98947b29289e0561976ada4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9124dd3d98947b29289e0561976ada4 already in progress: creating tablet
I20251215 14:55:13.407953 10345 consensus_queue.cc:1048] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:13.408883 9248 leader_election.cc:304] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:13.409253 9943 tablet_replica.cc:333] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:13.409451 10345 raft_consensus.cc:2749] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:13.409471 9943 raft_consensus.cc:2243] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:13.409745 9943 raft_consensus.cc:2272] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:13.410466 9943 ts_tablet_manager.cc:1916] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:13.411073 9248 leader_election.cc:304] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:13.411340 10345 raft_consensus.cc:2804] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:13.411439 10345 raft_consensus.cc:493] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:13.411520 10345 raft_consensus.cc:3060] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.414064 10345 raft_consensus.cc:515] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.414932 10345 leader_election.cc:290] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:13.414846 9426 raft_consensus.cc:359] T 2d75636265f14a428aae592438064ea2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.415385 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d75636265f14a428aae592438064ea2" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:13.415678 8978 leader_election.cc:343] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2
I20251215 14:55:13.415833 8978 leader_election.cc:304] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:13.417001 9426 raft_consensus.cc:385] T 2d75636265f14a428aae592438064ea2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.416872 10269 raft_consensus.cc:2749] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:13.417249 8978 leader_election.cc:304] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:13.417383 10357 consensus_queue.cc:1048] T 30c5c795ea4a4fe591cdf63320ec2521 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:13.417520 10274 raft_consensus.cc:2749] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:13.417824 8978 leader_election.cc:304] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:13.418213 10357 raft_consensus.cc:2749] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:13.418465 9426 raft_consensus.cc:740] T 2d75636265f14a428aae592438064ea2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.418751 9426 consensus_queue.cc:260] T 2d75636265f14a428aae592438064ea2 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.419107 8978 leader_election.cc:304] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:13.419504 10357 raft_consensus.cc:2804] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:13.419598 9426 ts_tablet_manager.cc:1434] T 2d75636265f14a428aae592438064ea2 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.064s user 0.002s sys 0.000s
I20251215 14:55:13.419770 10357 raft_consensus.cc:697] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:13.419935 9426 tablet_bootstrap.cc:492] T 30c5c795ea4a4fe591cdf63320ec2521 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:13.420079 10357 consensus_queue.cc:237] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:13.421720 8781 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b4a856793e8b46cfb42110de5d383ff7 consensus state has no leader
I20251215 14:55:13.422111 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_e721697e900b48b6b27e0abb6c829ff8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.422363 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet f830b4af355e480bbe75d6060585529e
I20251215 14:55:13.422567 9426 tablet_bootstrap.cc:654] T 30c5c795ea4a4fe591cdf63320ec2521 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:13.422642 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e721697e900b48b6b27e0abb6c829ff8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.425699 9171 raft_consensus.cc:3060] T 2d75636265f14a428aae592438064ea2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:13.423563 8787 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d88741012a814d41ac074e86805f492d consensus state has no leader
I20251215 14:55:13.433743 9427 tablet_bootstrap.cc:654] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:13.433804 8787 master_service.cc:954] ReplaceTablet: received request to replace tablet d09d7ce93d074bfaa830130b31bcc594 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:13.434041 8978 leader_election.cc:304] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:13.434480 10274 raft_consensus.cc:2804] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:13.434572 10274 raft_consensus.cc:493] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:13.434665 10274 raft_consensus.cc:3060] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.423720 8785 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 2b54d7dcdcc94e58b039b9f231f38d11
I20251215 14:55:13.435811 8785 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_200e2ab348de44b888070f1a12e8e30e" } new_table_name: "default.Table_4d5258590238424887a68af4bb147a93" modify_external_catalogs: true
I20251215 14:55:13.423146 8788 catalog_manager.cc:5654] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e89303a500544272b601d7c29be802b4 (127.8.121.131). New cstate: current_term: 1 leader_uuid: "e89303a500544272b601d7c29be802b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: HEALTHY } } }
I20251215 14:55:13.437147 10274 raft_consensus.cc:515] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.437387 8788 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 605da10c8d3049e8b94caa9738576aab (table default.Table_2e1e3e730bbb4364b0f1f86d7d89056a [id=1a10676eee8b47098cf45bee49e3f502]). Expected version 2 got 0
I20251215 14:55:13.438177 10274 leader_election.cc:290] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:13.438395 9015 tablet_service.cc:1552] Processing DeleteTablet for tablet 2b54d7dcdcc94e58b039b9f231f38d11 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:13 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:13.423744 8782 master_service.cc:954] ReplaceTablet: received request to replace tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 from {username='slave'} at 127.0.0.1:49790
W20251215 14:55:13.439132 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 2b54d7dcdcc94e58b039b9f231f38d11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b54d7dcdcc94e58b039b9f231f38d11 already in progress: creating tablet
I20251215 14:55:13.423869 8784 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 404cb1888ca2402ab7a41d0d5efeacd8
I20251215 14:55:13.439865 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_09a33207f66546398b5669c9294fa726"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.440412 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09a33207f66546398b5669c9294fa726 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.423938 8783 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet f0e8dad82b3e4eff971b7b6845970c4f
I20251215 14:55:13.443271 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_b9318dc67efb49bea8513a106539137a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.443830 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9318dc67efb49bea8513a106539137a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.444054 9435 tablet_bootstrap.cc:492] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:13.444216 9435 ts_tablet_manager.cc:1403] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.058s user 0.003s sys 0.000s
I20251215 14:55:13.423980 8786 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet be2852f63bbe441a98971657cdf1d522
I20251215 14:55:13.445322 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_2b278e1d2cf048e9ae8f76002a70b7b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:13.423322 8779 master_service.cc:954] ReplaceTablet: received request to replace tablet ce0154b24522401b9cc0e37fa502532f from {username='slave'} at 127.0.0.1:49790
W20251215 14:55:13.445864 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2b278e1d2cf048e9ae8f76002a70b7b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.446095 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_e3c47d33c0ce4867b5237b931499b82b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.446543 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3c47d33c0ce4867b5237b931499b82b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.447616 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781]) successfully deleted
W20251215 14:55:13.447896 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet df30b9f793bf4232ba848f569100a747 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df30b9f793bf4232ba848f569100a747 already in progress: creating tablet
W20251215 14:55:13.448135 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet e9124dd3d98947b29289e0561976ada4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9124dd3d98947b29289e0561976ada4 already in progress: creating tablet
I20251215 14:55:13.449090 9020 tablet_service.cc:1552] Processing DeleteTablet for tablet f0e8dad82b3e4eff971b7b6845970c4f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:13 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:13.449391 9015 tablet_service.cc:1552] Processing DeleteTablet for tablet 404cb1888ca2402ab7a41d0d5efeacd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:13 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:13.451228 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet f0e8dad82b3e4eff971b7b6845970c4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0e8dad82b3e4eff971b7b6845970c4f already in progress: creating tablet
W20251215 14:55:13.451478 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 404cb1888ca2402ab7a41d0d5efeacd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 404cb1888ca2402ab7a41d0d5efeacd8 already in progress: creating tablet
I20251215 14:55:13.452404 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d75636265f14a428aae592438064ea2" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:13.452610 9034 raft_consensus.cc:3060] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.454712 8780 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 9fc1e8f74b6c475cb02d6285978fd853
I20251215 14:55:13.455519 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "90c0254840b442a3817171b06f2726c8" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:13.456491 8780 catalog_manager.cc:5487] Ignoring report from unknown tablet 5560a21e16bb43c7903c1fc66429ecdf
I20251215 14:55:13.456413 9171 raft_consensus.cc:2468] T 2d75636265f14a428aae592438064ea2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:13.460171 9034 raft_consensus.cc:2468] T 2d75636265f14a428aae592438064ea2 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:13.460460 9435 raft_consensus.cc:359] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.460676 9435 raft_consensus.cc:385] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.460745 9435 raft_consensus.cc:740] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.460949 9435 consensus_queue.cc:260] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:13.461114 8976 leader_election.cc:343] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:13.461580 9435 ts_tablet_manager.cc:1434] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20251215 14:55:13.464382 9435 tablet_bootstrap.cc:492] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:13.468019 8785 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 02e391ec04cf44c881f31d0ba53af2e9 has no consensus state
I20251215 14:55:13.468609 8785 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_3f190fdaff1446908955f4b5957a8084" } new_table_name: "default.Table_1d7a2033401a4156ba066d374364e61f" modify_external_catalogs: true
I20251215 14:55:13.471406 8782 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 2ea4fbf5ff164c90b5b8f6dab05b9764
I20251215 14:55:13.471463 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet d09d7ce93d074bfaa830130b31bcc594
I20251215 14:55:13.471908 8782 catalog_manager.cc:6724] ReplaceTablet: tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 deleted and replaced by tablet 95b78c1518f1481794948f2db1055f38
I20251215 14:55:13.471982 8787 catalog_manager.cc:6724] ReplaceTablet: tablet d09d7ce93d074bfaa830130b31bcc594 deleted and replaced by tablet fa73a61ff5be4cd2b590d72763bf7c5d
I20251215 14:55:13.475956 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_dc44be4119b34298afe34d3e9bde7a23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.476613 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc44be4119b34298afe34d3e9bde7a23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.478029 8781 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_37a4070d85974aa6a6cc25f78196a7c7" } new_table_name: "default.Table_4ba7459ea1c0439bad879f6514a8b032" modify_external_catalogs: true
I20251215 14:55:13.480350 9020 tablet_service.cc:1552] Processing DeleteTablet for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 with delete_type TABLET_DATA_DELETED (replaced by tablet 95b78c1518f1481794948f2db1055f38) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:13.480607 9015 tablet_service.cc:1552] Processing DeleteTablet for tablet d09d7ce93d074bfaa830130b31bcc594 with delete_type TABLET_DATA_DELETED (replaced by tablet fa73a61ff5be4cd2b590d72763bf7c5d) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:13.480845 10141 tablet_replica.cc:333] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:13.481067 10141 raft_consensus.cc:2243] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:13.481271 10141 raft_consensus.cc:2272] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:13.481211 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_aeb325b8434f4db1a2a44761b1df1e6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.481761 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aeb325b8434f4db1a2a44761b1df1e6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.481796 9435 tablet_bootstrap.cc:654] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:13.481866 10141 ts_tablet_manager.cc:1916] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:13.483840 8783 master_service.cc:954] ReplaceTablet: received request to replace tablet 14ac26b3a02449f8a7588151abe7ae10 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:13.484335 8780 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet bb3b95d32c7044bd8a4451381c19aeba (table default.Table_3194032074824e83a1f02ad85fbba951 [id=7ec65d77d89d4e40a60b716f721e2940]). Expected version 5 got 0
I20251215 14:55:13.490705 10141 ts_tablet_manager.cc:1929] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251215 14:55:13.491089 10141 log.cc:1199] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/2ea4fbf5ff164c90b5b8f6dab05b9764
I20251215 14:55:13.491932 10141 ts_tablet_manager.cc:1950] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:13.493920 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 (table default.Table_d906d0f5a04a4c73bb02b6621abb99db [id=50a94314f5ba46e3a75b5a15e7362299]) successfully deleted
W20251215 14:55:13.497738 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet d09d7ce93d074bfaa830130b31bcc594 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d09d7ce93d074bfaa830130b31bcc594 already in progress: creating tablet
I20251215 14:55:13.505096 10375 tablet.cc:1722] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20251215 14:55:13.505640 8788 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_3194032074824e83a1f02ad85fbba951 [id=7ec65d77d89d4e40a60b716f721e2940] alter complete (version 5)
W20251215 14:55:13.506137 8781 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf6e4aa94f79403588dd1916226660fd consensus state has no leader
W20251215 14:55:13.509019 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 6ae72a1ded6e4faba1ad309d9a0e4a95
I20251215 14:55:13.497336 9248 leader_election.cc:304] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:13.516750 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 38e50a7f2bdd4907ab41436b59397ea6
W20251215 14:55:13.516961 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 56816add0a61454c9980ad09f5815b09
W20251215 14:55:13.517060 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 3c6cfff573434fbcb18feaf6a8e6a153
W20251215 14:55:13.517174 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7
W20251215 14:55:13.517267 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 82ca60c5a63744ffb0a0c0a140ef665e
W20251215 14:55:13.517385 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet ff4508c5a110427eb4d9d2eaaadace0b
W20251215 14:55:13.517509 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 194bb745ecb849cb9092fee1afb7dbe6
I20251215 14:55:13.517954 8782 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet bb3b95d32c7044bd8a4451381c19aeba (table default.Table_3194032074824e83a1f02ad85fbba951 [id=7ec65d77d89d4e40a60b716f721e2940]). Expected version 5 got 0
I20251215 14:55:13.518231 8782 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_1d7a2033401a4156ba066d374364e61f [id=cbafb4499c90447d8f185928d3e58b20]). Expected version 2 got 0
W20251215 14:55:13.512004 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 5dd36ea0aa53460f9c1fda4b31063fa7
I20251215 14:55:13.519418 10345 raft_consensus.cc:2804] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:13.519636 8787 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_1d7a2033401a4156ba066d374364e61f [id=cbafb4499c90447d8f185928d3e58b20]). Expected version 2 got 0
I20251215 14:55:13.520596 10345 raft_consensus.cc:697] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:13.520993 10345 consensus_queue.cc:237] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.501199 9435 tablet_bootstrap.cc:492] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:13.522244 9435 ts_tablet_manager.cc:1403] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.058s user 0.004s sys 0.000s
I20251215 14:55:13.523589 9435 raft_consensus.cc:359] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.523927 9435 raft_consensus.cc:385] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.524114 9435 raft_consensus.cc:740] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.525406 9943 ts_tablet_manager.cc:1929] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:13.525535 9943 log.cc:1199] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/05e70b4070b6437e9b934af4e6b93f6a
I20251215 14:55:13.526595 9943 ts_tablet_manager.cc:1950] T 05e70b4070b6437e9b934af4e6b93f6a P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:13.526859 9427 tablet_bootstrap.cc:492] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:13.527093 9427 ts_tablet_manager.cc:1403] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.138s user 0.001s sys 0.005s
I20251215 14:55:13.527938 9427 raft_consensus.cc:359] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.528193 9427 raft_consensus.cc:385] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.528317 9427 raft_consensus.cc:740] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.529392 9427 consensus_queue.cc:260] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.530048 9427 ts_tablet_manager.cc:1434] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:13.532155 9427 tablet_bootstrap.cc:492] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:13.535585 9427 tablet_bootstrap.cc:654] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:13.540175 9146 tablet_service.cc:1552] Processing DeleteTablet for tablet 2b54d7dcdcc94e58b039b9f231f38d11 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:13 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:13.540378 9157 tablet_service.cc:1552] Processing DeleteTablet for tablet f0e8dad82b3e4eff971b7b6845970c4f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:13 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:13.540509 9155 tablet_service.cc:1552] Processing DeleteTablet for tablet 404cb1888ca2402ab7a41d0d5efeacd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:13 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:13.541152 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet 2b54d7dcdcc94e58b039b9f231f38d11 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:13 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:13.541656 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet 404cb1888ca2402ab7a41d0d5efeacd8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:13 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:13.542069 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet f0e8dad82b3e4eff971b7b6845970c4f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:13 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:13.542522 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 with delete_type TABLET_DATA_DELETED (replaced by tablet 95b78c1518f1481794948f2db1055f38) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:13.543067 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet d09d7ce93d074bfaa830130b31bcc594 with delete_type TABLET_DATA_DELETED (replaced by tablet fa73a61ff5be4cd2b590d72763bf7c5d) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:13.543530 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 5e80ac7bd98a46119a30bd5d2f3de2f9
W20251215 14:55:13.543673 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bf4a899338f4bcfac099b5099a22f05
I20251215 14:55:13.544723 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "90c0254840b442a3817171b06f2726c8" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:13.544898 9314 raft_consensus.cc:3060] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.545495 9944 tablet_replica.cc:333] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:13.545783 9944 raft_consensus.cc:2243] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:13.524940 9435 consensus_queue.cc:260] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.546164 9944 raft_consensus.cc:2272] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:13.546429 8787 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet a639396098a941249afd9c3560073131 (table default.Table_404807c380fa4483ac5e0545eb3028cd [id=5cc820ec2c8b427db1c89647b295363e]). Expected version 1 got 0
I20251215 14:55:13.547031 9944 ts_tablet_manager.cc:1916] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:13.548002 9314 raft_consensus.cc:2468] T 90c0254840b442a3817171b06f2726c8 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
W20251215 14:55:13.554196 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 5dd36ea0aa53460f9c1fda4b31063fa7
W20251215 14:55:13.557236 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 2b54d7dcdcc94e58b039b9f231f38d11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b54d7dcdcc94e58b039b9f231f38d11 already in progress: creating tablet
W20251215 14:55:13.558368 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 404cb1888ca2402ab7a41d0d5efeacd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 404cb1888ca2402ab7a41d0d5efeacd8 already in progress: creating tablet
I20251215 14:55:13.559499 8787 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_1d7a2033401a4156ba066d374364e61f [id=cbafb4499c90447d8f185928d3e58b20]). Expected version 2 got 0
I20251215 14:55:13.560756 9435 ts_tablet_manager.cc:1434] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.038s user 0.002s sys 0.000s
I20251215 14:55:13.561124 9435 tablet_bootstrap.cc:492] T 3c6cfff573434fbcb18feaf6a8e6a153 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:13.561260 9426 tablet_bootstrap.cc:492] T 30c5c795ea4a4fe591cdf63320ec2521 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:13.564584 9435 tablet_bootstrap.cc:654] T 3c6cfff573434fbcb18feaf6a8e6a153 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:13.565344 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 2d75636265f14a428aae592438064ea2
I20251215 14:55:13.568219 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781]) successfully deleted
W20251215 14:55:13.568814 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet df30b9f793bf4232ba848f569100a747 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df30b9f793bf4232ba848f569100a747 already in progress: creating tablet
W20251215 14:55:13.569271 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet ad2bead71c9a462bbd7888774c608ba9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ad2bead71c9a462bbd7888774c608ba9 already in progress: creating tablet
W20251215 14:55:13.569955 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 84477b0a4bd14522908cc28e7015e4f9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 84477b0a4bd14522908cc28e7015e4f9 already in progress: creating tablet
W20251215 14:55:13.570343 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 2b54d7dcdcc94e58b039b9f231f38d11 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b54d7dcdcc94e58b039b9f231f38d11 already in progress: creating tablet
W20251215 14:55:13.570861 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet f0e8dad82b3e4eff971b7b6845970c4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0e8dad82b3e4eff971b7b6845970c4f already in progress: creating tablet
W20251215 14:55:13.571501 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 404cb1888ca2402ab7a41d0d5efeacd8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 404cb1888ca2402ab7a41d0d5efeacd8 already in progress: creating tablet
I20251215 14:55:13.574395 9155 tablet_service.cc:1552] Processing DeleteTablet for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 with delete_type TABLET_DATA_DELETED (replaced by tablet 95b78c1518f1481794948f2db1055f38) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:13.575584 9157 tablet_service.cc:1552] Processing DeleteTablet for tablet d09d7ce93d074bfaa830130b31bcc594 with delete_type TABLET_DATA_DELETED (replaced by tablet fa73a61ff5be4cd2b590d72763bf7c5d) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:13.577122 9943 tablet_replica.cc:333] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:13.578469 9943 raft_consensus.cc:2243] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:13.578689 9943 raft_consensus.cc:2272] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:13.581408 8782 master_service.cc:954] ReplaceTablet: received request to replace tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:13.586221 9426 ts_tablet_manager.cc:1403] T 30c5c795ea4a4fe591cdf63320ec2521 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.144s user 0.003s sys 0.023s
I20251215 14:55:13.587761 10375 tablet.cc:1722] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:13.588107 9943 ts_tablet_manager.cc:1916] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:13.589504 9426 raft_consensus.cc:359] T 30c5c795ea4a4fe591cdf63320ec2521 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.595980 9427 tablet_bootstrap.cc:492] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:13.596189 9427 ts_tablet_manager.cc:1403] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.001s
I20251215 14:55:13.596943 10367 tablet.cc:1722] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20251215 14:55:13.597127 9427 raft_consensus.cc:359] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.597364 9427 raft_consensus.cc:385] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.597515 9427 raft_consensus.cc:740] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.597817 9427 consensus_queue.cc:260] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.599579 9427 ts_tablet_manager.cc:1434] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:13.599635 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_52a6dc1585e14a438b227b8a04e0dc72"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:13.600958 9427 tablet_bootstrap.cc:492] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:13.600683 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_52a6dc1585e14a438b227b8a04e0dc72 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:13.602236 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet f0e8dad82b3e4eff971b7b6845970c4f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f0e8dad82b3e4eff971b7b6845970c4f already in progress: creating tablet
I20251215 14:55:13.601994 8978 leader_election.cc:304] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:13.607841 10289 raft_consensus.cc:2804] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:13.608131 10289 raft_consensus.cc:697] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:13.608414 10289 consensus_queue.cc:237] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.612661 9427 tablet_bootstrap.cc:654] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:13.604628 9426 raft_consensus.cc:385] T 30c5c795ea4a4fe591cdf63320ec2521 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.613446 9426 raft_consensus.cc:740] T 30c5c795ea4a4fe591cdf63320ec2521 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.616983 10375 tablet.cc:1717] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156: Skipping requested alter to schema version 5, tablet already version 5
I20251215 14:55:13.617216 9943 ts_tablet_manager.cc:1929] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251215 14:55:13.626194 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_e585b5bc1c5d43b8bb68ab45f52a146f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.626856 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e585b5bc1c5d43b8bb68ab45f52a146f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.629837 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_711ea57ef62e434a9a6041639e2826b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.630419 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_711ea57ef62e434a9a6041639e2826b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.630861 10152 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 14:55:13.630991 8788 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_07de59922021486886fb112cbc06c493" } new_table_name: "default.Table_5227b3b62b1843ea9a43fecb24c0fd07" modify_external_catalogs: true
I20251215 14:55:13.632472 10152 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251215 14:55:13.632879 10152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 14:55:13.624221 9426 consensus_queue.cc:260] T 30c5c795ea4a4fe591cdf63320ec2521 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.636438 8781 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_2e2c247d317f40768e0fdafb990b1266" } new_table_name: "default.Table_c15fd87a1803401cad889d57d9c16a47" modify_external_catalogs: true
I20251215 14:55:13.636171 9943 log.cc:1199] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/2ea4fbf5ff164c90b5b8f6dab05b9764
I20251215 14:55:13.637168 10351 tablet.cc:1717] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4: Skipping requested alter to schema version 5, tablet already version 5
I20251215 14:55:13.651417 9042 raft_consensus.cc:3060] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.653986 8783 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_2a1b8255b8b348e7b88eacbd41d5231a" } modify_external_catalogs: true
I20251215 14:55:13.654300 8784 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_b9318dc67efb49bea8513a106539137a" } modify_external_catalogs: true
I20251215 14:55:13.654345 8780 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ac2ccf4d3e5b44de808a7a4108394f9c" } modify_external_catalogs: true
I20251215 14:55:13.654453 9042 raft_consensus.cc:1275] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Refusing update from remote peer e89303a500544272b601d7c29be802b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 14:55:13.654639 8786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e073cd03acc04d7bbf396abc459c8049" } modify_external_catalogs: true
I20251215 14:55:13.657954 8779 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_5a1f6846c5344a53b59844dbc4f6a24f" } modify_external_catalogs: true
I20251215 14:55:13.666586 9971 consensus_queue.cc:1048] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:13.669409 10351 tablet.cc:1722] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:13.693146 9944 ts_tablet_manager.cc:1929] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251215 14:55:13.693836 9944 log.cc:1199] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/2ea4fbf5ff164c90b5b8f6dab05b9764
I20251215 14:55:13.703153 9944 ts_tablet_manager.cc:1950] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:13.718842 9426 ts_tablet_manager.cc:1434] T 30c5c795ea4a4fe591cdf63320ec2521 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.132s user 0.002s sys 0.001s
I20251215 14:55:13.723999 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 (table default.Table_d906d0f5a04a4c73bb02b6621abb99db [id=50a94314f5ba46e3a75b5a15e7362299]) successfully deleted
I20251215 14:55:13.728221 9943 ts_tablet_manager.cc:1950] T 2ea4fbf5ff164c90b5b8f6dab05b9764 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:13.729502 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 (table default.Table_d906d0f5a04a4c73bb02b6621abb99db [id=50a94314f5ba46e3a75b5a15e7362299]) successfully deleted
I20251215 14:55:13.733482 9427 tablet_bootstrap.cc:492] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
W20251215 14:55:13.733565 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet d09d7ce93d074bfaa830130b31bcc594 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d09d7ce93d074bfaa830130b31bcc594 already in progress: creating tablet
I20251215 14:55:13.733721 9427 ts_tablet_manager.cc:1403] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.133s user 0.008s sys 0.001s
I20251215 14:55:13.734642 9427 raft_consensus.cc:359] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.734884 9427 raft_consensus.cc:385] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.734979 9427 raft_consensus.cc:740] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.735287 9427 consensus_queue.cc:260] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.735903 9427 ts_tablet_manager.cc:1434] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:13.737136 9427 tablet_bootstrap.cc:492] T f830b4af355e480bbe75d6060585529e P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:13.740177 9427 tablet_bootstrap.cc:654] T f830b4af355e480bbe75d6060585529e P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:13.741755 8780 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ac2ccf4d3e5b44de808a7a4108394f9c" } modify_external_catalogs: true
I20251215 14:55:13.741992 8786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e073cd03acc04d7bbf396abc459c8049" } modify_external_catalogs: true
I20251215 14:55:13.742771 8779 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_5a1f6846c5344a53b59844dbc4f6a24f" } modify_external_catalogs: true
I20251215 14:55:13.744192 8783 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_2a1b8255b8b348e7b88eacbd41d5231a" } modify_external_catalogs: true
I20251215 14:55:13.746495 8784 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_b9318dc67efb49bea8513a106539137a" } modify_external_catalogs: true
I20251215 14:55:13.747117 9971 raft_consensus.cc:493] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:13.747296 9971 raft_consensus.cc:515] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.747949 9971 leader_election.cc:290] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:13.748725 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82ca60c5a63744ffb0a0c0a140ef665e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:13.748924 9042 raft_consensus.cc:2468] T 82ca60c5a63744ffb0a0c0a140ef665e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:13.749434 9248 leader_election.cc:304] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:13.750137 9971 raft_consensus.cc:2804] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:13.750257 9971 raft_consensus.cc:493] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:13.750344 9971 raft_consensus.cc:3060] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.752976 9971 raft_consensus.cc:515] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.753626 9971 leader_election.cc:290] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:13.755144 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82ca60c5a63744ffb0a0c0a140ef665e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:13.755448 9042 raft_consensus.cc:3060] T 82ca60c5a63744ffb0a0c0a140ef665e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.756712 9427 tablet_bootstrap.cc:492] T f830b4af355e480bbe75d6060585529e P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:13.756821 8786 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 86f18ff40af547da85de8966b12f76f4
I20251215 14:55:13.756898 9427 ts_tablet_manager.cc:1403] T f830b4af355e480bbe75d6060585529e P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.005s
I20251215 14:55:13.758055 9015 tablet_service.cc:1552] Processing DeleteTablet for tablet 86f18ff40af547da85de8966b12f76f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:13 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:13.758714 9042 raft_consensus.cc:2468] T 82ca60c5a63744ffb0a0c0a140ef665e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:13.757898 9427 raft_consensus.cc:359] T f830b4af355e480bbe75d6060585529e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.759016 9427 raft_consensus.cc:385] T f830b4af355e480bbe75d6060585529e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251215 14:55:13.759003 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 86f18ff40af547da85de8966b12f76f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86f18ff40af547da85de8966b12f76f4 already in progress: creating tablet
I20251215 14:55:13.760628 9248 leader_election.cc:304] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:13.759217 9427 raft_consensus.cc:740] T f830b4af355e480bbe75d6060585529e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.762756 9971 raft_consensus.cc:2804] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:13.762655 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 86f18ff40af547da85de8966b12f76f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:13 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:13.763490 9427 consensus_queue.cc:260] T f830b4af355e480bbe75d6060585529e P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.763689 9971 raft_consensus.cc:697] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:13.764739 9427 ts_tablet_manager.cc:1434] T f830b4af355e480bbe75d6060585529e P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20251215 14:55:13.766891 9971 consensus_queue.cc:237] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.769348 10351 tablet.cc:1722] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:13.771621 10388 tablet.cc:1722] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:13.771210 9427 tablet_bootstrap.cc:492] T a0a74645593d46fcbc0235ec6a4670d8 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:13.777334 9427 tablet_bootstrap.cc:654] T a0a74645593d46fcbc0235ec6a4670d8 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:13.780573 9157 tablet_service.cc:1552] Processing DeleteTablet for tablet 86f18ff40af547da85de8966b12f76f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:13 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:13.781162 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet d09d7ce93d074bfaa830130b31bcc594 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d09d7ce93d074bfaa830130b31bcc594 already in progress: creating tablet
I20251215 14:55:13.781148 10367 tablet.cc:1722] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:13.781636 9426 tablet_bootstrap.cc:492] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:13.783113 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 86f18ff40af547da85de8966b12f76f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86f18ff40af547da85de8966b12f76f4 already in progress: creating tablet
W20251215 14:55:13.787036 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:13.787701 9426 tablet_bootstrap.cc:654] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:13.790813 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 86f18ff40af547da85de8966b12f76f4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 86f18ff40af547da85de8966b12f76f4 already in progress: creating tablet
W20251215 14:55:13.792044 9249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 197795us
I20251215 14:55:13.793596 10269 raft_consensus.cc:493] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:13.811549 9435 tablet_bootstrap.cc:492] T 3c6cfff573434fbcb18feaf6a8e6a153 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:13.811760 9435 ts_tablet_manager.cc:1403] T 3c6cfff573434fbcb18feaf6a8e6a153 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.251s user 0.007s sys 0.005s
I20251215 14:55:13.814694 10345 raft_consensus.cc:493] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:13.814883 10345 raft_consensus.cc:515] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.815625 10345 leader_election.cc:290] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:13.824009 8786 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_76a8f78ec8a74aadaf69142df6990dc8" } new_table_name: "default.Table_9da974a647f64692a4b35ed053e34ef3" modify_external_catalogs: true
I20251215 14:55:13.824450 9435 raft_consensus.cc:359] T 3c6cfff573434fbcb18feaf6a8e6a153 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.824739 9435 raft_consensus.cc:385] T 3c6cfff573434fbcb18feaf6a8e6a153 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.824822 9435 raft_consensus.cc:740] T 3c6cfff573434fbcb18feaf6a8e6a153 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.825407 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_aaf97f0fc96740029af4a42f8050701b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:13.825747 9435 consensus_queue.cc:260] T 3c6cfff573434fbcb18feaf6a8e6a153 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:13.825953 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aaf97f0fc96740029af4a42f8050701b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.826313 9435 ts_tablet_manager.cc:1434] T 3c6cfff573434fbcb18feaf6a8e6a153 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20251215 14:55:13.828389 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_651229e55631414091ad50b8f190c26a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.828920 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_651229e55631414091ad50b8f190c26a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.830770 10269 raft_consensus.cc:515] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.831470 10269 leader_election.cc:290] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:13.832767 9435 tablet_bootstrap.cc:492] T 88206b17f94242378a35d5314611ac1a P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:13.833046 8779 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet b32d996521dd4330b84ff4e1951f5124
I20251215 14:55:13.834659 9435 tablet_bootstrap.cc:654] T 88206b17f94242378a35d5314611ac1a P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:13.836416 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 88206b17f94242378a35d5314611ac1a
W20251215 14:55:13.836504 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 18cd1f63d51e4565bb8c55be13e3e099
W20251215 14:55:13.836551 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet c7f760639a664cfb9f4af5578154b981
W20251215 14:55:13.836675 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 90c0254840b442a3817171b06f2726c8
W20251215 14:55:13.836746 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bf4a899338f4bcfac099b5099a22f05
W20251215 14:55:13.836802 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet accc3fdaf8e64b0f96b45150a59516bf
I20251215 14:55:13.837209 8779 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 605da10c8d3049e8b94caa9738576aab (table default.Table_2e1e3e730bbb4364b0f1f86d7d89056a [id=1a10676eee8b47098cf45bee49e3f502]). Expected version 2 got 0
I20251215 14:55:13.837400 8779 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet a639396098a941249afd9c3560073131 (table default.Table_404807c380fa4483ac5e0545eb3028cd [id=5cc820ec2c8b427db1c89647b295363e]). Expected version 1 got 0
W20251215 14:55:13.840229 8788 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7f9c173d11f1449b829a54190313bea3 consensus state has no leader
I20251215 14:55:13.841324 8780 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 4a98e436ade941989e40e34578572e3b
I20251215 14:55:13.841871 8783 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 57b2bdb8f24842f384a11133e2b07db8
W20251215 14:55:13.842630 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet a0a74645593d46fcbc0235ec6a4670d8
W20251215 14:55:13.842729 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 30c5c795ea4a4fe591cdf63320ec2521
W20251215 14:55:13.843832 8781 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8f6bf35f57e94a1d983612561aa6f185 has no consensus state
I20251215 14:55:13.847716 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_d781b8c6c0c749a9967558102dcb8f11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:13.847774 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_038be3c83b73426c8567ae0303533ced"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.850262 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_038be3c83b73426c8567ae0303533ced in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:13.850592 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d781b8c6c0c749a9967558102dcb8f11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:13.851186 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 2d75636265f14a428aae592438064ea2
W20251215 14:55:13.851358 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bf4a899338f4bcfac099b5099a22f05
I20251215 14:55:13.851991 8783 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_1d7a2033401a4156ba066d374364e61f [id=cbafb4499c90447d8f185928d3e58b20]). Expected version 2 got 0
I20251215 14:55:13.852196 8783 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet a639396098a941249afd9c3560073131 (table default.Table_404807c380fa4483ac5e0545eb3028cd [id=5cc820ec2c8b427db1c89647b295363e]). Expected version 1 got 0
I20251215 14:55:13.852993 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_fe59a4e6fc0e475986dbdcdf73cf19ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.853479 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe59a4e6fc0e475986dbdcdf73cf19ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.854638 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56816add0a61454c9980ad09f5815b09" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:13.856323 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_8f71efbeb4b64923bc7d7313d3119348"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.856812 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f71efbeb4b64923bc7d7313d3119348 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.857142 8784 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet f172aa2c509e446cb51b082f385fade0
I20251215 14:55:13.857517 8784 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e51fbd4ee3b74a7b8c6be8288d9676f9" } new_table_name: "default.Table_feadd6e18a8f4153b4cd423f6ca5c0ba" modify_external_catalogs: true
I20251215 14:55:13.857919 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet 4a98e436ade941989e40e34578572e3b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:13 UTC) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:13.860006 8786 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 43e9cfdc89b04781b7b5892af07307af consensus state has no leader
I20251215 14:55:13.860325 8786 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d89eda12e44643bb9eb29e87f1562d49" } new_table_name: "default.Table_f016f160e2324a7aa2c117ab8a53c173" modify_external_catalogs: true
I20251215 14:55:13.862967 9015 tablet_service.cc:1552] Processing DeleteTablet for tablet 4a98e436ade941989e40e34578572e3b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:13 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:13.863381 8978 leader_election.cc:343] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:13.871977 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 4a98e436ade941989e40e34578572e3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a98e436ade941989e40e34578572e3b already in progress: creating tablet
I20251215 14:55:13.874221 9435 tablet_bootstrap.cc:492] T 88206b17f94242378a35d5314611ac1a P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:13.874462 8779 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_1d7a2033401a4156ba066d374364e61f [id=cbafb4499c90447d8f185928d3e58b20] alter complete (version 2)
I20251215 14:55:13.874747 9435 ts_tablet_manager.cc:1403] T 88206b17f94242378a35d5314611ac1a P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.042s user 0.000s sys 0.004s
I20251215 14:55:13.875754 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_7a9d211862b14b6ab12a5bd5c7f89d59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.876332 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a9d211862b14b6ab12a5bd5c7f89d59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:13.877470 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 3c6cfff573434fbcb18feaf6a8e6a153
W20251215 14:55:13.878108 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 82ca60c5a63744ffb0a0c0a140ef665e
W20251215 14:55:13.878219 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bf4a899338f4bcfac099b5099a22f05
W20251215 14:55:13.878490 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 30c5c795ea4a4fe591cdf63320ec2521
I20251215 14:55:13.877998 9435 raft_consensus.cc:359] T 88206b17f94242378a35d5314611ac1a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.879107 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_cfe7e4ea81d045558a2dc22b52ba8e22"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:13.878902 9435 raft_consensus.cc:385] T 88206b17f94242378a35d5314611ac1a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.879443 9435 raft_consensus.cc:740] T 88206b17f94242378a35d5314611ac1a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
W20251215 14:55:13.879662 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfe7e4ea81d045558a2dc22b52ba8e22 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:13.880352 9435 consensus_queue.cc:260] T 88206b17f94242378a35d5314611ac1a P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.882704 8781 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet a639396098a941249afd9c3560073131 (table default.Table_404807c380fa4483ac5e0545eb3028cd [id=5cc820ec2c8b427db1c89647b295363e]). Expected version 1 got 0
I20251215 14:55:13.887488 10289 raft_consensus.cc:493] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:13.887257 9435 ts_tablet_manager.cc:1434] T 88206b17f94242378a35d5314611ac1a P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20251215 14:55:13.887677 10289 raft_consensus.cc:515] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.888291 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f830b4af355e480bbe75d6060585529e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:13.888618 9435 tablet_bootstrap.cc:492] T accc3fdaf8e64b0f96b45150a59516bf P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:13.890060 9040 raft_consensus.cc:2468] T f830b4af355e480bbe75d6060585529e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:13.890671 10289 leader_election.cc:290] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:13.894102 9427 tablet_bootstrap.cc:492] T a0a74645593d46fcbc0235ec6a4670d8 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:13.894333 9427 ts_tablet_manager.cc:1403] T a0a74645593d46fcbc0235ec6a4670d8 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.123s user 0.000s sys 0.008s
I20251215 14:55:13.895203 9427 raft_consensus.cc:359] T a0a74645593d46fcbc0235ec6a4670d8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.895534 9427 raft_consensus.cc:385] T a0a74645593d46fcbc0235ec6a4670d8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.895627 9435 tablet_bootstrap.cc:654] T accc3fdaf8e64b0f96b45150a59516bf P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:13.895709 9427 raft_consensus.cc:740] T a0a74645593d46fcbc0235ec6a4670d8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.896312 9427 consensus_queue.cc:260] T a0a74645593d46fcbc0235ec6a4670d8 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.897424 9427 ts_tablet_manager.cc:1434] T a0a74645593d46fcbc0235ec6a4670d8 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:13.898008 9427 tablet_bootstrap.cc:492] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:13.900900 9427 tablet_bootstrap.cc:654] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:13.901561 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 4a98e436ade941989e40e34578572e3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a98e436ade941989e40e34578572e3b already in progress: creating tablet
I20251215 14:55:13.902508 9971 raft_consensus.cc:493] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:13.902717 9971 raft_consensus.cc:515] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.902987 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dd36ea0aa53460f9c1fda4b31063fa7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:13.903223 9306 raft_consensus.cc:2468] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:13.903589 9971 leader_election.cc:290] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:13.903975 9248 leader_election.cc:304] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:13.904422 9971 raft_consensus.cc:2804] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:13.904528 9971 raft_consensus.cc:493] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251215 14:55:13.908351 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet f830b4af355e480bbe75d6060585529e
W20251215 14:55:13.909297 8784 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0fed3b34844e4e5b8518c0165df342d1 consensus state has no leader
W20251215 14:55:13.912482 8786 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d809129224b4a74b42c0f7e370233f6 has no consensus state
I20251215 14:55:13.919294 9971 raft_consensus.cc:3060] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.921226 8978 leader_election.cc:304] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:13.921530 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dd36ea0aa53460f9c1fda4b31063fa7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:13.921628 10289 raft_consensus.cc:2804] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:13.921800 9040 raft_consensus.cc:2468] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:13.922161 10289 raft_consensus.cc:493] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:13.922260 10289 raft_consensus.cc:3060] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:13.922571 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82ca60c5a63744ffb0a0c0a140ef665e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:13.924304 9175 raft_consensus.cc:1275] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Refusing update from remote peer e89303a500544272b601d7c29be802b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251215 14:55:13.924594 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82ca60c5a63744ffb0a0c0a140ef665e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:13.924970 10289 raft_consensus.cc:515] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.925794 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f830b4af355e480bbe75d6060585529e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:13.926115 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dd36ea0aa53460f9c1fda4b31063fa7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:13.926219 10289 leader_election.cc:290] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:13.926604 9157 tablet_service.cc:1552] Processing DeleteTablet for tablet 4a98e436ade941989e40e34578572e3b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:13 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:13.930548 8781 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_2e1e3e730bbb4364b0f1f86d7d89056a [id=1a10676eee8b47098cf45bee49e3f502] alter complete (version 2)
W20251215 14:55:13.936340 8772 consensus_peers.cc:597] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315 -> Peer cad1fca07ac7419cb608c21541f672f3 (127.8.121.190:44279): Couldn't send request to peer cad1fca07ac7419cb608c21541f672f3. Status: Network error: Client connection negotiation failed: client connection to 127.8.121.190:44279: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20251215 14:55:13.937343 9427 tablet_bootstrap.cc:492] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:13.937539 9427 ts_tablet_manager.cc:1403] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.040s user 0.001s sys 0.003s
I20251215 14:55:13.938639 9427 raft_consensus.cc:359] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.938951 9427 raft_consensus.cc:385] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.939098 9427 raft_consensus.cc:740] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
W20251215 14:55:13.939117 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 30c5c795ea4a4fe591cdf63320ec2521
W20251215 14:55:13.939244 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet a0a74645593d46fcbc0235ec6a4670d8
I20251215 14:55:13.939632 9427 consensus_queue.cc:260] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.947319 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dd36ea0aa53460f9c1fda4b31063fa7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:13.947841 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dd36ea0aa53460f9c1fda4b31063fa7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:13.948601 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56816add0a61454c9980ad09f5815b09" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:13.949182 8976 leader_election.cc:343] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:13.949899 8976 leader_election.cc:343] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:13.950112 8976 leader_election.cc:343] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:13.950233 8976 leader_election.cc:304] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:13.950771 10289 raft_consensus.cc:2749] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:13.955888 9427 ts_tablet_manager.cc:1434] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.018s user 0.000s sys 0.003s
I20251215 14:55:13.956554 9427 tablet_bootstrap.cc:492] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:13.958540 9427 tablet_bootstrap.cc:654] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:13.963790 8781 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_fe59a4e6fc0e475986dbdcdf73cf19ff" } modify_external_catalogs: true
I20251215 14:55:13.964038 8781 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_fe59a4e6fc0e475986dbdcdf73cf19ff" } modify_external_catalogs: true
I20251215 14:55:13.966087 8779 master_service.cc:954] ReplaceTablet: received request to replace tablet 52e93348b205408f83efff27fde48e9b from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:13.966595 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_2020a15a1c104430a6681d4242a1b4a1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:13.967283 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2020a15a1c104430a6681d4242a1b4a1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:13.973537 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 4a98e436ade941989e40e34578572e3b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4a98e436ade941989e40e34578572e3b already in progress: creating tablet
I20251215 14:55:13.974210 10367 tablet.cc:1717] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3: Skipping requested alter to schema version 5, tablet already version 5
W20251215 14:55:13.976404 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 034fec793ae74fcda0c73f1cea291311
W20251215 14:55:13.976732 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 30c5c795ea4a4fe591cdf63320ec2521
I20251215 14:55:13.983812 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dd36ea0aa53460f9c1fda4b31063fa7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:13.984984 9305 raft_consensus.cc:3060] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:13.985486 9249 leader_election.cc:343] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:13.985960 9249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 57543.6us
I20251215 14:55:13.986359 10289 raft_consensus.cc:493] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:13.986512 10289 raft_consensus.cc:515] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.987108 10289 leader_election.cc:290] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:13.987833 10345 consensus_queue.cc:1048] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 14:55:13.988792 9248 leader_election.cc:304] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:13.989611 9249 leader_election.cc:343] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:13.990104 9426 tablet_bootstrap.cc:492] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:13.990253 9426 ts_tablet_manager.cc:1403] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.236s user 0.004s sys 0.000s
W20251215 14:55:13.990559 9249 leader_election.cc:343] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:13.990924 9249 leader_election.cc:343] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:13.991809 9426 raft_consensus.cc:359] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.991991 9426 raft_consensus.cc:385] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:13.993243 9426 raft_consensus.cc:740] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:13.993505 9426 consensus_queue.cc:260] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:13.994485 9426 ts_tablet_manager.cc:1434] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251215 14:55:13.996153 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c6cfff573434fbcb18feaf6a8e6a153" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:13.998395 9426 tablet_bootstrap.cc:492] T ff4508c5a110427eb4d9d2eaaadace0b P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:13.999883 9305 raft_consensus.cc:2468] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:14.000002 9426 tablet_bootstrap.cc:654] T ff4508c5a110427eb4d9d2eaaadace0b P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:14.000114 10345 raft_consensus.cc:2764] T 5dd36ea0aa53460f9c1fda4b31063fa7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20251215 14:55:14.002264 8978 leader_election.cc:304] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:14.002799 10289 raft_consensus.cc:2804] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:14.002940 10289 raft_consensus.cc:697] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:14.003219 10289 consensus_queue.cc:237] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:14.007020 8976 leader_election.cc:343] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:14.009013 9971 raft_consensus.cc:515] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.009445 10289 raft_consensus.cc:493] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:14.009586 10289 raft_consensus.cc:515] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.010130 10289 leader_election.cc:290] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:14.010464 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f830b4af355e480bbe75d6060585529e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:14.010705 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c6cfff573434fbcb18feaf6a8e6a153" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:14.010958 9305 raft_consensus.cc:2468] T 3c6cfff573434fbcb18feaf6a8e6a153 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:14.010946 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "65ea0509d8eb42bdb2291ff01e8d3bd6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:14.011245 9971 leader_election.cc:290] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:14.011379 8976 leader_election.cc:343] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:14.011386 9249 leader_election.cc:343] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:14.012060 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f830b4af355e480bbe75d6060585529e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:14.012125 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "65ea0509d8eb42bdb2291ff01e8d3bd6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:14.012226 9038 raft_consensus.cc:3060] T f830b4af355e480bbe75d6060585529e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:14.014969 9038 raft_consensus.cc:2468] T f830b4af355e480bbe75d6060585529e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:14.016336 8978 leader_election.cc:304] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
W20251215 14:55:14.016801 8978 leader_election.cc:343] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:14.016911 8978 leader_election.cc:304] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:14.017432 10357 raft_consensus.cc:2804] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:14.017535 10357 raft_consensus.cc:493] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:14.017618 10357 raft_consensus.cc:3060] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:14.018640 9426 tablet_bootstrap.cc:492] T ff4508c5a110427eb4d9d2eaaadace0b P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:14.018787 9426 ts_tablet_manager.cc:1403] T ff4508c5a110427eb4d9d2eaaadace0b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.002s
I20251215 14:55:14.019565 9426 raft_consensus.cc:359] T ff4508c5a110427eb4d9d2eaaadace0b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.019735 9426 raft_consensus.cc:385] T ff4508c5a110427eb4d9d2eaaadace0b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:14.019793 9426 raft_consensus.cc:740] T ff4508c5a110427eb4d9d2eaaadace0b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:14.019990 9426 consensus_queue.cc:260] T ff4508c5a110427eb4d9d2eaaadace0b P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.020171 10357 raft_consensus.cc:515] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.020777 10357 leader_election.cc:290] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:14.020964 10357 raft_consensus.cc:2749] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:14.021188 9426 ts_tablet_manager.cc:1434] T ff4508c5a110427eb4d9d2eaaadace0b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:14.021474 9426 tablet_bootstrap.cc:492] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:14.022215 9248 leader_election.cc:304] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:14.022502 9971 raft_consensus.cc:2804] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:14.022711 9971 raft_consensus.cc:697] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:14.023010 9971 consensus_queue.cc:237] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.024537 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c6cfff573434fbcb18feaf6a8e6a153" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:14.025148 8976 leader_election.cc:343] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:14.025743 9426 tablet_bootstrap.cc:654] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:14.026731 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c6cfff573434fbcb18feaf6a8e6a153" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:14.026945 9315 raft_consensus.cc:3060] T 3c6cfff573434fbcb18feaf6a8e6a153 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:14.029745 9315 raft_consensus.cc:2468] T 3c6cfff573434fbcb18feaf6a8e6a153 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:14.031064 8978 leader_election.cc:304] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:14.031461 10269 raft_consensus.cc:493] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:14.031587 10269 raft_consensus.cc:515] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.032162 10269 leader_election.cc:290] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:14.032286 10269 consensus_queue.cc:1048] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:14.032692 10269 raft_consensus.cc:2804] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:14.032796 10269 raft_consensus.cc:697] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:14.033030 10269 consensus_queue.cc:237] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.037114 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88206b17f94242378a35d5314611ac1a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:14.037305 9315 raft_consensus.cc:2468] T 88206b17f94242378a35d5314611ac1a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:14.032024 10266 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:14.034359 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88206b17f94242378a35d5314611ac1a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:14.037541 10266 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:14.038054 8976 leader_election.cc:343] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:14.038121 10266 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:14.038472 8978 leader_election.cc:304] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:14.039088 10289 raft_consensus.cc:2804] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:14.039192 10289 raft_consensus.cc:493] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251215 14:55:14.039254 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:55:14.039286 10289 raft_consensus.cc:3060] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:14.042315 10289 raft_consensus.cc:515] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:14.042951 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:55:14.043092 9112 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:14.043525 10266 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:14.050729 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88206b17f94242378a35d5314611ac1a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:14.051699 8976 leader_election.cc:343] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:14.052397 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88206b17f94242378a35d5314611ac1a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:14.052577 9315 raft_consensus.cc:3060] T 88206b17f94242378a35d5314611ac1a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:14.055894 9315 raft_consensus.cc:2468] T 88206b17f94242378a35d5314611ac1a P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:14.056881 8978 leader_election.cc:304] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:14.057433 9427 tablet_bootstrap.cc:492] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:14.057677 9427 ts_tablet_manager.cc:1403] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.101s user 0.002s sys 0.014s
I20251215 14:55:14.058626 9427 raft_consensus.cc:359] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.059247 9427 raft_consensus.cc:385] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:14.059391 9427 raft_consensus.cc:740] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:14.059718 9427 consensus_queue.cc:260] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.067813 10266 raft_consensus.cc:493] T 30c5c795ea4a4fe591cdf63320ec2521 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:14.068006 10266 raft_consensus.cc:515] T 30c5c795ea4a4fe591cdf63320ec2521 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.068643 10266 leader_election.cc:290] T 30c5c795ea4a4fe591cdf63320ec2521 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:14.069489 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30c5c795ea4a4fe591cdf63320ec2521" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:14.073446 9435 tablet_bootstrap.cc:492] T accc3fdaf8e64b0f96b45150a59516bf P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:14.073678 9435 ts_tablet_manager.cc:1403] T accc3fdaf8e64b0f96b45150a59516bf P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.185s user 0.005s sys 0.000s
I20251215 14:55:14.074517 9435 raft_consensus.cc:359] T accc3fdaf8e64b0f96b45150a59516bf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.074743 9435 raft_consensus.cc:385] T accc3fdaf8e64b0f96b45150a59516bf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:14.074818 9435 raft_consensus.cc:740] T accc3fdaf8e64b0f96b45150a59516bf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:14.075121 9435 consensus_queue.cc:260] T accc3fdaf8e64b0f96b45150a59516bf P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.078984 10289 leader_election.cc:290] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:14.085525 10436 raft_consensus.cc:2804] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:14.087795 9427 ts_tablet_manager.cc:1434] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.030s user 0.002s sys 0.006s
I20251215 14:55:14.088640 10436 raft_consensus.cc:697] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:14.089003 9427 tablet_bootstrap.cc:492] T 35326e99d413431583b25d11269d09dc P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:14.089030 10436 consensus_queue.cc:237] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.090942 9427 tablet_bootstrap.cc:654] T 35326e99d413431583b25d11269d09dc P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:14.088201 10289 consensus_queue.cc:1048] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:14.099933 9435 ts_tablet_manager.cc:1434] T accc3fdaf8e64b0f96b45150a59516bf P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.026s user 0.002s sys 0.000s
I20251215 14:55:14.109095 9435 tablet_bootstrap.cc:492] T 2811b8ffdb614c91b0d3d4e6e039245b P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:14.111691 9435 tablet_bootstrap.cc:654] T 2811b8ffdb614c91b0d3d4e6e039245b P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:14.115232 8772 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet d88741012a814d41ac074e86805f492d (table default.Table_6c09c786139c45b7aafd6b42938df236 [id=9a061a63f3c54a9bb093c9c41ae79db6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d88741012a814d41ac074e86805f492d consensus state has no leader
I20251215 14:55:14.117859 8786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_2e1e3e730bbb4364b0f1f86d7d89056a" } modify_external_catalogs: true
I20251215 14:55:14.118085 8786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_2e1e3e730bbb4364b0f1f86d7d89056a" } modify_external_catalogs: true
I20251215 14:55:14.122305 8785 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_20804605d90d4fba9f88e94a70e903e4" } modify_external_catalogs: true
I20251215 14:55:14.123785 8787 master_service.cc:954] ReplaceTablet: received request to replace tablet 26754a74483c4c9580df93aae10e7de1 from {username='slave'} at 127.0.0.1:49790
W20251215 14:55:14.126677 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 88206b17f94242378a35d5314611ac1a
I20251215 14:55:14.127202 8788 master_service.cc:954] ReplaceTablet: received request to replace tablet 6229b8bc8d3d446c944c819670b10d54 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:14.128212 8780 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_25f19281d4834ce6b6e42c14857433a5" } new_table_name: "default.Table_846dce0df4e24591ad236b2eedaeecff" modify_external_catalogs: true
I20251215 14:55:14.123795 8781 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet f34f8fb9d76c4dc083f969de6dc4b5b6
I20251215 14:55:14.131276 8784 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_5b7025739b9b4c3f97a21eb6d726c69c" } modify_external_catalogs: true
I20251215 14:55:14.131474 8784 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_5b7025739b9b4c3f97a21eb6d726c69c" } modify_external_catalogs: true
I20251215 14:55:14.133136 8781 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d7b6fa9c5de14f49bd548e60d9d1b4b6" } new_table_name: "default.Table_d91b7818df7d462e931287fb2e5a382b" modify_external_catalogs: true
I20251215 14:55:14.137470 8785 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_20804605d90d4fba9f88e94a70e903e4" } modify_external_catalogs: true
I20251215 14:55:14.138859 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 26754a74483c4c9580df93aae10e7de1
I20251215 14:55:14.139613 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_dcc4a99665d346a7b25e1e4a63149e12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.140147 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dcc4a99665d346a7b25e1e4a63149e12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.140903 9015 tablet_service.cc:1552] Processing DeleteTablet for tablet 26754a74483c4c9580df93aae10e7de1 with delete_type TABLET_DATA_DELETED (replaced by tablet 46c3f997e7bc4c7fb08dfe6928d7c0ea) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:14.141201 10141 tablet_replica.cc:333] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:14.141443 10141 raft_consensus.cc:2243] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:14.141669 10141 raft_consensus.cc:2272] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:14.143368 8787 catalog_manager.cc:6724] ReplaceTablet: tablet 26754a74483c4c9580df93aae10e7de1 deleted and replaced by tablet 46c3f997e7bc4c7fb08dfe6928d7c0ea
I20251215 14:55:14.143420 10141 ts_tablet_manager.cc:1916] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:14.145736 8783 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c5e74b5e0e27496faba60875b5541547" } modify_external_catalogs: true
I20251215 14:55:14.145932 8783 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c5e74b5e0e27496faba60875b5541547" } modify_external_catalogs: true
I20251215 14:55:14.150336 10141 ts_tablet_manager.cc:1929] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:14.150547 10141 log.cc:1199] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/26754a74483c4c9580df93aae10e7de1
I20251215 14:55:14.150739 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet 26754a74483c4c9580df93aae10e7de1 with delete_type TABLET_DATA_DELETED (replaced by tablet 46c3f997e7bc4c7fb08dfe6928d7c0ea) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:14.151036 9944 tablet_replica.cc:333] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:14.151199 10141 ts_tablet_manager.cc:1950] T 26754a74483c4c9580df93aae10e7de1 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:14.151288 9944 raft_consensus.cc:2243] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:14.151520 9944 raft_consensus.cc:2272] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:14.152465 9944 ts_tablet_manager.cc:1916] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:14.161176 9944 ts_tablet_manager.cc:1929] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:14.161465 9944 log.cc:1199] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/26754a74483c4c9580df93aae10e7de1
I20251215 14:55:14.161921 9944 ts_tablet_manager.cc:1950] T 26754a74483c4c9580df93aae10e7de1 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:14.164068 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_1d7a2033401a4156ba066d374364e61f [id=cbafb4499c90447d8f185928d3e58b20]) successfully deleted
I20251215 14:55:14.164709 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_1d7a2033401a4156ba066d374364e61f [id=cbafb4499c90447d8f185928d3e58b20]) successfully deleted
W20251215 14:55:14.165474 8780 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e8ffa009bae84660b331ebeddcccc266 has no consensus state
I20251215 14:55:14.167568 8780 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_1bc862badd3047f59da171da067890ba" } new_table_name: "default.Table_f6dc3123615b4cd1b4114e8ed9723cbd" modify_external_catalogs: true
I20251215 14:55:14.169466 8786 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 605da10c8d3049e8b94caa9738576aab
I20251215 14:55:14.170809 9015 tablet_service.cc:1552] Processing DeleteTablet for tablet 605da10c8d3049e8b94caa9738576aab with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:14.171077 10141 tablet_replica.cc:333] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:14.171345 10141 raft_consensus.cc:2243] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:14.171569 10141 raft_consensus.cc:2272] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:14.172996 10141 ts_tablet_manager.cc:1916] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:14.172978 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet 605da10c8d3049e8b94caa9738576aab with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:14.173207 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_3fa36ab140804466ab3cec1bc2051b26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.173767 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3fa36ab140804466ab3cec1bc2051b26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:14.175016 8781 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 21437c9162f1435485dde5fca3522be1 has no consensus state
I20251215 14:55:14.175405 9944 tablet_replica.cc:333] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:14.175590 9944 raft_consensus.cc:2243] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:14.175907 9944 raft_consensus.cc:2272] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:14.176129 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_9f648c3cee4545d1b7501496db60f858"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.176594 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f648c3cee4545d1b7501496db60f858 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.176842 9944 ts_tablet_manager.cc:1916] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:14.179723 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_5c47df95ac124b47aa4d1c9fbdfb0a05"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:14.181036 10141 ts_tablet_manager.cc:1929] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:14.181190 10141 log.cc:1199] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/605da10c8d3049e8b94caa9738576aab
I20251215 14:55:14.181566 10141 ts_tablet_manager.cc:1950] T 605da10c8d3049e8b94caa9738576aab P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
W20251215 14:55:14.181880 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet accc3fdaf8e64b0f96b45150a59516bf
W20251215 14:55:14.182058 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet f830b4af355e480bbe75d6060585529e
I20251215 14:55:14.182533 8787 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet e0c88310853f47b0aa1af9a3d676bef6 (table default.Table_6b689570cd944426b4edf8342163ef0e [id=d0891c1ad38b48348b350482a3298f39]). Expected version 1 got 0
I20251215 14:55:14.183233 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 605da10c8d3049e8b94caa9738576aab (table default.Table_2e1e3e730bbb4364b0f1f86d7d89056a [id=1a10676eee8b47098cf45bee49e3f502]) successfully deleted
W20251215 14:55:14.183691 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5c47df95ac124b47aa4d1c9fbdfb0a05 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.188403 9944 ts_tablet_manager.cc:1929] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:14.188544 9944 log.cc:1199] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/605da10c8d3049e8b94caa9738576aab
I20251215 14:55:14.188972 9944 ts_tablet_manager.cc:1950] T 605da10c8d3049e8b94caa9738576aab P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:14.189513 8787 master_service.cc:954] ReplaceTablet: received request to replace tablet 5830296559264b609909486aa15c9e2e from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:14.191349 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 605da10c8d3049e8b94caa9738576aab (table default.Table_2e1e3e730bbb4364b0f1f86d7d89056a [id=1a10676eee8b47098cf45bee49e3f502]) successfully deleted
W20251215 14:55:14.196075 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 034fec793ae74fcda0c73f1cea291311
W20251215 14:55:14.197892 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 141046us
I20251215 14:55:14.199239 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "30c5c795ea4a4fe591cdf63320ec2521" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:14.199651 10434 raft_consensus.cc:493] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:14.199796 10434 raft_consensus.cc:515] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.200381 10434 leader_election.cc:290] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:14.209124 8780 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet be4393dc706f45a89b9b2c9727cd7726 consensus state has no leader
I20251215 14:55:14.209829 8786 master_service.cc:954] ReplaceTablet: received request to replace tablet 82575517299b4e69a0871714dde9aacc from {username='slave'} at 127.0.0.1:49790
W20251215 14:55:14.211354 8780 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
I20251215 14:55:14.212761 8780 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_1d7a2033401a4156ba066d374364e61f" } new_table_name: "default.Table_bbbfcbf7cf704bc9b55fd2cf41a7ab5e" modify_external_catalogs: true
I20251215 14:55:14.214557 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_32cc6ae980434bab879271b8df8d5d90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.215241 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32cc6ae980434bab879271b8df8d5d90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.218012 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_22d32e115a824ce19bb9a8d0c82da09a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.218688 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_22d32e115a824ce19bb9a8d0c82da09a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.227128 9015 tablet_service.cc:1505] Processing CreateTablet for tablet 2b686ad43973448c8e24230d7d1d7250 (DEFAULT_TABLE table=default.Table_52a6dc1585e14a438b227b8a04e0dc72 [id=d2ccdf335c2c421db90bb923ad637a3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.227582 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b686ad43973448c8e24230d7d1d7250. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.231868 9020 tablet_service.cc:1505] Processing CreateTablet for tablet 0ea937af02b447e6a78cda0741cc8570 (DEFAULT_TABLE table=default.Table_dc44be4119b34298afe34d3e9bde7a23 [id=b131019df9a64fc98d39b5a1d969167e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.232342 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea937af02b447e6a78cda0741cc8570. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.241669 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 2b686ad43973448c8e24230d7d1d7250 (DEFAULT_TABLE table=default.Table_52a6dc1585e14a438b227b8a04e0dc72 [id=d2ccdf335c2c421db90bb923ad637a3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.242136 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b686ad43973448c8e24230d7d1d7250. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:14.249543 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:14.250344 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 0ea937af02b447e6a78cda0741cc8570 (DEFAULT_TABLE table=default.Table_dc44be4119b34298afe34d3e9bde7a23 [id=b131019df9a64fc98d39b5a1d969167e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.250973 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea937af02b447e6a78cda0741cc8570. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.258944 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "accc3fdaf8e64b0f96b45150a59516bf" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:14.259370 9315 raft_consensus.cc:2468] T accc3fdaf8e64b0f96b45150a59516bf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:14.260895 8978 leader_election.cc:304] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:14.261591 10269 raft_consensus.cc:2804] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:14.261801 10269 raft_consensus.cc:493] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:14.261960 10269 raft_consensus.cc:3060] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:14.265519 10269 raft_consensus.cc:515] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.271086 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 5bd1578d434047158b6fbce7c24daebb (DEFAULT_TABLE table=default.Table_aeb325b8434f4db1a2a44761b1df1e6d [id=59ae80a72ff4469ca461cc61bac17fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.271566 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bd1578d434047158b6fbce7c24daebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.273505 10019 raft_consensus.cc:493] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:14.273649 10019 raft_consensus.cc:515] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.274730 9157 tablet_service.cc:1552] Processing DeleteTablet for tablet 26754a74483c4c9580df93aae10e7de1 with delete_type TABLET_DATA_DELETED (replaced by tablet 46c3f997e7bc4c7fb08dfe6928d7c0ea) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:14.276093 9943 tablet_replica.cc:333] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:14.276301 9943 raft_consensus.cc:2243] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:14.276676 9943 raft_consensus.cc:2272] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:14.274040 9112 leader_election.cc:304] T 30c5c795ea4a4fe591cdf63320ec2521 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:14.282861 8779 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 52e93348b205408f83efff27fde48e9b
I20251215 14:55:14.283499 8779 catalog_manager.cc:6724] ReplaceTablet: tablet 52e93348b205408f83efff27fde48e9b deleted and replaced by tablet 3f5dfc12c9ed4608933edeb6b1effcef
I20251215 14:55:14.283593 8786 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 82575517299b4e69a0871714dde9aacc
I20251215 14:55:14.284011 8786 catalog_manager.cc:6724] ReplaceTablet: tablet 82575517299b4e69a0871714dde9aacc deleted and replaced by tablet bc5222713e384199a016d5e928db8172
I20251215 14:55:14.286512 8784 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 022c9c0d19ac450cb270319004886fe2
I20251215 14:55:14.287727 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_778b1ec72d0e42f6a43b6bd5f6e69ecd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:14.288249 8785 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet e1d4dc7d18f7448880b79af99283c99f
W20251215 14:55:14.288444 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_778b1ec72d0e42f6a43b6bd5f6e69ecd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.289098 8785 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c88aa9616bff4d35942bc6dab8595dd3" } new_table_name: "default.Table_bba752fe83e349f4ad33cb5d5aec88a8" modify_external_catalogs: true
I20251215 14:55:14.292349 8783 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 9e317c8dc24e481abb709e932fa39c29
I20251215 14:55:14.292439 8786 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet e0c88310853f47b0aa1af9a3d676bef6 (table default.Table_6b689570cd944426b4edf8342163ef0e [id=d0891c1ad38b48348b350482a3298f39]). Expected version 1 got 0
I20251215 14:55:14.293279 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_5a2fe44194e744ab9d8e2d16351bd4d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.294123 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a2fe44194e744ab9d8e2d16351bd4d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.294531 9943 ts_tablet_manager.cc:1916] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:14.295593 10323 raft_consensus.cc:2749] T 30c5c795ea4a4fe591cdf63320ec2521 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:14.296212 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 88206b17f94242378a35d5314611ac1a
W20251215 14:55:14.296902 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 3c6cfff573434fbcb18feaf6a8e6a153
W20251215 14:55:14.297044 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 5dd36ea0aa53460f9c1fda4b31063fa7
I20251215 14:55:14.297399 8779 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 2811b8ffdb614c91b0d3d4e6e039245b (table default.Table_12b99071f9224445935f70cba021453f [id=53315a8cf3bd4a05b1c5e30fd0acdd56]). Expected version 1 got 0
I20251215 14:55:14.298345 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_48811b0d810640d985aa31e1748a1436"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:14.298456 10345 raft_consensus.cc:493] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:14.298606 10345 raft_consensus.cc:515] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.299275 10345 leader_election.cc:290] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:14.299851 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48811b0d810640d985aa31e1748a1436 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.302035 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_230e96c45d644e538756039106446856"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.302711 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_230e96c45d644e538756039106446856 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.304494 9155 tablet_service.cc:1505] Processing CreateTablet for tablet 2b686ad43973448c8e24230d7d1d7250 (DEFAULT_TABLE table=default.Table_52a6dc1585e14a438b227b8a04e0dc72 [id=d2ccdf335c2c421db90bb923ad637a3f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.305194 9146 tablet_service.cc:1505] Processing CreateTablet for tablet 0ea937af02b447e6a78cda0741cc8570 (DEFAULT_TABLE table=default.Table_dc44be4119b34298afe34d3e9bde7a23 [id=b131019df9a64fc98d39b5a1d969167e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.305689 9142 tablet_service.cc:1505] Processing CreateTablet for tablet 5bd1578d434047158b6fbce7c24daebb (DEFAULT_TABLE table=default.Table_aeb325b8434f4db1a2a44761b1df1e6d [id=59ae80a72ff4469ca461cc61bac17fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.305922 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 5830296559264b609909486aa15c9e2e
I20251215 14:55:14.306308 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 82575517299b4e69a0871714dde9aacc with delete_type TABLET_DATA_DELETED (replaced by tablet bc5222713e384199a016d5e928db8172) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:14.306571 9153 tablet_service.cc:1552] Processing DeleteTablet for tablet 022c9c0d19ac450cb270319004886fe2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:14.306684 8787 catalog_manager.cc:6724] ReplaceTablet: tablet 5830296559264b609909486aa15c9e2e deleted and replaced by tablet 6f9cdf8a71f24b7fb820d12c75a226fd
I20251215 14:55:14.306811 9152 tablet_service.cc:1552] Processing DeleteTablet for tablet 9e317c8dc24e481abb709e932fa39c29 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:14.307615 8780 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 46c3f997e7bc4c7fb08dfe6928d7c0ea has no consensus state
I20251215 14:55:14.310856 10019 leader_election.cc:290] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:14.312556 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08ca9ee6b76b4b13b7bc26d65dcc3979" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:14.314846 10345 consensus_queue.cc:1048] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:14.318351 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 52e93348b205408f83efff27fde48e9b with delete_type TABLET_DATA_DELETED (replaced by tablet 3f5dfc12c9ed4608933edeb6b1effcef) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:14.318835 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 82575517299b4e69a0871714dde9aacc with delete_type TABLET_DATA_DELETED (replaced by tablet bc5222713e384199a016d5e928db8172) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:14.319337 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 022c9c0d19ac450cb270319004886fe2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:14.319830 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet e1d4dc7d18f7448880b79af99283c99f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:14.320326 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 9e317c8dc24e481abb709e932fa39c29 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:14.320834 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 5830296559264b609909486aa15c9e2e with delete_type TABLET_DATA_DELETED (replaced by tablet 6f9cdf8a71f24b7fb820d12c75a226fd) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:14.321708 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 52e93348b205408f83efff27fde48e9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52e93348b205408f83efff27fde48e9b already in progress: creating tablet
W20251215 14:55:14.322265 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 82575517299b4e69a0871714dde9aacc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82575517299b4e69a0871714dde9aacc already in progress: creating tablet
W20251215 14:55:14.322721 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 022c9c0d19ac450cb270319004886fe2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 022c9c0d19ac450cb270319004886fe2 already in progress: creating tablet
W20251215 14:55:14.323114 8775 catalog_manager.cc:4952] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet e1d4dc7d18f7448880b79af99283c99f because the tablet was not found. No further retry: Not found: Tablet not found: e1d4dc7d18f7448880b79af99283c99f
W20251215 14:55:14.324460 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 9e317c8dc24e481abb709e932fa39c29 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e317c8dc24e481abb709e932fa39c29 already in progress: creating tablet
W20251215 14:55:14.324901 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 5830296559264b609909486aa15c9e2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5830296559264b609909486aa15c9e2e already in progress: creating tablet
I20251215 14:55:14.337818 8782 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d91b7818df7d462e931287fb2e5a382b" } modify_external_catalogs: true
W20251215 14:55:14.338187 8785 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet de5ba7f2b5c84ac39e4019a0b9532176 consensus state has no leader
I20251215 14:55:14.338330 8782 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d91b7818df7d462e931287fb2e5a382b" } modify_external_catalogs: true
I20251215 14:55:14.271399 9020 tablet_service.cc:1505] Processing CreateTablet for tablet 5bd1578d434047158b6fbce7c24daebb (DEFAULT_TABLE table=default.Table_aeb325b8434f4db1a2a44761b1df1e6d [id=59ae80a72ff4469ca461cc61bac17fa9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.349548 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bd1578d434047158b6fbce7c24daebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.279691 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "08ca9ee6b76b4b13b7bc26d65dcc3979" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:14.302094 9015 tablet_service.cc:1552] Processing DeleteTablet for tablet 52e93348b205408f83efff27fde48e9b with delete_type TABLET_DATA_DELETED (replaced by tablet 3f5dfc12c9ed4608933edeb6b1effcef) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:14.302280 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 82575517299b4e69a0871714dde9aacc with delete_type TABLET_DATA_DELETED (replaced by tablet bc5222713e384199a016d5e928db8172) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:14.302415 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet 022c9c0d19ac450cb270319004886fe2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:14.302531 9008 tablet_service.cc:1552] Processing DeleteTablet for tablet e1d4dc7d18f7448880b79af99283c99f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:14.302670 9006 tablet_service.cc:1552] Processing DeleteTablet for tablet 9e317c8dc24e481abb709e932fa39c29 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:14.309646 9009 tablet_service.cc:1552] Processing DeleteTablet for tablet 5830296559264b609909486aa15c9e2e with delete_type TABLET_DATA_DELETED (replaced by tablet 6f9cdf8a71f24b7fb820d12c75a226fd) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:14.317130 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0a74645593d46fcbc0235ec6a4670d8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:14.352030 9042 raft_consensus.cc:2468] T a0a74645593d46fcbc0235ec6a4670d8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:14.344919 9014 tablet_service.cc:1505] Processing CreateTablet for tablet 6d6e5f5227974610b686e23da5501f4a (DEFAULT_TABLE table=default.Table_2b278e1d2cf048e9ae8f76002a70b7b3 [id=2041932506a84ce18c4e7bc35467d8e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.346508 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 9a4c7bd7d0984ef788fe2c0504058c37 (DEFAULT_TABLE table=default.Table_e3c47d33c0ce4867b5237b931499b82b [id=06ba690e924a48d8a77a76a222eca498]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.348510 9427 tablet_bootstrap.cc:492] T 35326e99d413431583b25d11269d09dc P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:14.352589 9427 ts_tablet_manager.cc:1403] T 35326e99d413431583b25d11269d09dc P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.264s user 0.023s sys 0.054s
I20251215 14:55:14.353061 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4c7bd7d0984ef788fe2c0504058c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.353551 9427 raft_consensus.cc:359] T 35326e99d413431583b25d11269d09dc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.353816 9427 raft_consensus.cc:385] T 35326e99d413431583b25d11269d09dc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:14.353951 9427 raft_consensus.cc:740] T 35326e99d413431583b25d11269d09dc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:14.354231 9427 consensus_queue.cc:260] T 35326e99d413431583b25d11269d09dc P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.354966 9427 ts_tablet_manager.cc:1434] T 35326e99d413431583b25d11269d09dc P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:14.355327 9427 tablet_bootstrap.cc:492] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:14.355842 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d6e5f5227974610b686e23da5501f4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.357295 9427 tablet_bootstrap.cc:654] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:14.358971 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 52e93348b205408f83efff27fde48e9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52e93348b205408f83efff27fde48e9b already in progress: creating tablet
W20251215 14:55:14.359359 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 82575517299b4e69a0871714dde9aacc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82575517299b4e69a0871714dde9aacc already in progress: creating tablet
W20251215 14:55:14.359578 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 022c9c0d19ac450cb270319004886fe2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 022c9c0d19ac450cb270319004886fe2 already in progress: creating tablet
W20251215 14:55:14.359814 8772 catalog_manager.cc:4952] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet e1d4dc7d18f7448880b79af99283c99f because the tablet was not found. No further retry: Not found: Tablet not found: e1d4dc7d18f7448880b79af99283c99f
W20251215 14:55:14.360016 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 9e317c8dc24e481abb709e932fa39c29 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e317c8dc24e481abb709e932fa39c29 already in progress: creating tablet
W20251215 14:55:14.360225 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 5830296559264b609909486aa15c9e2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5830296559264b609909486aa15c9e2e already in progress: creating tablet
I20251215 14:55:14.361315 10269 leader_election.cc:290] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:14.363145 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "accc3fdaf8e64b0f96b45150a59516bf" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:14.363473 9305 raft_consensus.cc:3060] T accc3fdaf8e64b0f96b45150a59516bf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:14.366681 9435 tablet_bootstrap.cc:492] T 2811b8ffdb614c91b0d3d4e6e039245b P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:14.366837 9435 ts_tablet_manager.cc:1403] T 2811b8ffdb614c91b0d3d4e6e039245b P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.258s user 0.004s sys 0.000s
I20251215 14:55:14.367985 9305 raft_consensus.cc:2468] T accc3fdaf8e64b0f96b45150a59516bf P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:14.368402 8784 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_038be3c83b73426c8567ae0303533ced" } new_table_name: "default.Table_81e49c588c6041d084a89c30f86daec7" modify_external_catalogs: true
I20251215 14:55:14.368113 9435 raft_consensus.cc:359] T 2811b8ffdb614c91b0d3d4e6e039245b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.369382 9435 raft_consensus.cc:385] T 2811b8ffdb614c91b0d3d4e6e039245b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:14.369486 9435 raft_consensus.cc:740] T 2811b8ffdb614c91b0d3d4e6e039245b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:14.369737 9435 consensus_queue.cc:260] T 2811b8ffdb614c91b0d3d4e6e039245b P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.370440 9435 ts_tablet_manager.cc:1434] T 2811b8ffdb614c91b0d3d4e6e039245b P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:14.372041 8786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e721697e900b48b6b27e0abb6c829ff8" } modify_external_catalogs: true
I20251215 14:55:14.372174 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 9a4c7bd7d0984ef788fe2c0504058c37 (DEFAULT_TABLE table=default.Table_e3c47d33c0ce4867b5237b931499b82b [id=06ba690e924a48d8a77a76a222eca498]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.372296 8786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e721697e900b48b6b27e0abb6c829ff8" } modify_external_catalogs: true
I20251215 14:55:14.374624 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_2a2fc82ab42c48c5a4d85f40b9b79901"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.375236 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a2fc82ab42c48c5a4d85f40b9b79901 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.375466 8785 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet e0c88310853f47b0aa1af9a3d676bef6 (table default.Table_6b689570cd944426b4edf8342163ef0e [id=d0891c1ad38b48348b350482a3298f39]). Expected version 1 got 0
I20251215 14:55:14.378559 9435 tablet_bootstrap.cc:492] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:14.380995 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4c7bd7d0984ef788fe2c0504058c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.383023 8780 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 2811b8ffdb614c91b0d3d4e6e039245b (table default.Table_12b99071f9224445935f70cba021453f [id=53315a8cf3bd4a05b1c5e30fd0acdd56]). Expected version 1 got 0
I20251215 14:55:14.387741 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 41e0d694b1af46b19138ccbffea96f28 (DEFAULT_TABLE table=default.Table_09a33207f66546398b5669c9294fa726 [id=a655e5face5241248e9156493dccf3b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.388195 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e0d694b1af46b19138ccbffea96f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.391901 9014 tablet_service.cc:1505] Processing CreateTablet for tablet 96a1de7ce5f64f348585926ac05ddb87 (DEFAULT_TABLE table=default.Table_e721697e900b48b6b27e0abb6c829ff8 [id=c1b7ece4283c41b2842b5d94c6b3a9c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.392293 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a1de7ce5f64f348585926ac05ddb87. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.392716 9290 tablet_service.cc:1505] Processing CreateTablet for tablet 41e0d694b1af46b19138ccbffea96f28 (DEFAULT_TABLE table=default.Table_09a33207f66546398b5669c9294fa726 [id=a655e5face5241248e9156493dccf3b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.393064 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e0d694b1af46b19138ccbffea96f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.395692 9020 tablet_service.cc:1505] Processing CreateTablet for tablet d064a85455844115899b3de91a2313f5 (DEFAULT_TABLE table=default.Table_28b26a7c5358471e9bd8528c1380cdf3 [id=c51d4adba26244c190a29d353d3fd2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.396056 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d064a85455844115899b3de91a2313f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.401721 8780 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 2811b8ffdb614c91b0d3d4e6e039245b (table default.Table_12b99071f9224445935f70cba021453f [id=53315a8cf3bd4a05b1c5e30fd0acdd56]). Expected version 1 got 0
I20251215 14:55:14.406807 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "accc3fdaf8e64b0f96b45150a59516bf" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:14.407795 9157 tablet_service.cc:1552] Processing DeleteTablet for tablet 605da10c8d3049e8b94caa9738576aab with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:14.408008 9290 tablet_service.cc:1505] Processing CreateTablet for tablet 96a1de7ce5f64f348585926ac05ddb87 (DEFAULT_TABLE table=default.Table_e721697e900b48b6b27e0abb6c829ff8 [id=c1b7ece4283c41b2842b5d94c6b3a9c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.408483 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a1de7ce5f64f348585926ac05ddb87. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.409677 10367 tablet.cc:1722] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:14.413901 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c9b9e88efddf4c879e3987b947dd7645"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.414496 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c9b9e88efddf4c879e3987b947dd7645 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.416002 8779 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_6c09c786139c45b7aafd6b42938df236" } new_table_name: "default.Table_8b8a9e9ac41a4cf0b47d6c5fd4594684" modify_external_catalogs: true
I20251215 14:55:14.417327 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_a10c0cc456a1432dbc6d031881098356"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.417909 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a10c0cc456a1432dbc6d031881098356 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.420228 9144 tablet_service.cc:1505] Processing CreateTablet for tablet 6d6e5f5227974610b686e23da5501f4a (DEFAULT_TABLE table=default.Table_2b278e1d2cf048e9ae8f76002a70b7b3 [id=2041932506a84ce18c4e7bc35467d8e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.420264 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_19a900b1074c49aea1849cce3d74bf77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:14.420814 9147 tablet_service.cc:1552] Processing DeleteTablet for tablet 52e93348b205408f83efff27fde48e9b with delete_type TABLET_DATA_DELETED (replaced by tablet 3f5dfc12c9ed4608933edeb6b1effcef) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:14.421006 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19a900b1074c49aea1849cce3d74bf77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.421032 9156 tablet_service.cc:1552] Processing DeleteTablet for tablet e1d4dc7d18f7448880b79af99283c99f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:14.421202 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0a74645593d46fcbc0235ec6a4670d8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:14.421584 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b686ad43973448c8e24230d7d1d7250. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.426434 10289 raft_consensus.cc:493] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:14.426596 10289 raft_consensus.cc:515] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.427259 10289 leader_election.cc:290] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:14.427702 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d6e5f5227974610b686e23da5501f4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.428675 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 6d6e5f5227974610b686e23da5501f4a (DEFAULT_TABLE table=default.Table_2b278e1d2cf048e9ae8f76002a70b7b3 [id=2041932506a84ce18c4e7bc35467d8e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.429100 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d6e5f5227974610b686e23da5501f4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.432821 9278 tablet_service.cc:1505] Processing CreateTablet for tablet d064a85455844115899b3de91a2313f5 (DEFAULT_TABLE table=default.Table_28b26a7c5358471e9bd8528c1380cdf3 [id=c51d4adba26244c190a29d353d3fd2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.433233 9278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d064a85455844115899b3de91a2313f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.434437 9157 tablet_service.cc:1552] Processing DeleteTablet for tablet 5830296559264b609909486aa15c9e2e with delete_type TABLET_DATA_DELETED (replaced by tablet 6f9cdf8a71f24b7fb820d12c75a226fd) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:14.443964 8785 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_2f427312900a49008b3119b4008c5658" } new_table_name: "default.Table_b72e710c503a43c6a815fc53ae465467" modify_external_catalogs: true
I20251215 14:55:14.445578 9175 raft_consensus.cc:3060] T 30c5c795ea4a4fe591cdf63320ec2521 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:14.448060 9248 leader_election.cc:304] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:14.448911 10395 raft_consensus.cc:2804] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:14.448997 10395 raft_consensus.cc:493] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:14.449083 10395 raft_consensus.cc:3060] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:14.449167 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "accc3fdaf8e64b0f96b45150a59516bf" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:14.452325 10395 raft_consensus.cc:515] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.453935 9115 leader_election.cc:304] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
W20251215 14:55:14.455099 8976 leader_election.cc:343] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:14.455530 8976 consensus_peers.cc:597] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:14.455777 10395 leader_election.cc:290] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:14.455780 8976 leader_election.cc:343] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:14.455947 8976 consensus_peers.cc:597] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20251215 14:55:14.456204 8976 consensus_peers.cc:597] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:14.448570 9278 tablet_service.cc:1505] Processing CreateTablet for tablet 02e391ec04cf44c881f31d0ba53af2e9 (DEFAULT_TABLE table=default.Table_4d5258590238424887a68af4bb147a93 [id=79b50ff6d61947b8a5be117930c21ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.456804 9278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02e391ec04cf44c881f31d0ba53af2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.457222 9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bd1578d434047158b6fbce7c24daebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.458387 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bafc5063058a469bb9c9b3e5345eb1be" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:14.458599 9178 raft_consensus.cc:2468] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:14.465847 8825 master_runner.cc:186] Error getting master registration for 127.8.121.190:44279: Network error: Client connection negotiation failed: client connection to 127.8.121.190:44279: connect: Connection refused (error 111),
I20251215 14:55:14.466001 8825 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251215 14:55:14.466192 9507 raft_consensus.cc:2749] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:14.466850 9435 tablet_bootstrap.cc:654] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:14.467398 8976 leader_election.cc:304] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:14.467828 10269 raft_consensus.cc:2804] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 14:55:14.467969 10269 raft_consensus.cc:493] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:14.468122 10269 raft_consensus.cc:3060] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:14.470937 10269 raft_consensus.cc:515] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.472884 8978 leader_election.cc:304] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:14.473291 10289 raft_consensus.cc:2804] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:14.473430 10289 raft_consensus.cc:697] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:14.473677 10289 consensus_queue.cc:237] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.475512 9427 tablet_bootstrap.cc:492] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:14.475694 9427 ts_tablet_manager.cc:1403] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.120s user 0.030s sys 0.017s
I20251215 14:55:14.476552 9427 raft_consensus.cc:359] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.476856 9427 raft_consensus.cc:385] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:14.476981 9427 raft_consensus.cc:740] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:14.477349 9427 consensus_queue.cc:260] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.479058 9427 ts_tablet_manager.cc:1434] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:14.480553 9427 tablet_bootstrap.cc:492] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:14.482590 9427 tablet_bootstrap.cc:654] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:14.488098 9020 tablet_service.cc:1552] Processing DeleteTablet for tablet 35326e99d413431583b25d11269d09dc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:12 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:14.488440 10141 tablet_replica.cc:333] T 35326e99d413431583b25d11269d09dc P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:14.488657 10141 raft_consensus.cc:2243] T 35326e99d413431583b25d11269d09dc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:14.488844 10141 raft_consensus.cc:2272] T 35326e99d413431583b25d11269d09dc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:14.489791 10141 ts_tablet_manager.cc:1916] T 35326e99d413431583b25d11269d09dc P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:14.493291 8788 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_52a6dc1585e14a438b227b8a04e0dc72" } modify_external_catalogs: true
I20251215 14:55:14.493525 8788 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_52a6dc1585e14a438b227b8a04e0dc72" } modify_external_catalogs: true
I20251215 14:55:14.495633 10269 leader_election.cc:290] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:14.497392 9427 tablet_bootstrap.cc:492] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:14.498214 9427 ts_tablet_manager.cc:1403] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.004s
I20251215 14:55:14.499773 9146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ea937af02b447e6a78cda0741cc8570. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.499805 9427 raft_consensus.cc:359] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.500849 9427 raft_consensus.cc:385] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:14.501134 9427 raft_consensus.cc:740] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:14.501686 9427 consensus_queue.cc:260] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.502380 10289 raft_consensus.cc:493] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:14.502519 10289 raft_consensus.cc:515] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.502710 9427 ts_tablet_manager.cc:1434] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:14.503094 10289 leader_election.cc:290] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:14.503718 10141 ts_tablet_manager.cc:1929] T 35326e99d413431583b25d11269d09dc P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251215 14:55:14.503877 10141 log.cc:1199] T 35326e99d413431583b25d11269d09dc P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/35326e99d413431583b25d11269d09dc
I20251215 14:55:14.504120 9427 tablet_bootstrap.cc:492] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:14.504307 10141 ts_tablet_manager.cc:1950] T 35326e99d413431583b25d11269d09dc P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:14.506376 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0a74645593d46fcbc0235ec6a4670d8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:14.506559 9042 raft_consensus.cc:3060] T a0a74645593d46fcbc0235ec6a4670d8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:14.507229 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 35326e99d413431583b25d11269d09dc (table default.Table_7624bbb38e9c499390f53c92673ed169 [id=41f7f84b468f4860b54a4544d236cecc]) successfully deleted
I20251215 14:55:14.507642 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2811b8ffdb614c91b0d3d4e6e039245b" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:14.508344 8976 leader_election.cc:343] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:14.509079 9042 raft_consensus.cc:2468] T a0a74645593d46fcbc0235ec6a4670d8 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:14.510695 9427 tablet_bootstrap.cc:654] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:14.511459 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bafc5063058a469bb9c9b3e5345eb1be" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:14.511462 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bafc5063058a469bb9c9b3e5345eb1be" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:14.511718 9305 raft_consensus.cc:2468] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:14.512776 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0a74645593d46fcbc0235ec6a4670d8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:14.512919 9020 tablet_service.cc:1505] Processing CreateTablet for tablet 02e391ec04cf44c881f31d0ba53af2e9 (DEFAULT_TABLE table=default.Table_4d5258590238424887a68af4bb147a93 [id=79b50ff6d61947b8a5be117930c21ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.513321 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02e391ec04cf44c881f31d0ba53af2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.520210 9427 tablet_bootstrap.cc:492] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:14.520960 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2811b8ffdb614c91b0d3d4e6e039245b" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:14.521088 9427 ts_tablet_manager.cc:1403] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.003s
I20251215 14:55:14.521163 9315 raft_consensus.cc:2468] T 2811b8ffdb614c91b0d3d4e6e039245b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:14.521957 9427 raft_consensus.cc:359] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.523484 9427 raft_consensus.cc:385] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:14.523841 9427 raft_consensus.cc:740] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:14.524250 9427 consensus_queue.cc:260] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.524765 8978 leader_election.cc:304] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:14.525309 10269 raft_consensus.cc:2804] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:14.525444 10269 raft_consensus.cc:493] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:14.525549 10269 raft_consensus.cc:3060] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:14.528430 10269 raft_consensus.cc:515] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.529522 9248 leader_election.cc:304] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:14.529711 10269 leader_election.cc:290] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:14.529990 10144 raft_consensus.cc:2804] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:14.530139 10144 raft_consensus.cc:697] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:14.530406 10144 consensus_queue.cc:237] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.530534 9427 ts_tablet_manager.cc:1434] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20251215 14:55:14.531482 9427 tablet_bootstrap.cc:492] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:14.534022 9427 tablet_bootstrap.cc:654] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:14.543807 9249 leader_election.cc:343] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:14.544585 9249 leader_election.cc:343] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:14.546078 9426 tablet_bootstrap.cc:492] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:14.548610 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bafc5063058a469bb9c9b3e5345eb1be" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:14.549733 9157 tablet_service.cc:1505] Processing CreateTablet for tablet 96a1de7ce5f64f348585926ac05ddb87 (DEFAULT_TABLE table=default.Table_e721697e900b48b6b27e0abb6c829ff8 [id=c1b7ece4283c41b2842b5d94c6b3a9c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.550186 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96a1de7ce5f64f348585926ac05ddb87. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.557343 9155 tablet_service.cc:1505] Processing CreateTablet for tablet 41e0d694b1af46b19138ccbffea96f28 (DEFAULT_TABLE table=default.Table_09a33207f66546398b5669c9294fa726 [id=a655e5face5241248e9156493dccf3b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.558204 9156 tablet_service.cc:1505] Processing CreateTablet for tablet d064a85455844115899b3de91a2313f5 (DEFAULT_TABLE table=default.Table_28b26a7c5358471e9bd8528c1380cdf3 [id=c51d4adba26244c190a29d353d3fd2a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.559971 10345 consensus_queue.cc:1048] T 2d75636265f14a428aae592438064ea2 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:14.561417 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e0d694b1af46b19138ccbffea96f28. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.562144 9435 tablet_bootstrap.cc:492] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:14.562292 9435 ts_tablet_manager.cc:1403] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.184s user 0.004s sys 0.001s
I20251215 14:55:14.562834 9156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d064a85455844115899b3de91a2313f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.563009 9435 raft_consensus.cc:359] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.563210 9435 raft_consensus.cc:385] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:14.563280 9435 raft_consensus.cc:740] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:14.563484 9435 consensus_queue.cc:260] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.564092 9426 ts_tablet_manager.cc:1403] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.525s user 0.089s sys 0.125s
I20251215 14:55:14.565193 9144 tablet_service.cc:1505] Processing CreateTablet for tablet 9a4c7bd7d0984ef788fe2c0504058c37 (DEFAULT_TABLE table=default.Table_e3c47d33c0ce4867b5237b931499b82b [id=06ba690e924a48d8a77a76a222eca498]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.565733 9178 raft_consensus.cc:3060] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:14.569861 9020 tablet_service.cc:1505] Processing CreateTablet for tablet 21437c9162f1435485dde5fca3522be1 (DEFAULT_TABLE table=default.Table_d91b7818df7d462e931287fb2e5a382b [id=4d159340e83941f3b6a402b829dfcca5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.570327 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21437c9162f1435485dde5fca3522be1. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:14.573177 8772 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.8.121.190:44279: connect: Connection refused (error 111) [suppressed 10 similar messages]
I20251215 14:55:14.573374 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 5e5c1626a30444bf987a7d7e09a586f7 (DEFAULT_TABLE table=default.Table_7f1131563cdd40e6a3e28615d4340538 [id=cd317b83fc264aa09cd8833ce85a5dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.573828 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e5c1626a30444bf987a7d7e09a586f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.565605 9147 tablet_service.cc:1505] Processing CreateTablet for tablet 02e391ec04cf44c881f31d0ba53af2e9 (DEFAULT_TABLE table=default.Table_4d5258590238424887a68af4bb147a93 [id=79b50ff6d61947b8a5be117930c21ccd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.579845 9172 raft_consensus.cc:3060] T ff4508c5a110427eb4d9d2eaaadace0b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:14.589761 8784 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7d2d13e4c8448cab4a430aca9322525 has no consensus state
I20251215 14:55:14.591254 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2811b8ffdb614c91b0d3d4e6e039245b" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:14.592550 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet a0a74645593d46fcbc0235ec6a4670d8
W20251215 14:55:14.592753 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet fc50995f6d934b58ab5f6f6f370cb7e5
W20251215 14:55:14.592861 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet accc3fdaf8e64b0f96b45150a59516bf
I20251215 14:55:14.593068 8787 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_34f674e6f3e34e739110435de6af285e" } modify_external_catalogs: true
I20251215 14:55:14.593267 8787 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_34f674e6f3e34e739110435de6af285e" } modify_external_catalogs: true
I20251215 14:55:14.593355 8784 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_3fa36ab140804466ab3cec1bc2051b26" } modify_external_catalogs: true
I20251215 14:55:14.593564 8784 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_3fa36ab140804466ab3cec1bc2051b26" } modify_external_catalogs: true
I20251215 14:55:14.595021 8786 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 96a1de7ce5f64f348585926ac05ddb87
I20251215 14:55:14.595878 8782 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 21437c9162f1435485dde5fca3522be1
I20251215 14:55:14.595988 9152 tablet_service.cc:1505] Processing CreateTablet for tablet 5e5c1626a30444bf987a7d7e09a586f7 (DEFAULT_TABLE table=default.Table_7f1131563cdd40e6a3e28615d4340538 [id=cd317b83fc264aa09cd8833ce85a5dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.596603 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_39c1b03aa3924af79af743a252c7d5c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:14.596750 9153 tablet_service.cc:1505] Processing CreateTablet for tablet 4f49d57104554c91a13229d3940cd4d2 (DEFAULT_TABLE table=default.Table_ac906fad456547a58529672569b9bb2c [id=4ccdba3ad9614f349eda1d546d369c13]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:14.597087 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39c1b03aa3924af79af743a252c7d5c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.598127 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_1becf6c1cac5471f8f5f17e00d4438ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.598709 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1becf6c1cac5471f8f5f17e00d4438ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.602330 9157 tablet_service.cc:1505] Processing CreateTablet for tablet 21437c9162f1435485dde5fca3522be1 (DEFAULT_TABLE table=default.Table_d91b7818df7d462e931287fb2e5a382b [id=4d159340e83941f3b6a402b829dfcca5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.602591 10269 raft_consensus.cc:493] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:14.602746 10269 raft_consensus.cc:515] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.603281 9943 ts_tablet_manager.cc:1929] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:14.603386 10269 leader_election.cc:290] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:14.609052 9178 raft_consensus.cc:2468] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 2.
I20251215 14:55:14.611111 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4c7bd7d0984ef788fe2c0504058c37. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:14.611718 8976 leader_election.cc:343] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:14.612149 9019 tablet_service.cc:1552] Processing DeleteTablet for tablet 96a1de7ce5f64f348585926ac05ddb87 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:14.612206 9943 log.cc:1199] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/26754a74483c4c9580df93aae10e7de1
I20251215 14:55:14.612318 9153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f49d57104554c91a13229d3940cd4d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.613754 8976 leader_election.cc:304] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters: e89303a500544272b601d7c29be802b4
I20251215 14:55:14.614329 10289 raft_consensus.cc:2804] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 14:55:14.614475 10289 raft_consensus.cc:697] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [term 2 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:14.614724 10289 consensus_queue.cc:237] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.615065 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "034fec793ae74fcda0c73f1cea291311" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:14.615685 10357 consensus_queue.cc:1048] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:14.616073 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 96a1de7ce5f64f348585926ac05ddb87 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:14.617641 9152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e5c1626a30444bf987a7d7e09a586f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.618484 9943 ts_tablet_manager.cc:1950] T 26754a74483c4c9580df93aae10e7de1 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
W20251215 14:55:14.620074 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 96a1de7ce5f64f348585926ac05ddb87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96a1de7ce5f64f348585926ac05ddb87 already in progress: creating tablet
I20251215 14:55:14.620319 9427 tablet_bootstrap.cc:492] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
W20251215 14:55:14.620414 8976 leader_election.cc:343] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:14.620471 9427 ts_tablet_manager.cc:1403] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.089s user 0.006s sys 0.030s
I20251215 14:55:14.622634 9427 raft_consensus.cc:359] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:14.622745 8779 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d88741012a814d41ac074e86805f492d consensus state has no leader
I20251215 14:55:14.623281 9427 raft_consensus.cc:385] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:14.623390 8788 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 2b686ad43973448c8e24230d7d1d7250
I20251215 14:55:14.623615 9427 raft_consensus.cc:740] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:14.624133 9427 consensus_queue.cc:260] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:14.624945 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 2d75636265f14a428aae592438064ea2
I20251215 14:55:14.625176 9427 ts_tablet_manager.cc:1434] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20251215 14:55:14.625485 9427 tablet_bootstrap.cc:492] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:14.625437 8783 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_69b5e5c77c4b4399ba828d29b6f1c05b" } new_table_name: "default.Table_507be2a533134941a6b5d187e4e8ba52" modify_external_catalogs: true
W20251215 14:55:14.625933 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 58926ab073974e2c8b725d5061a544d5
I20251215 14:55:14.626713 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_0bc3164bd70c4c1694e54d73efe89b56"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:14.626830 8781 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d235d9c21993470fb94702fdd9e0a2e9" } new_table_name: "default.Table_d710e1c69ade44c38504cf34d30b96a9" modify_external_catalogs: true
I20251215 14:55:14.628309 10269 raft_consensus.cc:493] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:14.628496 10269 raft_consensus.cc:515] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.629141 10269 leader_election.cc:290] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:14.630129 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 11a5a6a0895c49648c910fa2ea3ca373
W20251215 14:55:14.630218 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bf4a899338f4bcfac099b5099a22f05
I20251215 14:55:14.630779 9427 tablet_bootstrap.cc:654] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:14.631701 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_fd0b666515c544278f9b9569cfd7783b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.632655 8785 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 798eb606957b4cf7a737ec1636437581 consensus state has no leader
W20251215 14:55:14.633742 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0bc3164bd70c4c1694e54d73efe89b56 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.635190 8779 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet a639396098a941249afd9c3560073131 (table default.Table_404807c380fa4483ac5e0545eb3028cd [id=5cc820ec2c8b427db1c89647b295363e]). Expected version 1 got 0
I20251215 14:55:14.635392 8779 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1]). Expected version 1 got 0
I20251215 14:55:14.636538 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_69c6adc66ccc4738a70b123a32b24b3c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.637012 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_69c6adc66ccc4738a70b123a32b24b3c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.635834 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_fecb4e1c13dc444394c2cbc55b44b7a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.638213 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fd0b666515c544278f9b9569cfd7783b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:14.641119 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fecb4e1c13dc444394c2cbc55b44b7a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.643652 9019 tablet_service.cc:1552] Processing DeleteTablet for tablet 2b686ad43973448c8e24230d7d1d7250 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:14.644145 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 21437c9162f1435485dde5fca3522be1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:14.645538 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:14.648083 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58926ab073974e2c8b725d5061a544d5" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:14.649397 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21437c9162f1435485dde5fca3522be1. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:14.650556 8976 leader_election.cc:343] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:14.652356 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 5e751be4722043928e6977c48c359aae
I20251215 14:55:14.652691 8784 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet bcbdc8b78c044cbdbdb7ebca9dfda8d2
W20251215 14:55:14.653824 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 2b686ad43973448c8e24230d7d1d7250 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b686ad43973448c8e24230d7d1d7250 already in progress: creating tablet
I20251215 14:55:14.654577 9019 tablet_service.cc:1552] Processing DeleteTablet for tablet 5e751be4722043928e6977c48c359aae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:14.658301 8772 catalog_manager.cc:4952] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 5e751be4722043928e6977c48c359aae because the tablet was not found. No further retry: Not found: Tablet not found: 5e751be4722043928e6977c48c359aae
I20251215 14:55:14.658394 9019 tablet_service.cc:1505] Processing CreateTablet for tablet 4f49d57104554c91a13229d3940cd4d2 (DEFAULT_TABLE table=default.Table_ac906fad456547a58529672569b9bb2c [id=4ccdba3ad9614f349eda1d546d369c13]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.658473 9014 tablet_service.cc:1505] Processing CreateTablet for tablet 18c0b2442bcd4fb69d7d9a4f5fb46061 (DEFAULT_TABLE table=default.Table_1371ea4ec00049d0b1653642d8cccf63 [id=21c17f588a3146df80243f84250826cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.658871 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f49d57104554c91a13229d3940cd4d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.582065 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2811b8ffdb614c91b0d3d4e6e039245b" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:14.659348 9305 raft_consensus.cc:3060] T 2811b8ffdb614c91b0d3d4e6e039245b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:14.661974 9435 ts_tablet_manager.cc:1434] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.100s user 0.000s sys 0.002s
I20251215 14:55:14.662111 9305 raft_consensus.cc:2468] T 2811b8ffdb614c91b0d3d4e6e039245b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:14.587126 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 5e5c1626a30444bf987a7d7e09a586f7 (DEFAULT_TABLE table=default.Table_7f1131563cdd40e6a3e28615d4340538 [id=cd317b83fc264aa09cd8833ce85a5dba]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.662295 9435 tablet_bootstrap.cc:492] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:14.662586 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e5c1626a30444bf987a7d7e09a586f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.663548 9009 tablet_service.cc:1505] Processing CreateTablet for tablet cf18d0368ee948a38d35ec47b732f6cc (DEFAULT_TABLE table=default.Table_f898e8de467442898e4adb8820306601 [id=aa5585193a5b4ccd83b231eab0fbf5c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.587082 9290 tablet_service.cc:1505] Processing CreateTablet for tablet 21437c9162f1435485dde5fca3522be1 (DEFAULT_TABLE table=default.Table_d91b7818df7d462e931287fb2e5a382b [id=4d159340e83941f3b6a402b829dfcca5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.664991 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21437c9162f1435485dde5fca3522be1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.665100 9009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf18d0368ee948a38d35ec47b732f6cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.667675 8978 leader_election.cc:304] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:14.668164 10434 raft_consensus.cc:2804] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:14.668308 10434 raft_consensus.cc:697] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:14.668473 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c0b2442bcd4fb69d7d9a4f5fb46061. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.668551 10434 consensus_queue.cc:237] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.675276 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_bbbfcbf7cf704bc9b55fd2cf41a7ab5e [id=cbafb4499c90447d8f185928d3e58b20]) successfully deleted
W20251215 14:55:14.678123 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 65ea0509d8eb42bdb2291ff01e8d3bd6
I20251215 14:55:14.680866 9147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02e391ec04cf44c881f31d0ba53af2e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.682633 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet 96a1de7ce5f64f348585926ac05ddb87 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:14.684446 9426 raft_consensus.cc:359] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.684724 9426 raft_consensus.cc:385] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:14.684832 9426 raft_consensus.cc:740] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:14.685084 9426 consensus_queue.cc:260] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.685691 9426 ts_tablet_manager.cc:1434] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.121s user 0.000s sys 0.002s
W20251215 14:55:14.686664 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 65ea0509d8eb42bdb2291ff01e8d3bd6
I20251215 14:55:14.687207 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet 21437c9162f1435485dde5fca3522be1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:14.689502 9278 tablet_service.cc:1505] Processing CreateTablet for tablet 4f49d57104554c91a13229d3940cd4d2 (DEFAULT_TABLE table=default.Table_ac906fad456547a58529672569b9bb2c [id=4ccdba3ad9614f349eda1d546d369c13]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.689954 9278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f49d57104554c91a13229d3940cd4d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.692262 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 2b686ad43973448c8e24230d7d1d7250 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:14.693145 9943 tablet_replica.cc:333] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:14.693776 9020 tablet_service.cc:1552] Processing DeleteTablet for tablet 21437c9162f1435485dde5fca3522be1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:14.694680 9943 raft_consensus.cc:2243] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:14.694907 9943 raft_consensus.cc:2272] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:14.695361 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 5e751be4722043928e6977c48c359aae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:14.697214 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 21437c9162f1435485dde5fca3522be1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21437c9162f1435485dde5fca3522be1 already in progress: creating tablet
I20251215 14:55:14.698159 9943 ts_tablet_manager.cc:1916] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:14.699245 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 18c0b2442bcd4fb69d7d9a4f5fb46061 (DEFAULT_TABLE table=default.Table_1371ea4ec00049d0b1653642d8cccf63 [id=21c17f588a3146df80243f84250826cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.700109 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet 5e751be4722043928e6977c48c359aae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:14.701006 9435 tablet_bootstrap.cc:654] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:14.701462 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet 2b686ad43973448c8e24230d7d1d7250 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:14.708278 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "034fec793ae74fcda0c73f1cea291311" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:14.702364 9295 tablet_service.cc:1505] Processing CreateTablet for tablet cf18d0368ee948a38d35ec47b732f6cc (DEFAULT_TABLE table=default.Table_f898e8de467442898e4adb8820306601 [id=aa5585193a5b4ccd83b231eab0fbf5c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.707664 9289 tablet_service.cc:1505] Processing CreateTablet for tablet 78c65aae2561484ebbd68d0a0475b27d (DEFAULT_TABLE table=default.Table_1e4d9ebb532f4e8c9ffc36b6b690d502 [id=a0e1f90c75fb4d8f9557b10f5cfac2a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.709388 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c65aae2561484ebbd68d0a0475b27d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.716051 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58926ab073974e2c8b725d5061a544d5" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:14.701742 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 18c0b2442bcd4fb69d7d9a4f5fb46061 (DEFAULT_TABLE table=default.Table_1371ea4ec00049d0b1653642d8cccf63 [id=21c17f588a3146df80243f84250826cf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.716683 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c0b2442bcd4fb69d7d9a4f5fb46061. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.722235 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf18d0368ee948a38d35ec47b732f6cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.707932 9020 tablet_service.cc:1505] Processing CreateTablet for tablet 78c65aae2561484ebbd68d0a0475b27d (DEFAULT_TABLE table=default.Table_1e4d9ebb532f4e8c9ffc36b6b690d502 [id=a0e1f90c75fb4d8f9557b10f5cfac2a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.723909 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c65aae2561484ebbd68d0a0475b27d. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:14.727244 8783 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a51cf25aab09432f92bbd3235c2ada56 consensus state has no leader
I20251215 14:55:14.731637 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18c0b2442bcd4fb69d7d9a4f5fb46061. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.733032 10289 consensus_queue.cc:1048] T ff4508c5a110427eb4d9d2eaaadace0b P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:14.735786 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 96a1de7ce5f64f348585926ac05ddb87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96a1de7ce5f64f348585926ac05ddb87 already in progress: creating tablet
W20251215 14:55:14.736337 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 38e50a7f2bdd4907ab41436b59397ea6
I20251215 14:55:14.736871 8783 catalog_manager.cc:5654] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 reported cstate change: term changed from 0 to 2, leader changed from <none> to 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129). New cstate: current_term: 2 leader_uuid: "67978ac4539d4b289e53f4eedd9a8156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:14.737473 8783 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_66a863188e16424797450ead992a2bba [id=066e8ae14004436cb8b4f3f740b45b19]). Expected version 5 got 0
W20251215 14:55:14.738337 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 21437c9162f1435485dde5fca3522be1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21437c9162f1435485dde5fca3522be1 already in progress: creating tablet
W20251215 14:55:14.738617 8775 catalog_manager.cc:4952] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 5e751be4722043928e6977c48c359aae because the tablet was not found. No further retry: Not found: Tablet not found: 5e751be4722043928e6977c48c359aae
W20251215 14:55:14.738883 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 2b686ad43973448c8e24230d7d1d7250 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b686ad43973448c8e24230d7d1d7250 already in progress: creating tablet
W20251215 14:55:14.739632 8978 leader_election.cc:343] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:14.739790 8978 leader_election.cc:304] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
W20251215 14:55:14.741969 8978 leader_election.cc:343] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:14.742173 8978 leader_election.cc:304] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:14.742486 10357 raft_consensus.cc:2749] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:14.742660 10357 consensus_queue.cc:1048] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:14.743053 10357 raft_consensus.cc:2749] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:14.748775 9006 tablet_service.cc:1505] Processing CreateTablet for tablet 3a4767a5965244afac42190f97f0a113 (DEFAULT_TABLE table=default.Table_d254592e0f274292acd8700ab11b09dc [id=1b17d052de8b447ca7c8029604c21a13]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.749235 9006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4767a5965244afac42190f97f0a113. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.749564 10357 consensus_queue.cc:1048] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:14.752311 9008 tablet_service.cc:1505] Processing CreateTablet for tablet c4929bdb04914251b75a11d6936f1ee0 (DEFAULT_TABLE table=default.Table_c9ff0075955547bfba3e55a69194c7e7 [id=6b041a10b7564a04b253f8024c26bddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.752717 9008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4929bdb04914251b75a11d6936f1ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.755957 9155 tablet_service.cc:1505] Processing CreateTablet for tablet 78c65aae2561484ebbd68d0a0475b27d (DEFAULT_TABLE table=default.Table_1e4d9ebb532f4e8c9ffc36b6b690d502 [id=a0e1f90c75fb4d8f9557b10f5cfac2a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.756628 9154 tablet_service.cc:1505] Processing CreateTablet for tablet 3a4767a5965244afac42190f97f0a113 (DEFAULT_TABLE table=default.Table_d254592e0f274292acd8700ab11b09dc [id=1b17d052de8b447ca7c8029604c21a13]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.756839 9146 tablet_service.cc:1505] Processing CreateTablet for tablet cf18d0368ee948a38d35ec47b732f6cc (DEFAULT_TABLE table=default.Table_f898e8de467442898e4adb8820306601 [id=aa5585193a5b4ccd83b231eab0fbf5c8]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:14.757357 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 82575517299b4e69a0871714dde9aacc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 82575517299b4e69a0871714dde9aacc already in progress: creating tablet
W20251215 14:55:14.758172 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 022c9c0d19ac450cb270319004886fe2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 022c9c0d19ac450cb270319004886fe2 already in progress: creating tablet
I20251215 14:55:14.758328 9158 tablet_service.cc:1505] Processing CreateTablet for tablet c4929bdb04914251b75a11d6936f1ee0 (DEFAULT_TABLE table=default.Table_c9ff0075955547bfba3e55a69194c7e7 [id=6b041a10b7564a04b253f8024c26bddd]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:14.758631 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 9e317c8dc24e481abb709e932fa39c29 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9e317c8dc24e481abb709e932fa39c29 already in progress: creating tablet
I20251215 14:55:14.764648 8786 master_service.cc:954] ReplaceTablet: received request to replace tablet f4203c4941184a66956ec9be8d703bb6 from {username='slave'} at 127.0.0.1:49790
W20251215 14:55:14.776319 8781 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3dca27f234054f9582a2ca6c5e6f5cad consensus state has no leader
W20251215 14:55:14.776858 9249 consensus_peers.cc:597] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:14.782459 8781 master_service.cc:954] ReplaceTablet: received request to replace tablet 84477b0a4bd14522908cc28e7015e4f9 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:14.787771 9426 tablet_bootstrap.cc:492] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:14.793270 8976 consensus_peers.cc:597] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:14.795408 8781 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d906d0f5a04a4c73bb02b6621abb99db" } new_table_name: "default.Table_3060c957ad034dafb3040834508f89b0" modify_external_catalogs: true
I20251215 14:55:14.802610 8784 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_882b905fdf18495b8a6044986590f470" } modify_external_catalogs: true
I20251215 14:55:14.802886 8784 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_882b905fdf18495b8a6044986590f470" } modify_external_catalogs: true
I20251215 14:55:14.802882 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_98b70bc3cb6c4802ab6f0ee555dfea2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.803990 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_98b70bc3cb6c4802ab6f0ee555dfea2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.802651 8782 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_78c038b3edc449fab589e43dea2d2dbf" } modify_external_catalogs: true
I20251215 14:55:14.805545 8782 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_78c038b3edc449fab589e43dea2d2dbf" } modify_external_catalogs: true
W20251215 14:55:14.806427 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet ff4508c5a110427eb4d9d2eaaadace0b
I20251215 14:55:14.806468 9426 tablet_bootstrap.cc:654] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:14.813230 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7
I20251215 14:55:14.814394 9427 tablet_bootstrap.cc:492] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:14.814731 9427 ts_tablet_manager.cc:1403] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.189s user 0.001s sys 0.028s
I20251215 14:55:14.816390 9427 raft_consensus.cc:359] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.816793 9427 raft_consensus.cc:385] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:14.816880 9427 raft_consensus.cc:740] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:14.817241 9427 consensus_queue.cc:260] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.818414 9020 tablet_service.cc:1505] Processing CreateTablet for tablet 20f30d23a43f43749f6f9054a18a84a8 (DEFAULT_TABLE table=default.Table_0433e5253cac46ecbc41c52ec16dc574 [id=c53d9e6f96524e01a0ae541ac2bc2dc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.818926 9427 ts_tablet_manager.cc:1434] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:14.819089 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f30d23a43f43749f6f9054a18a84a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.819810 9427 tablet_bootstrap.cc:492] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:14.819983 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c65aae2561484ebbd68d0a0475b27d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.821472 9427 tablet_bootstrap.cc:654] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:14.823513 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4767a5965244afac42190f97f0a113. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.827521 9146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf18d0368ee948a38d35ec47b732f6cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.831351 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4929bdb04914251b75a11d6936f1ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.838932 9278 tablet_service.cc:1505] Processing CreateTablet for tablet c4929bdb04914251b75a11d6936f1ee0 (DEFAULT_TABLE table=default.Table_c9ff0075955547bfba3e55a69194c7e7 [id=6b041a10b7564a04b253f8024c26bddd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.839422 9278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4929bdb04914251b75a11d6936f1ee0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.839433 8780 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_8db54f1c2da24f868800c51c6a04bcce" } modify_external_catalogs: true
I20251215 14:55:14.839659 8780 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_8db54f1c2da24f868800c51c6a04bcce" } modify_external_catalogs: true
I20251215 14:55:14.846118 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_87776c5fb718487da0eb48c02df760ee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.846711 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87776c5fb718487da0eb48c02df760ee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.848820 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_f1d7edf50eeb4a12b5adc5dcdfd7314f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.849291 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1d7edf50eeb4a12b5adc5dcdfd7314f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.851331 9153 tablet_service.cc:1505] Processing CreateTablet for tablet 20f30d23a43f43749f6f9054a18a84a8 (DEFAULT_TABLE table=default.Table_0433e5253cac46ecbc41c52ec16dc574 [id=c53d9e6f96524e01a0ae541ac2bc2dc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.851707 9153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f30d23a43f43749f6f9054a18a84a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.855218 9158 tablet_service.cc:1505] Processing CreateTablet for tablet caefb83a990e4ad2baf621cd83265f96 (DEFAULT_TABLE table=default.Table_f3920bdde5354312bfcca61bffe77a6d [id=24f9ab438e6240c19eca8dbbe8253c6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.855643 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caefb83a990e4ad2baf621cd83265f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.856482 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 3a4767a5965244afac42190f97f0a113 (DEFAULT_TABLE table=default.Table_d254592e0f274292acd8700ab11b09dc [id=1b17d052de8b447ca7c8029604c21a13]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.857090 9014 tablet_service.cc:1505] Processing CreateTablet for tablet 7bacba021777416e9c547469aa08bd9c (DEFAULT_TABLE table=default.Table_e68dc91a90f94a24a7b878655bc92914 [id=00e9a46ec2f94f32a2250ee74c5fc2c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.857302 9154 tablet_service.cc:1505] Processing CreateTablet for tablet 2ca89ec0fe3647ad9c3e62d16640bb20 (DEFAULT_TABLE table=default.Table_f1d0fc0296494974b6b7f83f6dc2e4ab [id=d6ac05b5292840fc8108e61afb7f9e4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.857564 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bacba021777416e9c547469aa08bd9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.857759 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca89ec0fe3647ad9c3e62d16640bb20. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.858383 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a4767a5965244afac42190f97f0a113. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:14.865187 8976 consensus_peers.cc:597] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:14.865859 9289 tablet_service.cc:1505] Processing CreateTablet for tablet caefb83a990e4ad2baf621cd83265f96 (DEFAULT_TABLE table=default.Table_f3920bdde5354312bfcca61bffe77a6d [id=24f9ab438e6240c19eca8dbbe8253c6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.866190 10144 consensus_queue.cc:1048] T 82ca60c5a63744ffb0a0c0a140ef665e P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:14.865862 9290 tablet_service.cc:1505] Processing CreateTablet for tablet 7bacba021777416e9c547469aa08bd9c (DEFAULT_TABLE table=default.Table_e68dc91a90f94a24a7b878655bc92914 [id=00e9a46ec2f94f32a2250ee74c5fc2c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.858199 9155 tablet_service.cc:1505] Processing CreateTablet for tablet 7bacba021777416e9c547469aa08bd9c (DEFAULT_TABLE table=default.Table_e68dc91a90f94a24a7b878655bc92914 [id=00e9a46ec2f94f32a2250ee74c5fc2c5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.866844 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caefb83a990e4ad2baf621cd83265f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.868875 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 2ca89ec0fe3647ad9c3e62d16640bb20 (DEFAULT_TABLE table=default.Table_f1d0fc0296494974b6b7f83f6dc2e4ab [id=d6ac05b5292840fc8108e61afb7f9e4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.869220 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca89ec0fe3647ad9c3e62d16640bb20. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.873530 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bacba021777416e9c547469aa08bd9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.876392 9278 tablet_service.cc:1505] Processing CreateTablet for tablet 20f30d23a43f43749f6f9054a18a84a8 (DEFAULT_TABLE table=default.Table_0433e5253cac46ecbc41c52ec16dc574 [id=c53d9e6f96524e01a0ae541ac2bc2dc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.876761 9278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f30d23a43f43749f6f9054a18a84a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.885334 9943 ts_tablet_manager.cc:1929] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20251215 14:55:14.891057 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 30c5c795ea4a4fe591cdf63320ec2521
W20251215 14:55:14.893781 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 6ae72a1ded6e4faba1ad309d9a0e4a95
I20251215 14:55:14.896584 9943 log.cc:1199] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/605da10c8d3049e8b94caa9738576aab
I20251215 14:55:14.898728 9943 ts_tablet_manager.cc:1950] T 605da10c8d3049e8b94caa9738576aab P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:14.902640 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bacba021777416e9c547469aa08bd9c. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:14.907202 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 6ae72a1ded6e4faba1ad309d9a0e4a95
W20251215 14:55:14.907300 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 2d75636265f14a428aae592438064ea2
W20251215 14:55:14.907410 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet ff4508c5a110427eb4d9d2eaaadace0b
I20251215 14:55:14.907899 8785 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1]). Expected version 1 got 0
I20251215 14:55:14.908077 8785 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet e0c88310853f47b0aa1af9a3d676bef6 (table default.Table_6b689570cd944426b4edf8342163ef0e [id=d0891c1ad38b48348b350482a3298f39]). Expected version 1 got 0
I20251215 14:55:14.909318 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_2844d99ea0cb42e382043bde82f2ac75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.909914 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2844d99ea0cb42e382043bde82f2ac75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.910295 8786 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet f4203c4941184a66956ec9be8d703bb6
I20251215 14:55:14.910652 8786 catalog_manager.cc:6724] ReplaceTablet: tablet f4203c4941184a66956ec9be8d703bb6 deleted and replaced by tablet b02f2fa45a4640b9b29c3e5556f41d67
I20251215 14:55:14.910960 8786 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_76bb79d40aa04a9785bc282e229bd6c3" } new_table_name: "default.Table_da45716731c941159b40ad5386f3e3d0" modify_external_catalogs: true
I20251215 14:55:14.912417 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_964b72b489f44c8a8b2976afc9ce2c15"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:14.912886 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_964b72b489f44c8a8b2976afc9ce2c15 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:14.914291 9435 tablet_bootstrap.cc:492] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
W20251215 14:55:14.914325 8781 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95b78c1518f1481794948f2db1055f38 consensus state has no leader
I20251215 14:55:14.914453 9435 ts_tablet_manager.cc:1403] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.252s user 0.001s sys 0.011s
I20251215 14:55:14.914613 8781 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_9bc811b3caa448e2b7cf83094f1ba245" } modify_external_catalogs: true
I20251215 14:55:14.914773 8781 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_9bc811b3caa448e2b7cf83094f1ba245" } modify_external_catalogs: true
I20251215 14:55:14.915304 9435 raft_consensus.cc:359] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.915481 9435 raft_consensus.cc:385] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:14.915567 9435 raft_consensus.cc:740] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:14.915782 9435 consensus_queue.cc:260] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:14.917851 9008 tablet_service.cc:1505] Processing CreateTablet for tablet 18802b48f9c04eccb369de25dd113c3f (DEFAULT_TABLE table=default.Table_086a011ce2d24a8e80197a41b046c8e5 [id=45200bfd05b24fc1af84bdea3c041091]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.918299 9008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18802b48f9c04eccb369de25dd113c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.922463 8783 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d781b8c6c0c749a9967558102dcb8f11" } new_table_name: "default.Table_4cb3f897d67d4618ac0819263ce866d8" modify_external_catalogs: true
W20251215 14:55:14.924405 8976 consensus_peers.cc:597] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:14.931115 9435 ts_tablet_manager.cc:1434] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20251215 14:55:14.932514 9435 tablet_bootstrap.cc:492] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:14.936066 9174 raft_consensus.cc:3060] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:14.936671 9288 tablet_service.cc:1505] Processing CreateTablet for tablet 666af680888c4b3c81187d0195684bc7 (DEFAULT_TABLE table=default.Table_6f7cb4c5d71649b7a375b8eb03570b24 [id=2dcc5552f0e14ab2855e1f79b7a648ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.938252 9288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 666af680888c4b3c81187d0195684bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.939996 9435 tablet_bootstrap.cc:654] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:14.945454 9019 tablet_service.cc:1505] Processing CreateTablet for tablet d6fd306fb2544afa8a60d5e7a093d76b (DEFAULT_TABLE table=default.Table_f0bf7f4e35d747908b76aee9f98a7a5a [id=b52b2eb8c8094d29a09434196b75e17a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.946054 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6fd306fb2544afa8a60d5e7a093d76b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.952159 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 605da10c8d3049e8b94caa9738576aab (table default.Table_2e1e3e730bbb4364b0f1f86d7d89056a [id=1a10676eee8b47098cf45bee49e3f502]) successfully deleted
I20251215 14:55:14.937280 9293 tablet_service.cc:1552] Processing DeleteTablet for tablet f4203c4941184a66956ec9be8d703bb6 with delete_type TABLET_DATA_DELETED (replaced by tablet b02f2fa45a4640b9b29c3e5556f41d67) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:14.937552 9284 tablet_service.cc:1505] Processing CreateTablet for tablet 7e8bf1cdbf2a48f59945268887cc5a2b (DEFAULT_TABLE table=default.Table_bc2a4de45b6c48838b6c80eb0c0a12b1 [id=14a0f59f28cc467ca4a3bb4d5be1950c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.958627 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e8bf1cdbf2a48f59945268887cc5a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.937598 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 18802b48f9c04eccb369de25dd113c3f (DEFAULT_TABLE table=default.Table_086a011ce2d24a8e80197a41b046c8e5 [id=45200bfd05b24fc1af84bdea3c041091]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.937810 9279 tablet_service.cc:1505] Processing CreateTablet for tablet e6f6324610f44cefb0ce67fd76e0e001 (DEFAULT_TABLE table=default.Table_8ad0b32830224acbb2af0187d4e1c783 [id=7ecb674f701f48e3a912e345d9eca7ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.965005 9279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f6324610f44cefb0ce67fd76e0e001. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.966552 9018 tablet_service.cc:1552] Processing DeleteTablet for tablet f4203c4941184a66956ec9be8d703bb6 with delete_type TABLET_DATA_DELETED (replaced by tablet b02f2fa45a4640b9b29c3e5556f41d67) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:14.937206 9277 tablet_service.cc:1505] Processing CreateTablet for tablet de5ba7f2b5c84ac39e4019a0b9532176 (DEFAULT_TABLE table=default.Table_bba752fe83e349f4ad33cb5d5aec88a8 [id=28f49f9763c5472bbc62cd2cbcfcbf6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.967468 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5ba7f2b5c84ac39e4019a0b9532176. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.967607 9018 tablet_service.cc:1505] Processing CreateTablet for tablet 666af680888c4b3c81187d0195684bc7 (DEFAULT_TABLE table=default.Table_6f7cb4c5d71649b7a375b8eb03570b24 [id=2dcc5552f0e14ab2855e1f79b7a648ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.967972 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 666af680888c4b3c81187d0195684bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.948166 9288 tablet_service.cc:1505] Processing CreateTablet for tablet 37554f8c1a90462095c511f00df6dece (DEFAULT_TABLE table=default.Table_ed2fa3c1ae2e4112a755c1be18a481c2 [id=72ec457701ed4fa1812a13e1ee969168]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.971649 9022 tablet_service.cc:1505] Processing CreateTablet for tablet de5ba7f2b5c84ac39e4019a0b9532176 (DEFAULT_TABLE table=default.Table_bba752fe83e349f4ad33cb5d5aec88a8 [id=28f49f9763c5472bbc62cd2cbcfcbf6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.971865 9288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37554f8c1a90462095c511f00df6dece. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.972008 9022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5ba7f2b5c84ac39e4019a0b9532176. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.948230 9276 tablet_service.cc:1505] Processing CreateTablet for tablet 5875cdedb77841359158f7f185ee30f6 (DEFAULT_TABLE table=default.Table_908bf3eb9e4d45daa3e63b9fb069fcf7 [id=16b4c8cd1e3841e6b30afa61dbfb2c0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.975440 9276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5875cdedb77841359158f7f185ee30f6. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:14.989101 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet f4203c4941184a66956ec9be8d703bb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4203c4941184a66956ec9be8d703bb6 already in progress: creating tablet
I20251215 14:55:14.989413 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18802b48f9c04eccb369de25dd113c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.990428 9006 tablet_service.cc:1505] Processing CreateTablet for tablet 2ca89ec0fe3647ad9c3e62d16640bb20 (DEFAULT_TABLE table=default.Table_f1d0fc0296494974b6b7f83f6dc2e4ab [id=d6ac05b5292840fc8108e61afb7f9e4e]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:14.991724 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 52e93348b205408f83efff27fde48e9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 52e93348b205408f83efff27fde48e9b already in progress: creating tablet
W20251215 14:55:14.992014 8773 catalog_manager.cc:4952] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet e1d4dc7d18f7448880b79af99283c99f because the tablet was not found. No further retry: Not found: Tablet not found: e1d4dc7d18f7448880b79af99283c99f
W20251215 14:55:14.992276 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 5830296559264b609909486aa15c9e2e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5830296559264b609909486aa15c9e2e already in progress: creating tablet
I20251215 14:55:14.948717 9278 tablet_service.cc:1505] Processing CreateTablet for tablet d6fd306fb2544afa8a60d5e7a093d76b (DEFAULT_TABLE table=default.Table_f0bf7f4e35d747908b76aee9f98a7a5a [id=b52b2eb8c8094d29a09434196b75e17a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.995245 9278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6fd306fb2544afa8a60d5e7a093d76b. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:15.001880 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 96a1de7ce5f64f348585926ac05ddb87 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 96a1de7ce5f64f348585926ac05ddb87 already in progress: creating tablet
W20251215 14:55:15.002249 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 21437c9162f1435485dde5fca3522be1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 21437c9162f1435485dde5fca3522be1 already in progress: creating tablet
W20251215 14:55:15.002559 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 2b686ad43973448c8e24230d7d1d7250 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b686ad43973448c8e24230d7d1d7250 already in progress: creating tablet
W20251215 14:55:15.002979 8773 catalog_manager.cc:4952] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 5e751be4722043928e6977c48c359aae because the tablet was not found. No further retry: Not found: Tablet not found: 5e751be4722043928e6977c48c359aae
I20251215 14:55:15.004052 9277 tablet_service.cc:1505] Processing CreateTablet for tablet 95b78c1518f1481794948f2db1055f38 (DEFAULT_TABLE table=default.Table_3060c957ad034dafb3040834508f89b0 [id=50a94314f5ba46e3a75b5a15e7362299]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:14.994006 9015 tablet_service.cc:1505] Processing CreateTablet for tablet 7e8bf1cdbf2a48f59945268887cc5a2b (DEFAULT_TABLE table=default.Table_bc2a4de45b6c48838b6c80eb0c0a12b1 [id=14a0f59f28cc467ca4a3bb4d5be1950c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.004587 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b78c1518f1481794948f2db1055f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.004853 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e8bf1cdbf2a48f59945268887cc5a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:14.995404 9004 tablet_service.cc:1505] Processing CreateTablet for tablet e6f6324610f44cefb0ce67fd76e0e001 (DEFAULT_TABLE table=default.Table_8ad0b32830224acbb2af0187d4e1c783 [id=7ecb674f701f48e3a912e345d9eca7ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.008317 9004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f6324610f44cefb0ce67fd76e0e001. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.011091 9276 tablet_service.cc:1505] Processing CreateTablet for tablet 23ace8d6e2bb42de9368a06190a07431 (DEFAULT_TABLE table=default.Table_5d98ed2bfc54418c8a8fe7d0694708b7 [id=344d18e363b9419180e1df8c5b2a8e8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.011463 9276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ace8d6e2bb42de9368a06190a07431. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.004257 9007 tablet_service.cc:1505] Processing CreateTablet for tablet 37554f8c1a90462095c511f00df6dece (DEFAULT_TABLE table=default.Table_ed2fa3c1ae2e4112a755c1be18a481c2 [id=72ec457701ed4fa1812a13e1ee969168]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.011991 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37554f8c1a90462095c511f00df6dece. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.017393 9277 tablet_service.cc:1505] Processing CreateTablet for tablet 4dd3af2da2c5445b962903d4475b0d58 (DEFAULT_TABLE table=default.Table_ced07a78c54f4b61b53992f2cf0e5381 [id=c9d2bebc140749068f02953f75381a75]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.017982 9006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca89ec0fe3647ad9c3e62d16640bb20. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.023233 10435 consensus_queue.cc:1048] T 90c0254840b442a3817171b06f2726c8 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:15.025264 9435 tablet_bootstrap.cc:492] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:15.025334 9009 tablet_service.cc:1505] Processing CreateTablet for tablet caefb83a990e4ad2baf621cd83265f96 (DEFAULT_TABLE table=default.Table_f3920bdde5354312bfcca61bffe77a6d [id=24f9ab438e6240c19eca8dbbe8253c6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.027505 9016 tablet_service.cc:1505] Processing CreateTablet for tablet 5875cdedb77841359158f7f185ee30f6 (DEFAULT_TABLE table=default.Table_908bf3eb9e4d45daa3e63b9fb069fcf7 [id=16b4c8cd1e3841e6b30afa61dbfb2c0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.027989 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5875cdedb77841359158f7f185ee30f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.031608 9435 ts_tablet_manager.cc:1403] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.099s user 0.003s sys 0.001s
I20251215 14:55:15.032760 9435 raft_consensus.cc:359] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.034049 9435 raft_consensus.cc:385] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:15.034997 9013 tablet_service.cc:1505] Processing CreateTablet for tablet 95b78c1518f1481794948f2db1055f38 (DEFAULT_TABLE table=default.Table_3060c957ad034dafb3040834508f89b0 [id=50a94314f5ba46e3a75b5a15e7362299]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.035399 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b78c1518f1481794948f2db1055f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.038340 9435 raft_consensus.cc:740] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:15.039028 9435 consensus_queue.cc:260] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.025602 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd3af2da2c5445b962903d4475b0d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.045174 9154 tablet_service.cc:1505] Processing CreateTablet for tablet d6fd306fb2544afa8a60d5e7a093d76b (DEFAULT_TABLE table=default.Table_f0bf7f4e35d747908b76aee9f98a7a5a [id=b52b2eb8c8094d29a09434196b75e17a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.045570 9158 tablet_service.cc:1552] Processing DeleteTablet for tablet f4203c4941184a66956ec9be8d703bb6 with delete_type TABLET_DATA_DELETED (replaced by tablet b02f2fa45a4640b9b29c3e5556f41d67) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:15.045624 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6fd306fb2544afa8a60d5e7a093d76b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.046284 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 4d809129224b4a74b42c0f7e370233f6 (DEFAULT_TABLE table=default.Table_f016f160e2324a7aa2c117ab8a53c173 [id=8341fbba05e04a80808eaa6be8204de4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.046334 9158 tablet_service.cc:1505] Processing CreateTablet for tablet 666af680888c4b3c81187d0195684bc7 (DEFAULT_TABLE table=default.Table_6f7cb4c5d71649b7a375b8eb03570b24 [id=2dcc5552f0e14ab2855e1f79b7a648ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.046663 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d809129224b4a74b42c0f7e370233f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.046691 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 666af680888c4b3c81187d0195684bc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.048444 9157 tablet_service.cc:1505] Processing CreateTablet for tablet 18802b48f9c04eccb369de25dd113c3f (DEFAULT_TABLE table=default.Table_086a011ce2d24a8e80197a41b046c8e5 [id=45200bfd05b24fc1af84bdea3c041091]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.048806 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18802b48f9c04eccb369de25dd113c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.054916 9435 ts_tablet_manager.cc:1434] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.023s user 0.000s sys 0.002s
I20251215 14:55:15.056628 9435 tablet_bootstrap.cc:492] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:15.061057 9276 tablet_service.cc:1505] Processing CreateTablet for tablet b34a860bf4244586948ae9eafe35103a (DEFAULT_TABLE table=default.Table_c50f337fe1ac4ea4bb935c8d64bfc244 [id=46cb0f86894a4e82bae1ae06e4c7d279]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.061555 9276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b34a860bf4244586948ae9eafe35103a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.062608 10144 raft_consensus.cc:493] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:15.062767 10144 raft_consensus.cc:515] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.063463 10144 leader_election.cc:290] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:15.064388 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "65ea0509d8eb42bdb2291ff01e8d3bd6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:15.064620 9042 raft_consensus.cc:2468] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:15.065544 10504 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.121.190:44279 every 8 connection(s)
I20251215 14:55:15.065864 10152 rpc_server.cc:307] RPC server started. Bound to: 127.8.121.190:44279
I20251215 14:55:15.065950 9248 leader_election.cc:304] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:15.067073 10144 raft_consensus.cc:2804] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:15.067260 10144 raft_consensus.cc:493] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:15.067389 10144 raft_consensus.cc:3060] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:15.068187 10152 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/info.pb
I20251215 14:55:15.070001 10144 raft_consensus.cc:515] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.071287 10144 leader_election.cc:290] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:15.071609 9435 tablet_bootstrap.cc:654] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:15.071985 8678 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu as pid 10152
W20251215 14:55:15.074743 8775 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 7f9c173d11f1449b829a54190313bea3 (table default.Table_5227b3b62b1843ea9a43fecb24c0fd07 [id=1ff1a56115104321ba6aafed10d1506d], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7f9c173d11f1449b829a54190313bea3 consensus state has no leader
I20251215 14:55:15.075525 10443 raft_consensus.cc:493] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:15.075984 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:15.076946 10443 raft_consensus.cc:515] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.079254 10443 leader_election.cc:290] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:15.080139 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ae72a1ded6e4faba1ad309d9a0e4a95" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:15.083073 10443 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:15.083314 9435 tablet_bootstrap.cc:492] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:15.083422 10443 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:15.084985 10443 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:15.086308 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:15.090643 9435 ts_tablet_manager.cc:1403] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.003s
I20251215 14:55:15.091897 9009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caefb83a990e4ad2baf621cd83265f96. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.091894 9435 raft_consensus.cc:359] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.092085 9435 raft_consensus.cc:385] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:15.092176 9435 raft_consensus.cc:740] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:15.092418 9435 consensus_queue.cc:260] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.092998 9435 ts_tablet_manager.cc:1434] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:15.093307 9435 tablet_bootstrap.cc:492] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:15.101876 10506 sys_catalog.cc:263] Verifying existing consensus state
W20251215 14:55:15.092355 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 67548.9us
I20251215 14:55:15.093825 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "65ea0509d8eb42bdb2291ff01e8d3bd6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:15.102254 9042 raft_consensus.cc:3060] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:15.107008 9011 tablet_service.cc:1505] Processing CreateTablet for tablet 4dd3af2da2c5445b962903d4475b0d58 (DEFAULT_TABLE table=default.Table_ced07a78c54f4b61b53992f2cf0e5381 [id=c9d2bebc140749068f02953f75381a75]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.107520 9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd3af2da2c5445b962903d4475b0d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.107788 10506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Bootstrap starting.
I20251215 14:55:15.113364 9010 tablet_service.cc:1505] Processing CreateTablet for tablet 23ace8d6e2bb42de9368a06190a07431 (DEFAULT_TABLE table=default.Table_5d98ed2bfc54418c8a8fe7d0694708b7 [id=344d18e363b9419180e1df8c5b2a8e8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.113806 9010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ace8d6e2bb42de9368a06190a07431. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.113914 9435 tablet_bootstrap.cc:654] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:15.125121 9435 tablet_bootstrap.cc:492] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:15.125542 9435 ts_tablet_manager.cc:1403] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.001s
I20251215 14:55:15.127462 9435 raft_consensus.cc:359] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.128711 9435 raft_consensus.cc:385] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:15.128937 9435 raft_consensus.cc:740] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:15.129493 9435 consensus_queue.cc:260] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.130863 9435 ts_tablet_manager.cc:1434] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20251215 14:55:15.131531 9435 tablet_bootstrap.cc:492] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:15.134865 9435 tablet_bootstrap.cc:654] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:15.134984 9295 tablet_service.cc:1505] Processing CreateTablet for tablet 5bdbdc16389442f587d18347a2340fd5 (DEFAULT_TABLE table=default.Table_08d34aa4d5924089a6b2af6c82ca6dd5 [id=e067894e00cf4fcdaf456f844ce834ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.135630 9278 tablet_service.cc:1505] Processing CreateTablet for tablet e1d4dc7d18f7448880b79af99283c99f (DEFAULT_TABLE table=default.Table_20804605d90d4fba9f88e94a70e903e4 [id=fa68748a705444198187d2f87753fdc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.136175 9277 tablet_service.cc:1505] Processing CreateTablet for tablet a4b0a5e13ae941dcb99749f1e0c04176 (DEFAULT_TABLE table=default.Table_44ff5f3f5bac4c479d54084f4b377291 [id=8ba0b14407a541f59de5cbe31f13baa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.136641 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bdbdc16389442f587d18347a2340fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.137131 9276 tablet_service.cc:1505] Processing CreateTablet for tablet d531a17b6d1d47fa9606e0a8206b3bfd (DEFAULT_TABLE table=default.Table_eec6fe4b648b481ab6d411e3cf33dcca [id=6dcc03fe0d2a4053bd68e76fffca4368]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.137494 9288 tablet_service.cc:1505] Processing CreateTablet for tablet 3dca27f234054f9582a2ca6c5e6f5cad (DEFAULT_TABLE table=default.Table_d710e1c69ade44c38504cf34d30b96a9 [id=b1f1206681044b31a78b72f2e24c8bce]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.137838 9279 tablet_service.cc:1505] Processing CreateTablet for tablet 6c9bc7a7bd4447dba112999eff69c932 (DEFAULT_TABLE table=default.Table_e6fb80aef50c40c6afdb4075838ecfb3 [id=ae3e4809f1b14eba8d4f95b949ea4f14]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.138095 9289 tablet_service.cc:1505] Processing CreateTablet for tablet e9f514f7656247fd90f550b4132a15e6 (DEFAULT_TABLE table=default.Table_66af3d0e5e85432cb28ab3db9b0fd01b [id=dde6a8e342ce4d899f05dd06b2a63bdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.138316 9293 tablet_service.cc:1505] Processing CreateTablet for tablet 266937328422421ab6880d7f7410683e (DEFAULT_TABLE table=default.Table_8866124dc954470da607bb2f70dccb5e [id=82147fb42e594125bba36e75e662a7ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.138684 9284 tablet_service.cc:1505] Processing CreateTablet for tablet e512c231686948619d338fa0fc8aae03 (DEFAULT_TABLE table=default.Table_961210c318cf477d87a5d6f9dae90d3d [id=7b73d3c6566541d0b8b3e70fd484e942]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.138873 9290 tablet_service.cc:1505] Processing CreateTablet for tablet e8ffa009bae84660b331ebeddcccc266 (DEFAULT_TABLE table=default.Table_846dce0df4e24591ad236b2eedaeecff [id=f7b77f6d54364a96b37c3bf223b7f270]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.139050 9280 tablet_service.cc:1505] Processing CreateTablet for tablet 5e751be4722043928e6977c48c359aae (DEFAULT_TABLE table=default.Table_34f674e6f3e34e739110435de6af285e [id=77325fe3ac484f54bb27efb5b009b5a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.139742 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b0a5e13ae941dcb99749f1e0c04176. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.144884 9276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d531a17b6d1d47fa9606e0a8206b3bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.147308 10144 raft_consensus.cc:493] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:15.147486 9288 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dca27f234054f9582a2ca6c5e6f5cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.147528 10144 raft_consensus.cc:515] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.148247 10144 leader_election.cc:290] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:15.151302 9154 tablet_service.cc:1505] Processing CreateTablet for tablet de5ba7f2b5c84ac39e4019a0b9532176 (DEFAULT_TABLE table=default.Table_bba752fe83e349f4ad33cb5d5aec88a8 [id=28f49f9763c5472bbc62cd2cbcfcbf6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.151697 9279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9bc7a7bd4447dba112999eff69c932. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.151683 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5ba7f2b5c84ac39e4019a0b9532176. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.165226 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7634179e7bef4b95ae6e06b4581888e7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:15.166977 9248 leader_election.cc:343] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:15.167892 9293 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266937328422421ab6880d7f7410683e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.171473 9284 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e512c231686948619d338fa0fc8aae03. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:15.172107 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet f4203c4941184a66956ec9be8d703bb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4203c4941184a66956ec9be8d703bb6 already in progress: creating tablet
I20251215 14:55:15.172487 9435 tablet_bootstrap.cc:492] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:15.172631 9435 ts_tablet_manager.cc:1403] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.000s
I20251215 14:55:15.172853 9003 tablet_service.cc:1505] Processing CreateTablet for tablet 4d809129224b4a74b42c0f7e370233f6 (DEFAULT_TABLE table=default.Table_f016f160e2324a7aa2c117ab8a53c173 [id=8341fbba05e04a80808eaa6be8204de4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.173238 9003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d809129224b4a74b42c0f7e370233f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.173501 9435 raft_consensus.cc:359] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.173671 9435 raft_consensus.cc:385] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:15.173766 9435 raft_consensus.cc:740] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:15.173982 9435 consensus_queue.cc:260] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.174492 9435 ts_tablet_manager.cc:1434] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:15.174767 9435 tablet_bootstrap.cc:492] T 050260e67b924f13847b9550a91e274b P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:15.175225 9088 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:15.176512 9435 tablet_bootstrap.cc:654] T 050260e67b924f13847b9550a91e274b P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:15.179328 9154 tablet_service.cc:1505] Processing CreateTablet for tablet 7e8bf1cdbf2a48f59945268887cc5a2b (DEFAULT_TABLE table=default.Table_bc2a4de45b6c48838b6c80eb0c0a12b1 [id=14a0f59f28cc467ca4a3bb4d5be1950c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.179963 9154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e8bf1cdbf2a48f59945268887cc5a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.179687 9280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e751be4722043928e6977c48c359aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.187633 9278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d4dc7d18f7448880b79af99283c99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.193229 10506 log.cc:826] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Log is configured to *not* fsync() on all Append() calls
I20251215 14:55:15.193387 9157 tablet_service.cc:1505] Processing CreateTablet for tablet e6f6324610f44cefb0ce67fd76e0e001 (DEFAULT_TABLE table=default.Table_8ad0b32830224acbb2af0187d4e1c783 [id=7ecb674f701f48e3a912e345d9eca7ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.193614 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ffa009bae84660b331ebeddcccc266. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.193806 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f6324610f44cefb0ce67fd76e0e001. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.199316 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f514f7656247fd90f550b4132a15e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.202317 9158 tablet_service.cc:1505] Processing CreateTablet for tablet 5875cdedb77841359158f7f185ee30f6 (DEFAULT_TABLE table=default.Table_908bf3eb9e4d45daa3e63b9fb069fcf7 [id=16b4c8cd1e3841e6b30afa61dbfb2c0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.202816 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5875cdedb77841359158f7f185ee30f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.207551 9157 tablet_service.cc:1505] Processing CreateTablet for tablet 37554f8c1a90462095c511f00df6dece (DEFAULT_TABLE table=default.Table_ed2fa3c1ae2e4112a755c1be18a481c2 [id=72ec457701ed4fa1812a13e1ee969168]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.208047 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37554f8c1a90462095c511f00df6dece. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.213338 10144 consensus_queue.cc:1048] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:15.215093 9021 tablet_service.cc:1505] Processing CreateTablet for tablet b34a860bf4244586948ae9eafe35103a (DEFAULT_TABLE table=default.Table_c50f337fe1ac4ea4bb935c8d64bfc244 [id=46cb0f86894a4e82bae1ae06e4c7d279]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.215610 9021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b34a860bf4244586948ae9eafe35103a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.218533 10435 raft_consensus.cc:493] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:15.218756 10435 raft_consensus.cc:515] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.219663 10435 leader_election.cc:290] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:15.220902 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc50995f6d934b58ab5f6f6f370cb7e5" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:15.222169 8976 leader_election.cc:343] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:15.232228 9361 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:15.232892 9295 tablet_service.cc:1505] Processing CreateTablet for tablet da4da9d74efd427ca27431c54a84a3e9 (DEFAULT_TABLE table=default.Table_4b3ae2f8a28c4a47bbd2580e884cec40 [id=30b63f6070fb44fa88f311b65dfd619f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.233724 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da4da9d74efd427ca27431c54a84a3e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.239739 9155 tablet_service.cc:1505] Processing CreateTablet for tablet 95b78c1518f1481794948f2db1055f38 (DEFAULT_TABLE table=default.Table_3060c957ad034dafb3040834508f89b0 [id=50a94314f5ba46e3a75b5a15e7362299]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.239841 9147 tablet_service.cc:1505] Processing CreateTablet for tablet 23ace8d6e2bb42de9368a06190a07431 (DEFAULT_TABLE table=default.Table_5d98ed2bfc54418c8a8fe7d0694708b7 [id=344d18e363b9419180e1df8c5b2a8e8e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.240252 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95b78c1518f1481794948f2db1055f38. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.240513 9142 tablet_service.cc:1505] Processing CreateTablet for tablet b34a860bf4244586948ae9eafe35103a (DEFAULT_TABLE table=default.Table_c50f337fe1ac4ea4bb935c8d64bfc244 [id=46cb0f86894a4e82bae1ae06e4c7d279]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.241672 9289 tablet_service.cc:1505] Processing CreateTablet for tablet fa73a61ff5be4cd2b590d72763bf7c5d (DEFAULT_TABLE table=default.Table_cd6f9353272f406f866b8aea97b47b52 [id=40a32fedadfe44bca3c1013ceb2b84c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.242063 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa73a61ff5be4cd2b590d72763bf7c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.243508 9153 tablet_service.cc:1505] Processing CreateTablet for tablet 4dd3af2da2c5445b962903d4475b0d58 (DEFAULT_TABLE table=default.Table_ced07a78c54f4b61b53992f2cf0e5381 [id=c9d2bebc140749068f02953f75381a75]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.243920 9159 tablet_service.cc:1505] Processing CreateTablet for tablet 4d809129224b4a74b42c0f7e370233f6 (DEFAULT_TABLE table=default.Table_f016f160e2324a7aa2c117ab8a53c173 [id=8341fbba05e04a80808eaa6be8204de4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.244741 9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b34a860bf4244586948ae9eafe35103a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.247443 9153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd3af2da2c5445b962903d4475b0d58. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.251412 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d809129224b4a74b42c0f7e370233f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.256330 9147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ace8d6e2bb42de9368a06190a07431. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.258867 9278 tablet_service.cc:1505] Processing CreateTablet for tablet 8f6bf35f57e94a1d983612561aa6f185 (DEFAULT_TABLE table=default.Table_c15fd87a1803401cad889d57d9c16a47 [id=1a176fea11c64039a31b9e77e8a2b8ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.259454 9278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6bf35f57e94a1d983612561aa6f185. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.260336 9276 tablet_service.cc:1505] Processing CreateTablet for tablet 1b6e5ac88fc74d66a3f74fb69eb01455 (DEFAULT_TABLE table=default.Table_a9c0cd79373b476ba1ecce82ed68b769 [id=c0fd75e313b54744bb00e7f7651febbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.260663 9276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6e5ac88fc74d66a3f74fb69eb01455. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.264547 9277 tablet_service.cc:1505] Processing CreateTablet for tablet 410b0b292c204193a4983580abc97aa9 (DEFAULT_TABLE table=default.Table_974ade2140a44f24b046a797944f71f8 [id=854a9d5a60e34e5d86bb2cb63459dad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.265048 9277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410b0b292c204193a4983580abc97aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.265447 9290 tablet_service.cc:1505] Processing CreateTablet for tablet f909de19a0184e5b8d54a04ed11a9c70 (DEFAULT_TABLE table=default.Table_d246863c572741ba93765655a7445caf [id=cca2ce26479e46d380155073f70ec267]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.265924 9290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f909de19a0184e5b8d54a04ed11a9c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.267395 9152 tablet_service.cc:1505] Processing CreateTablet for tablet 5bdbdc16389442f587d18347a2340fd5 (DEFAULT_TABLE table=default.Table_08d34aa4d5924089a6b2af6c82ca6dd5 [id=e067894e00cf4fcdaf456f844ce834ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.267802 9152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bdbdc16389442f587d18347a2340fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.270134 9280 tablet_service.cc:1505] Processing CreateTablet for tablet 3bfe7f2bc9b04aaeb6102b6b673d9379 (DEFAULT_TABLE table=default.Table_f85607e14d2647c4a7036f8d5ef7d9f9 [id=49363efafda94f3586957cb145386c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.270483 9280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bfe7f2bc9b04aaeb6102b6b673d9379. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.270892 9144 tablet_service.cc:1505] Processing CreateTablet for tablet e1d4dc7d18f7448880b79af99283c99f (DEFAULT_TABLE table=default.Table_20804605d90d4fba9f88e94a70e903e4 [id=fa68748a705444198187d2f87753fdc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.271214 9146 tablet_service.cc:1505] Processing CreateTablet for tablet a4b0a5e13ae941dcb99749f1e0c04176 (DEFAULT_TABLE table=default.Table_44ff5f3f5bac4c479d54084f4b377291 [id=8ba0b14407a541f59de5cbe31f13baa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.271490 9156 tablet_service.cc:1505] Processing CreateTablet for tablet d531a17b6d1d47fa9606e0a8206b3bfd (DEFAULT_TABLE table=default.Table_eec6fe4b648b481ab6d411e3cf33dcca [id=6dcc03fe0d2a4053bd68e76fffca4368]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.277834 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d4dc7d18f7448880b79af99283c99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.279593 9156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d531a17b6d1d47fa9606e0a8206b3bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.281052 9146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b0a5e13ae941dcb99749f1e0c04176. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.282222 8782 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 6beaf5ae37ce41fd9123d6b3560351b7
I20251215 14:55:15.295140 8784 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 548e6d35016746e2b8f5184ee44071cb
I20251215 14:55:15.295595 8780 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet ebeebb8f49ef4858804e2ed0b31b2196
I20251215 14:55:15.310809 9426 tablet_bootstrap.cc:492] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:15.311003 9426 ts_tablet_manager.cc:1403] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.523s user 0.003s sys 0.007s
I20251215 14:55:15.311812 9426 raft_consensus.cc:359] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.312048 9426 raft_consensus.cc:385] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:15.312150 9426 raft_consensus.cc:740] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:15.312443 9426 consensus_queue.cc:260] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.312974 9426 ts_tablet_manager.cc:1434] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:15.313324 9426 tablet_bootstrap.cc:492] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:15.327281 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 034fec793ae74fcda0c73f1cea291311
W20251215 14:55:15.327327 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 82ca60c5a63744ffb0a0c0a140ef665e
W20251215 14:55:15.327826 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet ff4508c5a110427eb4d9d2eaaadace0b
W20251215 14:55:15.327898 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 78b3f18a62d544b38a0682bf3bc00977
I20251215 14:55:15.327862 8779 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_8866124dc954470da607bb2f70dccb5e" } modify_external_catalogs: true
W20251215 14:55:15.327972 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 18cd1f63d51e4565bb8c55be13e3e099
W20251215 14:55:15.328023 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet c7f760639a664cfb9f4af5578154b981
I20251215 14:55:15.328047 8779 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_8866124dc954470da607bb2f70dccb5e" } modify_external_catalogs: true
W20251215 14:55:15.328135 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet 2d75636265f14a428aae592438064ea2
I20251215 14:55:15.328506 8788 catalog_manager.cc:5654] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129). New cstate: current_term: 1 leader_uuid: "67978ac4539d4b289e53f4eedd9a8156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
I20251215 14:55:15.328922 8788 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 2811b8ffdb614c91b0d3d4e6e039245b (table default.Table_12b99071f9224445935f70cba021453f [id=53315a8cf3bd4a05b1c5e30fd0acdd56]). Expected version 1 got 0
I20251215 14:55:15.335965 8784 master_service.cc:954] ReplaceTablet: received request to replace tablet 9c4be1c01418432492268598f97289a0 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:15.337030 9156 tablet_service.cc:1505] Processing CreateTablet for tablet e9f514f7656247fd90f550b4132a15e6 (DEFAULT_TABLE table=default.Table_66af3d0e5e85432cb28ab3db9b0fd01b [id=dde6a8e342ce4d899f05dd06b2a63bdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.338150 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_32ef645680d24387aaef210032ad27fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:15.338207 8782 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_95871025015c44e4b43a365970584eb5" } new_table_name: "default.Table_e62f7a2cd08046bb89a4ee467ab9c916" modify_external_catalogs: true
W20251215 14:55:15.338666 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_32ef645680d24387aaef210032ad27fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:15.341962 9156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f514f7656247fd90f550b4132a15e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:15.344264 8786 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8ae3004e4a76422397c6e1761d020e38 consensus state has no leader
I20251215 14:55:15.344573 8786 master_service.cc:954] ReplaceTablet: received request to replace tablet 804ad50f38314be3bf9e118eee9fe748 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:15.344910 8786 master_service.cc:954] ReplaceTablet: received request to replace tablet 804ad50f38314be3bf9e118eee9fe748 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:15.345295 8786 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c2efd3f029df4f7c9a74f6201cacf057" } new_table_name: "default.Table_893ed18a678f46a78f4d19c1fc95039b" modify_external_catalogs: true
I20251215 14:55:15.346774 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_737544a5c4c2494ea08011c91e5a75bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:15.347275 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_737544a5c4c2494ea08011c91e5a75bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:15.347496 9144 tablet_service.cc:1505] Processing CreateTablet for tablet 6c9bc7a7bd4447dba112999eff69c932 (DEFAULT_TABLE table=default.Table_e6fb80aef50c40c6afdb4075838ecfb3 [id=ae3e4809f1b14eba8d4f95b949ea4f14]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.347889 9144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9bc7a7bd4447dba112999eff69c932. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.353576 10521 tablet.cc:1722] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:15.360332 8779 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 266937328422421ab6880d7f7410683e
I20251215 14:55:15.361111 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_107391a0f76c4cedb9fb90d3488f955b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:15.361680 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_107391a0f76c4cedb9fb90d3488f955b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:15.363215 8781 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet e9353aff4c0742c191b37d3a412ed411
I20251215 14:55:15.363894 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_df1aac21fb3a4eb5a83b087fa50c04d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:15.364431 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df1aac21fb3a4eb5a83b087fa50c04d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:15.368042 8784 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 9c4be1c01418432492268598f97289a0
I20251215 14:55:15.368470 8784 catalog_manager.cc:6724] ReplaceTablet: tablet 9c4be1c01418432492268598f97289a0 deleted and replaced by tablet d261a26a864742afbc0c26a208279a1e
I20251215 14:55:15.368810 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ab69cd0af60f45ae993af743f25da77a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:15.369285 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ab69cd0af60f45ae993af743f25da77a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:15.370432 8783 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 223697ae09c54e72b8c33fc0bc57fb5d has no consensus state
I20251215 14:55:15.370774 8783 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_66af3d0e5e85432cb28ab3db9b0fd01b" } new_table_name: "default.Table_787c39536e88473bbbab7c495042cd8a" modify_external_catalogs: true
W20251215 14:55:15.371434 8782 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a7a401d5386499183b6560411f593b6 consensus state has no leader
W20251215 14:55:15.373674 8786 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 66249f9be0334affb4f4b0e7dd9212ea consensus state has no leader
I20251215 14:55:15.375217 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_d0e2271b8caf4c5ea5c37795dcd476b8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:15.375874 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0e2271b8caf4c5ea5c37795dcd476b8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:15.388919 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet 548e6d35016746e2b8f5184ee44071cb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:15.392263 9295 tablet_service.cc:1505] Processing CreateTablet for tablet c3e5c385232140079705470ad2d6e020 (DEFAULT_TABLE table=default.Table_aee0201b52bb4f58bcde6c4b80d384fc [id=288733c610c443808790a2b63f0ef411]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.392704 9295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3e5c385232140079705470ad2d6e020. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.393884 8788 master_service.cc:954] ReplaceTablet: received request to replace tablet 21437c9162f1435485dde5fca3522be1 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:15.394614 9155 tablet_service.cc:1505] Processing CreateTablet for tablet 266937328422421ab6880d7f7410683e (DEFAULT_TABLE table=default.Table_8866124dc954470da607bb2f70dccb5e [id=82147fb42e594125bba36e75e662a7ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.395099 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266937328422421ab6880d7f7410683e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.395148 9276 tablet_service.cc:1552] Processing DeleteTablet for tablet ebeebb8f49ef4858804e2ed0b31b2196 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:15.395588 9276 tablet_service.cc:1552] Processing DeleteTablet for tablet 6beaf5ae37ce41fd9123d6b3560351b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:15.398855 9289 tablet_service.cc:1505] Processing CreateTablet for tablet a9ed7d1946ba433eb8b19ccf6a84b7ad (DEFAULT_TABLE table=default.Table_86c6dc8b4a624840b2920c56cdf1a347 [id=977c10f407a74ad1bb20f1d0026df250]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:15.401382 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 82ca60c5a63744ffb0a0c0a140ef665e
W20251215 14:55:15.401499 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 6ae72a1ded6e4faba1ad309d9a0e4a95
W20251215 14:55:15.401577 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 15b8a2a337e54321afd67f7562c412a0
W20251215 14:55:15.401638 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7
W20251215 14:55:15.401713 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 90c0254840b442a3817171b06f2726c8
W20251215 14:55:15.401773 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet ff4508c5a110427eb4d9d2eaaadace0b
W20251215 14:55:15.401839 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 21a98ce868924690b8a5715f4103c360
W20251215 14:55:15.401892 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 7634179e7bef4b95ae6e06b4581888e7
W20251215 14:55:15.401957 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 56816add0a61454c9980ad09f5815b09
W20251215 14:55:15.402011 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 034fec793ae74fcda0c73f1cea291311
I20251215 14:55:15.403868 9159 tablet_service.cc:1505] Processing CreateTablet for tablet e512c231686948619d338fa0fc8aae03 (DEFAULT_TABLE table=default.Table_961210c318cf477d87a5d6f9dae90d3d [id=7b73d3c6566541d0b8b3e70fd484e942]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.404300 9159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e512c231686948619d338fa0fc8aae03. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.409119 9226 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:15.410491 8786 master_service.cc:954] ReplaceTablet: received request to replace tablet 15b8a2a337e54321afd67f7562c412a0 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:15.414348 9152 tablet_service.cc:1505] Processing CreateTablet for tablet e8ffa009bae84660b331ebeddcccc266 (DEFAULT_TABLE table=default.Table_846dce0df4e24591ad236b2eedaeecff [id=f7b77f6d54364a96b37c3bf223b7f270]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.414994 9152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ffa009bae84660b331ebeddcccc266. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.419906 9426 tablet_bootstrap.cc:654] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:15.422402 9278 tablet_service.cc:1552] Processing DeleteTablet for tablet 266937328422421ab6880d7f7410683e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:15 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:15.424366 9157 tablet_service.cc:1505] Processing CreateTablet for tablet da4da9d74efd427ca27431c54a84a3e9 (DEFAULT_TABLE table=default.Table_4b3ae2f8a28c4a47bbd2580e884cec40 [id=30b63f6070fb44fa88f311b65dfd619f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.424721 9157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da4da9d74efd427ca27431c54a84a3e9. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:15.430204 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 548e6d35016746e2b8f5184ee44071cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 548e6d35016746e2b8f5184ee44071cb already in progress: creating tablet
I20251215 14:55:15.430456 9277 tablet_service.cc:1552] Processing DeleteTablet for tablet 9c4be1c01418432492268598f97289a0 with delete_type TABLET_DATA_DELETED (replaced by tablet d261a26a864742afbc0c26a208279a1e) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:15.430474 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet ebeebb8f49ef4858804e2ed0b31b2196 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebeebb8f49ef4858804e2ed0b31b2196 already in progress: creating tablet
W20251215 14:55:15.430703 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 6beaf5ae37ce41fd9123d6b3560351b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6beaf5ae37ce41fd9123d6b3560351b7 already in progress: creating tablet
I20251215 14:55:15.431479 9158 tablet_service.cc:1505] Processing CreateTablet for tablet 3dca27f234054f9582a2ca6c5e6f5cad (DEFAULT_TABLE table=default.Table_d710e1c69ade44c38504cf34d30b96a9 [id=b1f1206681044b31a78b72f2e24c8bce]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.431865 9158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dca27f234054f9582a2ca6c5e6f5cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.431845 10345 raft_consensus.cc:493] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:15.439435 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 266937328422421ab6880d7f7410683e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 266937328422421ab6880d7f7410683e already in progress: creating tablet
W20251215 14:55:15.439746 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 9c4be1c01418432492268598f97289a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c4be1c01418432492268598f97289a0 already in progress: creating tablet
I20251215 14:55:15.441336 10269 raft_consensus.cc:493] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:15.441494 10269 raft_consensus.cc:515] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.445920 9012 tablet_service.cc:1505] Processing CreateTablet for tablet 5bdbdc16389442f587d18347a2340fd5 (DEFAULT_TABLE table=default.Table_08d34aa4d5924089a6b2af6c82ca6dd5 [id=e067894e00cf4fcdaf456f844ce834ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.445961 9276 tablet_service.cc:1505] Processing CreateTablet for tablet 8ae3004e4a76422397c6e1761d020e38 (DEFAULT_TABLE table=default.Table_76bb79d40aa04a9785bc282e229bd6c3 [id=d425ddfc16a24752a1fd3e6fc78e1158]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.446344 9278 tablet_service.cc:1552] Processing DeleteTablet for tablet e9353aff4c0742c191b37d3a412ed411 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:15.446671 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "050260e67b924f13847b9550a91e274b" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:15.446729 10345 raft_consensus.cc:515] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.447361 10345 leader_election.cc:290] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:15.448042 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet e9353aff4c0742c191b37d3a412ed411 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9353aff4c0742c191b37d3a412ed411 already in progress: creating tablet
I20251215 14:55:15.448050 9289 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9ed7d1946ba433eb8b19ccf6a84b7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.448670 9276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae3004e4a76422397c6e1761d020e38. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:15.452992 8976 leader_election.cc:343] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:15.453083 9014 consensus_meta.cc:287] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156: Time spent flushing consensus metadata: real 0.592s user 0.001s sys 0.004s
I20251215 14:55:15.455941 9012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bdbdc16389442f587d18347a2340fd5. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:15.460873 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:15.461025 10269 leader_election.cc:290] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:15.473199 9020 consensus_meta.cc:287] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156: Time spent flushing consensus metadata: real 0.592s user 0.001s sys 0.000s
W20251215 14:55:15.478996 9018 consensus_meta.cc:287] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent flushing consensus metadata: real 0.508s user 0.003s sys 0.002s
W20251215 14:55:15.482349 9008 consensus_meta.cc:287] T 18802b48f9c04eccb369de25dd113c3f P 67978ac4539d4b289e53f4eedd9a8156: Time spent flushing consensus metadata: real 0.526s user 0.001s sys 0.001s
W20251215 14:55:15.484017 9427 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.662s user 0.001s sys 0.028s
W20251215 14:55:15.484508 9427 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.662s user 0.001s sys 0.029s
I20251215 14:55:15.489413 9042 raft_consensus.cc:2468] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:15.492177 10289 raft_consensus.cc:493] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:15.495196 9427 tablet_bootstrap.cc:492] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:15.498715 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c7e52357bee2478fa198e148bb7408d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:15.499396 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7e52357bee2478fa198e148bb7408d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:15.501478 9013 tablet_service.cc:1505] Processing CreateTablet for tablet e1d4dc7d18f7448880b79af99283c99f (DEFAULT_TABLE table=default.Table_20804605d90d4fba9f88e94a70e903e4 [id=fa68748a705444198187d2f87753fdc8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.502122 9427 ts_tablet_manager.cc:1403] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.676s user 0.002s sys 0.030s
W20251215 14:55:15.504019 8786 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
I20251215 14:55:15.503922 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ff4ce8ac34b148b18889ba2820a0d606"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:15.504561 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff4ce8ac34b148b18889ba2820a0d606 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:15.508289 10289 raft_consensus.cc:515] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.513221 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e48a6b6dfe094c34b30b8d3a44c66435" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:15.514209 9008 tablet_service.cc:1505] Processing CreateTablet for tablet d531a17b6d1d47fa9606e0a8206b3bfd (DEFAULT_TABLE table=default.Table_eec6fe4b648b481ab6d411e3cf33dcca [id=6dcc03fe0d2a4053bd68e76fffca4368]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.515089 9016 tablet_service.cc:1505] Processing CreateTablet for tablet 3dca27f234054f9582a2ca6c5e6f5cad (DEFAULT_TABLE table=default.Table_d710e1c69ade44c38504cf34d30b96a9 [id=b1f1206681044b31a78b72f2e24c8bce]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.510252 9007 tablet_service.cc:1505] Processing CreateTablet for tablet 6c9bc7a7bd4447dba112999eff69c932 (DEFAULT_TABLE table=default.Table_e6fb80aef50c40c6afdb4075838ecfb3 [id=ae3e4809f1b14eba8d4f95b949ea4f14]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.515419 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1d4dc7d18f7448880b79af99283c99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.515866 10289 leader_election.cc:290] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:15.527258 9427 raft_consensus.cc:359] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.527520 9427 raft_consensus.cc:385] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:15.528096 9010 tablet_service.cc:1505] Processing CreateTablet for tablet e9f514f7656247fd90f550b4132a15e6 (DEFAULT_TABLE table=default.Table_66af3d0e5e85432cb28ab3db9b0fd01b [id=dde6a8e342ce4d899f05dd06b2a63bdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.529167 9427 raft_consensus.cc:740] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:15.530897 9018 tablet_service.cc:1505] Processing CreateTablet for tablet a4b0a5e13ae941dcb99749f1e0c04176 (DEFAULT_TABLE table=default.Table_44ff5f3f5bac4c479d54084f4b377291 [id=8ba0b14407a541f59de5cbe31f13baa3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.531579 9008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d531a17b6d1d47fa9606e0a8206b3bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.534152 9021 tablet_service.cc:1505] Processing CreateTablet for tablet e512c231686948619d338fa0fc8aae03 (DEFAULT_TABLE table=default.Table_961210c318cf477d87a5d6f9dae90d3d [id=7b73d3c6566541d0b8b3e70fd484e942]), partition=RANGE (key) PARTITION UNBOUNDED
W20251215 14:55:15.534373 8976 leader_election.cc:343] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:15.536077 9011 tablet_service.cc:1505] Processing CreateTablet for tablet e8ffa009bae84660b331ebeddcccc266 (DEFAULT_TABLE table=default.Table_846dce0df4e24591ad236b2eedaeecff [id=f7b77f6d54364a96b37c3bf223b7f270]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.532920 9020 tablet_service.cc:1505] Processing CreateTablet for tablet 266937328422421ab6880d7f7410683e (DEFAULT_TABLE table=default.Table_8866124dc954470da607bb2f70dccb5e [id=82147fb42e594125bba36e75e662a7ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.536473 9427 consensus_queue.cc:260] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.537338 9018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b0a5e13ae941dcb99749f1e0c04176. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.538033 8786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_dcc4a99665d346a7b25e1e4a63149e12" } modify_external_catalogs: true
I20251215 14:55:15.538651 8786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_dcc4a99665d346a7b25e1e4a63149e12" } modify_external_catalogs: true
I20251215 14:55:15.541175 8785 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_19778cae47da4d7fb3b868bdcea673ef" } modify_external_catalogs: true
I20251215 14:55:15.541366 8785 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_19778cae47da4d7fb3b868bdcea673ef" } modify_external_catalogs: true
I20251215 14:55:15.543524 9003 tablet_service.cc:1505] Processing CreateTablet for tablet 5e751be4722043928e6977c48c359aae (DEFAULT_TABLE table=default.Table_34f674e6f3e34e739110435de6af285e [id=77325fe3ac484f54bb27efb5b009b5a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.547487 9248 leader_election.cc:304] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:15.547966 10345 raft_consensus.cc:2804] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:15.549441 9019 tablet_service.cc:1505] Processing CreateTablet for tablet da4da9d74efd427ca27431c54a84a3e9 (DEFAULT_TABLE table=default.Table_4b3ae2f8a28c4a47bbd2580e884cec40 [id=30b63f6070fb44fa88f311b65dfd619f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.549489 10395 consensus_queue.cc:1048] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:15.552659 9017 tablet_service.cc:1505] Processing CreateTablet for tablet 8f6bf35f57e94a1d983612561aa6f185 (DEFAULT_TABLE table=default.Table_c15fd87a1803401cad889d57d9c16a47 [id=1a176fea11c64039a31b9e77e8a2b8ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.554869 9427 ts_tablet_manager.cc:1434] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.044s user 0.002s sys 0.001s
W20251215 14:55:15.557865 9004 consensus_meta.cc:287] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156: Time spent flushing consensus metadata: real 0.520s user 0.003s sys 0.000s
I20251215 14:55:15.557878 9015 tablet_service.cc:1505] Processing CreateTablet for tablet fa73a61ff5be4cd2b590d72763bf7c5d (DEFAULT_TABLE table=default.Table_cd6f9353272f406f866b8aea97b47b52 [id=40a32fedadfe44bca3c1013ceb2b84c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.559000 9021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e512c231686948619d338fa0fc8aae03. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.559300 9003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e751be4722043928e6977c48c359aae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.559953 9019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da4da9d74efd427ca27431c54a84a3e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.560169 9020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 266937328422421ab6880d7f7410683e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.560887 9011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ffa009bae84660b331ebeddcccc266. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.561278 9017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6bf35f57e94a1d983612561aa6f185. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.562459 10289 raft_consensus.cc:493] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:15.563299 9014 tablet_service.cc:1505] Processing CreateTablet for tablet f909de19a0184e5b8d54a04ed11a9c70 (DEFAULT_TABLE table=default.Table_d246863c572741ba93765655a7445caf [id=cca2ce26479e46d380155073f70ec267]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.563691 9427 tablet_bootstrap.cc:492] T 6ec16a234222470bb9cf8c29db536cc1 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:15.562611 10289 raft_consensus.cc:515] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.562688 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "034fec793ae74fcda0c73f1cea291311" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:15.565867 9005 tablet_service.cc:1505] Processing CreateTablet for tablet 1b6e5ac88fc74d66a3f74fb69eb01455 (DEFAULT_TABLE table=default.Table_a9c0cd79373b476ba1ecce82ed68b769 [id=c0fd75e313b54744bb00e7f7651febbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.566642 10345 raft_consensus.cc:697] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:15.566968 10345 consensus_queue.cc:237] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.568975 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78b3f18a62d544b38a0682bf3bc00977" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:15.569008 9009 tablet_service.cc:1505] Processing CreateTablet for tablet 410b0b292c204193a4983580abc97aa9 (DEFAULT_TABLE table=default.Table_974ade2140a44f24b046a797944f71f8 [id=854a9d5a60e34e5d86bb2cb63459dad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.569576 9004 tablet_service.cc:1505] Processing CreateTablet for tablet 3bfe7f2bc9b04aaeb6102b6b673d9379 (DEFAULT_TABLE table=default.Table_f85607e14d2647c4a7036f8d5ef7d9f9 [id=49363efafda94f3586957cb145386c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.570236 9041 raft_consensus.cc:2468] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:15.570664 9010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e9f514f7656247fd90f550b4132a15e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.570756 9248 leader_election.cc:304] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:15.570856 9022 consensus_meta.cc:287] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156: Time spent flushing consensus metadata: real 0.592s user 0.003s sys 0.000s
W20251215 14:55:15.571693 8976 leader_election.cc:343] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:15.576545 9014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f909de19a0184e5b8d54a04ed11a9c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.577814 9004 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bfe7f2bc9b04aaeb6102b6b673d9379. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.579049 10529 raft_consensus.cc:2804] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:15.579157 10529 raft_consensus.cc:493] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:15.579274 10529 raft_consensus.cc:3060] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:15.582302 10529 raft_consensus.cc:515] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.583770 9022 tablet_service.cc:1552] Processing DeleteTablet for tablet 548e6d35016746e2b8f5184ee44071cb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:15.584008 10289 leader_election.cc:290] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:15.583662 10529 leader_election.cc:290] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:15.586692 9009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410b0b292c204193a4983580abc97aa9. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:15.595314 8976 consensus_peers.cc:597] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:15.595927 9012 tablet_service.cc:1505] Processing CreateTablet for tablet a9ed7d1946ba433eb8b19ccf6a84b7ad (DEFAULT_TABLE table=default.Table_86c6dc8b4a624840b2920c56cdf1a347 [id=977c10f407a74ad1bb20f1d0026df250]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.596191 9005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6e5ac88fc74d66a3f74fb69eb01455. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.596887 9016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dca27f234054f9582a2ca6c5e6f5cad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.597143 9012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9ed7d1946ba433eb8b19ccf6a84b7ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.597880 9007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c9bc7a7bd4447dba112999eff69c932. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.602264 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "034fec793ae74fcda0c73f1cea291311" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:15.602502 9041 raft_consensus.cc:3060] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:15.605075 9427 tablet_bootstrap.cc:654] T 6ec16a234222470bb9cf8c29db536cc1 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:15.615796 9021 tablet_service.cc:1552] Processing DeleteTablet for tablet ebeebb8f49ef4858804e2ed0b31b2196 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:15.617223 9015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa73a61ff5be4cd2b590d72763bf7c5d. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:15.623518 8976 consensus_peers.cc:597] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:15.633361 9021 tablet_service.cc:1552] Processing DeleteTablet for tablet 6beaf5ae37ce41fd9123d6b3560351b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:15.635354 9021 tablet_service.cc:1505] Processing CreateTablet for tablet c3e5c385232140079705470ad2d6e020 (DEFAULT_TABLE table=default.Table_aee0201b52bb4f58bcde6c4b80d384fc [id=288733c610c443808790a2b63f0ef411]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.642426 9021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3e5c385232140079705470ad2d6e020. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.653394 9013 tablet_service.cc:1505] Processing CreateTablet for tablet 8ae3004e4a76422397c6e1761d020e38 (DEFAULT_TABLE table=default.Table_76bb79d40aa04a9785bc282e229bd6c3 [id=d425ddfc16a24752a1fd3e6fc78e1158]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.664216 9013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae3004e4a76422397c6e1761d020e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.665154 9041 raft_consensus.cc:2468] T 034fec793ae74fcda0c73f1cea291311 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:15.665683 9248 leader_election.cc:304] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:15.666083 10528 raft_consensus.cc:2804] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:15.666473 9008 tablet_service.cc:1552] Processing DeleteTablet for tablet 266937328422421ab6880d7f7410683e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:15 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:15.666875 9008 tablet_service.cc:1552] Processing DeleteTablet for tablet e9353aff4c0742c191b37d3a412ed411 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:15.666927 10528 raft_consensus.cc:697] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:15.667063 9008 tablet_service.cc:1552] Processing DeleteTablet for tablet 9c4be1c01418432492268598f97289a0 with delete_type TABLET_DATA_DELETED (replaced by tablet d261a26a864742afbc0c26a208279a1e) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:15.667505 10528 consensus_queue.cc:237] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.689778 9153 tablet_service.cc:1505] Processing CreateTablet for tablet f909de19a0184e5b8d54a04ed11a9c70 (DEFAULT_TABLE table=default.Table_d246863c572741ba93765655a7445caf [id=cca2ce26479e46d380155073f70ec267]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.690359 9153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f909de19a0184e5b8d54a04ed11a9c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.711226 9142 tablet_service.cc:1505] Processing CreateTablet for tablet 1b6e5ac88fc74d66a3f74fb69eb01455 (DEFAULT_TABLE table=default.Table_a9c0cd79373b476ba1ecce82ed68b769 [id=c0fd75e313b54744bb00e7f7651febbf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.711774 9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6e5ac88fc74d66a3f74fb69eb01455. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.718641 9142 tablet_service.cc:1505] Processing CreateTablet for tablet 410b0b292c204193a4983580abc97aa9 (DEFAULT_TABLE table=default.Table_974ade2140a44f24b046a797944f71f8 [id=854a9d5a60e34e5d86bb2cb63459dad7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.719182 9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410b0b292c204193a4983580abc97aa9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.726161 10443 raft_consensus.cc:493] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:15.726292 10443 raft_consensus.cc:515] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.726927 10443 leader_election.cc:290] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:15.728760 9115 leader_election.cc:343] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2
I20251215 14:55:15.731222 9427 tablet_bootstrap.cc:492] T 6ec16a234222470bb9cf8c29db536cc1 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:15.741269 9174 raft_consensus.cc:3060] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:15.749701 9427 ts_tablet_manager.cc:1403] T 6ec16a234222470bb9cf8c29db536cc1 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.174s user 0.004s sys 0.008s
I20251215 14:55:15.753072 10434 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:15.753237 10434 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.753921 10434 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:15.761756 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:55:15.764642 9146 tablet_service.cc:1505] Processing CreateTablet for tablet a9ed7d1946ba433eb8b19ccf6a84b7ad (DEFAULT_TABLE table=default.Table_86c6dc8b4a624840b2920c56cdf1a347 [id=977c10f407a74ad1bb20f1d0026df250]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.765079 9146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9ed7d1946ba433eb8b19ccf6a84b7ad. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:15.766630 9435 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.574s user 0.008s sys 0.010s
W20251215 14:55:15.766785 9435 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.585s user 0.008s sys 0.010s
I20251215 14:55:15.769322 9427 raft_consensus.cc:359] T 6ec16a234222470bb9cf8c29db536cc1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.770439 9427 raft_consensus.cc:385] T 6ec16a234222470bb9cf8c29db536cc1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:15.770558 9427 raft_consensus.cc:740] T 6ec16a234222470bb9cf8c29db536cc1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:15.770856 9427 consensus_queue.cc:260] T 6ec16a234222470bb9cf8c29db536cc1 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.772094 9435 tablet_bootstrap.cc:492] T 050260e67b924f13847b9550a91e274b P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:15.774185 9146 tablet_service.cc:1552] Processing DeleteTablet for tablet 548e6d35016746e2b8f5184ee44071cb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:15.775269 9146 tablet_service.cc:1505] Processing CreateTablet for tablet c3e5c385232140079705470ad2d6e020 (DEFAULT_TABLE table=default.Table_aee0201b52bb4f58bcde6c4b80d384fc [id=288733c610c443808790a2b63f0ef411]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.776050 9146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3e5c385232140079705470ad2d6e020. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.775511 9435 ts_tablet_manager.cc:1403] T 050260e67b924f13847b9550a91e274b P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.600s user 0.012s sys 0.010s
I20251215 14:55:15.779982 9971 raft_consensus.cc:493] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:15.780149 9971 raft_consensus.cc:515] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.780861 9971 leader_election.cc:290] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:15.787861 9154 tablet_service.cc:1552] Processing DeleteTablet for tablet 266937328422421ab6880d7f7410683e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:15 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:15.787974 9147 tablet_service.cc:1552] Processing DeleteTablet for tablet e9353aff4c0742c191b37d3a412ed411 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:15.791764 9147 tablet_service.cc:1552] Processing DeleteTablet for tablet 9c4be1c01418432492268598f97289a0 with delete_type TABLET_DATA_DELETED (replaced by tablet d261a26a864742afbc0c26a208279a1e) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:15.792307 9361 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
W20251215 14:55:15.795056 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet f4203c4941184a66956ec9be8d703bb6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4203c4941184a66956ec9be8d703bb6 already in progress: creating tablet
I20251215 14:55:15.792856 9435 raft_consensus.cc:359] T 050260e67b924f13847b9550a91e274b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.796312 9435 raft_consensus.cc:385] T 050260e67b924f13847b9550a91e274b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:15.802870 9435 raft_consensus.cc:740] T 050260e67b924f13847b9550a91e274b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:15.807303 9426 tablet_bootstrap.cc:492] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:15.807591 9426 ts_tablet_manager.cc:1403] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.494s user 0.004s sys 0.000s
I20251215 14:55:15.806511 9435 consensus_queue.cc:260] T 050260e67b924f13847b9550a91e274b P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.809409 9426 raft_consensus.cc:359] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.809773 9426 raft_consensus.cc:385] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:15.809927 9426 raft_consensus.cc:740] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:15.810254 9426 consensus_queue.cc:260] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.814988 9435 ts_tablet_manager.cc:1434] T 050260e67b924f13847b9550a91e274b P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.038s user 0.005s sys 0.000s
I20251215 14:55:15.816417 9159 tablet_service.cc:1552] Processing DeleteTablet for tablet 6beaf5ae37ce41fd9123d6b3560351b7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:15.818979 9435 tablet_bootstrap.cc:492] T 78b3f18a62d544b38a0682bf3bc00977 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:15.819849 9153 tablet_service.cc:1505] Processing CreateTablet for tablet 8ae3004e4a76422397c6e1761d020e38 (DEFAULT_TABLE table=default.Table_76bb79d40aa04a9785bc282e229bd6c3 [id=d425ddfc16a24752a1fd3e6fc78e1158]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.820313 9153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ae3004e4a76422397c6e1761d020e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.824084 9427 ts_tablet_manager.cc:1434] T 6ec16a234222470bb9cf8c29db536cc1 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s
I20251215 14:55:15.827507 9156 tablet_service.cc:1505] Processing CreateTablet for tablet 5e751be4722043928e6977c48c359aae (DEFAULT_TABLE table=default.Table_34f674e6f3e34e739110435de6af285e [id=77325fe3ac484f54bb27efb5b009b5a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.828042 9156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e751be4722043928e6977c48c359aae. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:15.840911 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 65ea0509d8eb42bdb2291ff01e8d3bd6
I20251215 14:55:15.841521 8787 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_1becf6c1cac5471f8f5f17e00d4438ec" } modify_external_catalogs: true
I20251215 14:55:15.841728 8787 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_1becf6c1cac5471f8f5f17e00d4438ec" } modify_external_catalogs: true
I20251215 14:55:15.842029 9435 tablet_bootstrap.cc:654] T 78b3f18a62d544b38a0682bf3bc00977 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:15.842990 8781 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_1e4d9ebb532f4e8c9ffc36b6b690d502" } new_table_name: "default.Table_8dab9eb2d771405b82d9f9ac465467ea" modify_external_catalogs: true
I20251215 14:55:15.844413 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_0c1d732b58744089aa183b3b7c0c5976"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:15.844942 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c1d732b58744089aa183b3b7c0c5976 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:15.839012 8779 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c15ea76b3b6f41419688ef6bc1f667cf" } modify_external_catalogs: true
I20251215 14:55:15.846628 8779 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c15ea76b3b6f41419688ef6bc1f667cf" } modify_external_catalogs: true
W20251215 14:55:15.851560 8783 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e9f514f7656247fd90f550b4132a15e6 consensus state has no leader
I20251215 14:55:15.855361 9152 tablet_service.cc:1505] Processing CreateTablet for tablet fa73a61ff5be4cd2b590d72763bf7c5d (DEFAULT_TABLE table=default.Table_cd6f9353272f406f866b8aea97b47b52 [id=40a32fedadfe44bca3c1013ceb2b84c6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.855687 9427 tablet_bootstrap.cc:492] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:15.855845 9152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa73a61ff5be4cd2b590d72763bf7c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.859671 9426 ts_tablet_manager.cc:1434] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.052s user 0.001s sys 0.000s
I20251215 14:55:15.866083 8785 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 6f9cdf8a71f24b7fb820d12c75a226fd
I20251215 14:55:15.866755 9155 tablet_service.cc:1505] Processing CreateTablet for tablet 8f6bf35f57e94a1d983612561aa6f185 (DEFAULT_TABLE table=default.Table_c15fd87a1803401cad889d57d9c16a47 [id=1a176fea11c64039a31b9e77e8a2b8ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.870244 8786 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet e483464be7f042f8bfbc83dcbfa487ca
I20251215 14:55:15.870622 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_6634fdcf66cf46be852cf9c2f31be438"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:15.870810 8783 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_39c1b03aa3924af79af743a252c7d5c4" } modify_external_catalogs: true
I20251215 14:55:15.870988 8783 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_39c1b03aa3924af79af743a252c7d5c4" } modify_external_catalogs: true
W20251215 14:55:15.871238 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6634fdcf66cf46be852cf9c2f31be438 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:15.872092 9155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6bf35f57e94a1d983612561aa6f185. 1 dirs total, 0 dirs full, 0 dirs failed
I20251215 14:55:15.872284 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_41799d90537f45cdb719ce2fb20ec35c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:15.872823 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_41799d90537f45cdb719ce2fb20ec35c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:15.872792 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ae72a1ded6e4faba1ad309d9a0e4a95" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:15.875383 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet f830b4af355e480bbe75d6060585529e
W20251215 14:55:15.875511 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet a0a74645593d46fcbc0235ec6a4670d8
W20251215 14:55:15.875569 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 034fec793ae74fcda0c73f1cea291311
W20251215 14:55:15.875633 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 2d75636265f14a428aae592438064ea2
I20251215 14:55:15.875586 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "21a98ce868924690b8a5715f4103c360" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:15.876538 8782 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c9cd184036e942449e5f5a3d806a1000" } new_table_name: "default.Table_57448b5f02144c98859bff51ab101fe2" modify_external_catalogs: true
I20251215 14:55:15.878131 8780 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_cea06d4fba344de4aa4165c004aa5b46" } new_table_name: "default.Table_681e95321cd9408b86d9b8dc14ab4448" modify_external_catalogs: true
I20251215 14:55:15.879439 8788 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_908bf3eb9e4d45daa3e63b9fb069fcf7" } new_table_name: "default.Table_412efc50b4544770a9606c9dee15a6fd" modify_external_catalogs: true
I20251215 14:55:15.884158 9142 tablet_service.cc:1505] Processing CreateTablet for tablet 3bfe7f2bc9b04aaeb6102b6b673d9379 (DEFAULT_TABLE table=default.Table_f85607e14d2647c4a7036f8d5ef7d9f9 [id=49363efafda94f3586957cb145386c96]), partition=RANGE (key) PARTITION UNBOUNDED
I20251215 14:55:15.884673 9142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bfe7f2bc9b04aaeb6102b6b673d9379. 1 dirs total, 0 dirs full, 0 dirs failed
W20251215 14:55:15.885676 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:15.886603 9248 leader_election.cc:343] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:15.886873 8787 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet bd6ff6e2a97646dbbcf91c53ba51c341
I20251215 14:55:15.886914 9971 raft_consensus.cc:493] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:15.887033 9971 raft_consensus.cc:515] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.887217 8787 master_service.cc:954] ReplaceTablet: received request to replace tablet 56f600c59b094e4f96acec978911a8a7 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:15.887635 9971 leader_election.cc:290] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:15.889559 8779 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 07fafc0eab704e42a793eeb32ac9a7d6
W20251215 14:55:15.889837 8781 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 78c65aae2561484ebbd68d0a0475b27d consensus state has no leader
I20251215 14:55:15.890110 8781 master_service.cc:954] ReplaceTablet: received request to replace tablet 14ac26b3a02449f8a7588151abe7ae10 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:15.890502 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet 07fafc0eab704e42a793eeb32ac9a7d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:15 UTC) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:15.891265 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 07fafc0eab704e42a793eeb32ac9a7d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07fafc0eab704e42a793eeb32ac9a7d6 already in progress: creating tablet
I20251215 14:55:15.895764 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56816add0a61454c9980ad09f5815b09" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:15.896376 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 548e6d35016746e2b8f5184ee44071cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 548e6d35016746e2b8f5184ee44071cb already in progress: creating tablet
I20251215 14:55:15.897248 9038 raft_consensus.cc:2468] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:15.897722 9248 leader_election.cc:304] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:15.898077 9427 tablet_bootstrap.cc:654] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:15.898465 10345 raft_consensus.cc:2804] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20251215 14:55:15.899917 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet ebeebb8f49ef4858804e2ed0b31b2196 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebeebb8f49ef4858804e2ed0b31b2196 already in progress: creating tablet
I20251215 14:55:15.899953 9971 raft_consensus.cc:493] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:15.899955 9146 tablet_service.cc:1552] Processing DeleteTablet for tablet ebeebb8f49ef4858804e2ed0b31b2196 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:14 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:15.900070 9971 raft_consensus.cc:515] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.900656 9971 leader_election.cc:290] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:15.902132 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 6beaf5ae37ce41fd9123d6b3560351b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6beaf5ae37ce41fd9123d6b3560351b7 already in progress: creating tablet
I20251215 14:55:15.898540 10345 raft_consensus.cc:493] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:15.902702 10345 raft_consensus.cc:3060] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:15.905912 10345 raft_consensus.cc:515] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.906229 8781 master_service.cc:954] ReplaceTablet: received request to replace tablet cf6e4aa94f79403588dd1916226660fd from {username='slave'} at 127.0.0.1:49790
W20251215 14:55:15.910113 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 266937328422421ab6880d7f7410683e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 266937328422421ab6880d7f7410683e already in progress: creating tablet
I20251215 14:55:15.912294 9016 tablet_service.cc:1552] Processing DeleteTablet for tablet 07fafc0eab704e42a793eeb32ac9a7d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:15 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:15.913007 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet e9353aff4c0742c191b37d3a412ed411 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9353aff4c0742c191b37d3a412ed411 already in progress: creating tablet
I20251215 14:55:15.916260 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56816add0a61454c9980ad09f5815b09" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
W20251215 14:55:15.917510 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 9c4be1c01418432492268598f97289a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c4be1c01418432492268598f97289a0 already in progress: creating tablet
W20251215 14:55:15.918865 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 07fafc0eab704e42a793eeb32ac9a7d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07fafc0eab704e42a793eeb32ac9a7d6 already in progress: creating tablet
I20251215 14:55:15.919227 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b8a2a337e54321afd67f7562c412a0" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:15.920039 9248 leader_election.cc:343] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:15.920778 9041 raft_consensus.cc:3060] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:15.926573 8783 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 3130e969dc164baf9455bbf87c563b09
W20251215 14:55:15.936879 8780 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd025ffa766d45f8bc6c42c6eaa3418c consensus state has no leader
I20251215 14:55:15.937903 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 56f600c59b094e4f96acec978911a8a7
W20251215 14:55:15.938084 8788 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5875cdedb77841359158f7f185ee30f6 consensus state has no leader
I20251215 14:55:15.938352 8787 catalog_manager.cc:6724] ReplaceTablet: tablet 56f600c59b094e4f96acec978911a8a7 deleted and replaced by tablet 531203af9c674c1bbb9e6a4c2be7eda3
I20251215 14:55:15.939945 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet 56f600c59b094e4f96acec978911a8a7 with delete_type TABLET_DATA_DELETED (replaced by tablet 531203af9c674c1bbb9e6a4c2be7eda3) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:15.940500 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 56f600c59b094e4f96acec978911a8a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56f600c59b094e4f96acec978911a8a7 already in progress: creating tablet
I20251215 14:55:15.949441 9041 raft_consensus.cc:2468] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:15.949962 9248 leader_election.cc:304] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:15.950227 9971 raft_consensus.cc:2804] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:15.950351 9971 raft_consensus.cc:697] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:15.950582 9971 consensus_queue.cc:237] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.951197 10345 leader_election.cc:290] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:15.952477 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet 56f600c59b094e4f96acec978911a8a7 with delete_type TABLET_DATA_DELETED (replaced by tablet 531203af9c674c1bbb9e6a4c2be7eda3) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:15.954030 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 56f600c59b094e4f96acec978911a8a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56f600c59b094e4f96acec978911a8a7 already in progress: creating tablet
W20251215 14:55:15.964548 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 56816add0a61454c9980ad09f5815b09
I20251215 14:55:15.965839 9435 tablet_bootstrap.cc:492] T 78b3f18a62d544b38a0682bf3bc00977 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:15.966037 9435 ts_tablet_manager.cc:1403] T 78b3f18a62d544b38a0682bf3bc00977 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.148s user 0.023s sys 0.006s
I20251215 14:55:15.967283 9435 raft_consensus.cc:359] T 78b3f18a62d544b38a0682bf3bc00977 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:15.967602 9435 raft_consensus.cc:385] T 78b3f18a62d544b38a0682bf3bc00977 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:15.968310 9435 raft_consensus.cc:740] T 78b3f18a62d544b38a0682bf3bc00977 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:15.968645 9435 consensus_queue.cc:260] T 78b3f18a62d544b38a0682bf3bc00977 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:15.973421 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 78b3f18a62d544b38a0682bf3bc00977
I20251215 14:55:15.974174 9435 ts_tablet_manager.cc:1434] T 78b3f18a62d544b38a0682bf3bc00977 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20251215 14:55:15.975545 9435 tablet_bootstrap.cc:492] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:15.979148 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 78b3f18a62d544b38a0682bf3bc00977
I20251215 14:55:15.980585 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77780f8cfe544db7baee2c761fe52ca2" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:15.980886 9038 raft_consensus.cc:2468] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:15.984128 9435 tablet_bootstrap.cc:654] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:15.986042 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc50995f6d934b58ab5f6f6f370cb7e5" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:15.993110 8781 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet cf6e4aa94f79403588dd1916226660fd
I20251215 14:55:15.993980 8781 catalog_manager.cc:6724] ReplaceTablet: tablet cf6e4aa94f79403588dd1916226660fd deleted and replaced by tablet a909bd3c7ff647c1a6a3edd7ede81757
I20251215 14:55:15.994592 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet cf6e4aa94f79403588dd1916226660fd with delete_type TABLET_DATA_DELETED (replaced by tablet a909bd3c7ff647c1a6a3edd7ede81757) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:15.995313 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet cf6e4aa94f79403588dd1916226660fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf6e4aa94f79403588dd1916226660fd already in progress: creating tablet
I20251215 14:55:15.997886 9011 tablet_service.cc:1552] Processing DeleteTablet for tablet cf6e4aa94f79403588dd1916226660fd with delete_type TABLET_DATA_DELETED (replaced by tablet a909bd3c7ff647c1a6a3edd7ede81757) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:16.001169 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet cf6e4aa94f79403588dd1916226660fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf6e4aa94f79403588dd1916226660fd already in progress: creating tablet
I20251215 14:55:16.001715 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78b3f18a62d544b38a0682bf3bc00977" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:16.001927 9308 raft_consensus.cc:2468] T 78b3f18a62d544b38a0682bf3bc00977 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:16.001724 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "050260e67b924f13847b9550a91e274b" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:16.002290 9303 raft_consensus.cc:2468] T 050260e67b924f13847b9550a91e274b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:16.001755 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e48a6b6dfe094c34b30b8d3a44c66435" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:16.003934 9305 raft_consensus.cc:3060] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:16.008255 9305 raft_consensus.cc:1275] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4 [term 2 FOLLOWER]: Refusing update from remote peer 67978ac4539d4b289e53f4eedd9a8156: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 14:55:16.014701 9112 leader_election.cc:304] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:16.015326 10443 raft_consensus.cc:2749] T 6ae72a1ded6e4faba1ad309d9a0e4a95 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:16.015724 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:16.015827 9112 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:16.016287 10443 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:16.018858 9112 leader_election.cc:304] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters: e89303a500544272b601d7c29be802b4
I20251215 14:55:16.019282 10443 raft_consensus.cc:2804] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:16.019362 10443 raft_consensus.cc:493] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:16.019424 10443 raft_consensus.cc:3060] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.022125 10443 raft_consensus.cc:515] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.023257 10443 leader_election.cc:290] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:16.024003 9115 leader_election.cc:343] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2
W20251215 14:55:16.024339 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 548e6d35016746e2b8f5184ee44071cb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 548e6d35016746e2b8f5184ee44071cb already in progress: creating tablet
W20251215 14:55:16.025398 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 266937328422421ab6880d7f7410683e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 266937328422421ab6880d7f7410683e already in progress: creating tablet
W20251215 14:55:16.025864 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet e9353aff4c0742c191b37d3a412ed411 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e9353aff4c0742c191b37d3a412ed411 already in progress: creating tablet
I20251215 14:55:16.040124 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_a6572e88e8114dc3aeab103ce83947af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.040697 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6572e88e8114dc3aeab103ce83947af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.042403 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_1ef864044b7c4984b873771cdbeae8f8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.042884 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ef864044b7c4984b873771cdbeae8f8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.043843 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_53af509bece54e01b0c783cc9d46111c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.044306 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_53af509bece54e01b0c783cc9d46111c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.046193 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_fe694e1b8c904bc7a6b514d2d8cf34d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.046649 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe694e1b8c904bc7a6b514d2d8cf34d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.050397 8780 master_service.cc:954] ReplaceTablet: received request to replace tablet cf6e4aa94f79403588dd1916226660fd from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:16.058027 8787 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_7f1131563cdd40e6a3e28615d4340538" } new_table_name: "default.Table_74d3e3d32e1d494eaf2e694a1313979d" modify_external_catalogs: true
I20251215 14:55:16.060283 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_647e21058c674dc691321db7330b9952"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.060865 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_647e21058c674dc691321db7330b9952 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:16.063092 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet accc3fdaf8e64b0f96b45150a59516bf
W20251215 14:55:16.063269 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 90c0254840b442a3817171b06f2726c8
W20251215 14:55:16.063345 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 3c6cfff573434fbcb18feaf6a8e6a153
W20251215 14:55:16.063412 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet c7f760639a664cfb9f4af5578154b981
W20251215 14:55:16.063469 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 5e80ac7bd98a46119a30bd5d2f3de2f9
W20251215 14:55:16.063512 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 38e50a7f2bdd4907ab41436b59397ea6
W20251215 14:55:16.063570 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet a0a74645593d46fcbc0235ec6a4670d8
W20251215 14:55:16.063612 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 30c5c795ea4a4fe591cdf63320ec2521
W20251215 14:55:16.063665 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 5dd36ea0aa53460f9c1fda4b31063fa7
W20251215 14:55:16.063706 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet d4cff0ed3782446397dbae8a2da52ed7
W20251215 14:55:16.063769 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7
W20251215 14:55:16.063812 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet f830b4af355e480bbe75d6060585529e
W20251215 14:55:16.063863 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 82ca60c5a63744ffb0a0c0a140ef665e
W20251215 14:55:16.063903 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet ff4508c5a110427eb4d9d2eaaadace0b
W20251215 14:55:16.063968 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 18cd1f63d51e4565bb8c55be13e3e099
W20251215 14:55:16.064064 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 88206b17f94242378a35d5314611ac1a
W20251215 14:55:16.064123 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 6ae72a1ded6e4faba1ad309d9a0e4a95
W20251215 14:55:16.064165 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 2d75636265f14a428aae592438064ea2
W20251215 14:55:16.064795 8773 catalog_manager.cc:5058] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): alter failed for tablet 26754a74483c4c9580df93aae10e7de1 (table default.Table_bbbfcbf7cf704bc9b55fd2cf41a7ab5e [id=cbafb4499c90447d8f185928d3e58b20]),no further retry: Not found: Tablet not found: 26754a74483c4c9580df93aae10e7de1
I20251215 14:55:16.065054 10521 tablet.cc:1722] T bfead52afe8040a88ba0d826f482b1bd P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:16.065543 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_3d8a892a9d4a4a54a40eed436b584f9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.066040 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d8a892a9d4a4a54a40eed436b584f9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.066548 8785 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet bfead52afe8040a88ba0d826f482b1bd (table default.Table_57448b5f02144c98859bff51ab101fe2 [id=d8410eb19405483eafbfc5b83e088c2d]). Expected version 1 got 0
I20251215 14:55:16.067008 8785 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_66a863188e16424797450ead992a2bba [id=066e8ae14004436cb8b4f3f740b45b19]). Expected version 5 got 0
I20251215 14:55:16.067354 8785 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet e0c88310853f47b0aa1af9a3d676bef6 (table default.Table_6b689570cd944426b4edf8342163ef0e [id=d0891c1ad38b48348b350482a3298f39]). Expected version 1 got 0
I20251215 14:55:16.067564 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_511cbed8d41a49da9d58d7b8aae2576b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.068059 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_511cbed8d41a49da9d58d7b8aae2576b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.067665 8785 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 2811b8ffdb614c91b0d3d4e6e039245b (table default.Table_12b99071f9224445935f70cba021453f [id=53315a8cf3bd4a05b1c5e30fd0acdd56]). Expected version 1 got 0
I20251215 14:55:16.069918 8784 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_09a33207f66546398b5669c9294fa726" } modify_external_catalogs: true
I20251215 14:55:16.070086 8784 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_09a33207f66546398b5669c9294fa726" } modify_external_catalogs: true
I20251215 14:55:16.073765 8785 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_5c47df95ac124b47aa4d1c9fbdfb0a05" } modify_external_catalogs: true
I20251215 14:55:16.073974 8785 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_5c47df95ac124b47aa4d1c9fbdfb0a05" } modify_external_catalogs: true
I20251215 14:55:16.077646 9226 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
W20251215 14:55:16.082016 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet a0a74645593d46fcbc0235ec6a4670d8
W20251215 14:55:16.082124 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet f830b4af355e480bbe75d6060585529e
W20251215 14:55:16.082171 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 18cd1f63d51e4565bb8c55be13e3e099
I20251215 14:55:16.082350 9427 tablet_bootstrap.cc:492] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:16.082502 9427 ts_tablet_manager.cc:1403] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.245s user 0.002s sys 0.010s
I20251215 14:55:16.082626 8779 catalog_manager.cc:5746] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891) does not have the latest schema for tablet 6ec16a234222470bb9cf8c29db536cc1 (table default.Table_1d4e6d3c6cb74511b929a8c022624c33 [id=c6a51393c76f4e7a83480bcca232e954]). Expected version 1 got 0
I20251215 14:55:16.083333 9427 raft_consensus.cc:359] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.083698 9427 raft_consensus.cc:385] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.083813 9427 raft_consensus.cc:740] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.086849 9172 raft_consensus.cc:1275] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 FOLLOWER]: Refusing update from remote peer 67978ac4539d4b289e53f4eedd9a8156: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 14:55:16.087533 10527 consensus_queue.cc:1048] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:16.088544 8779 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f6164e312b7a4576a27fab2ab89f91ca" } modify_external_catalogs: true
I20251215 14:55:16.088963 8779 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f6164e312b7a4576a27fab2ab89f91ca" } modify_external_catalogs: true
W20251215 14:55:16.090471 8772 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 78c65aae2561484ebbd68d0a0475b27d (table default.Table_8dab9eb2d771405b82d9f9ac465467ea [id=a0e1f90c75fb4d8f9557b10f5cfac2a1], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 78c65aae2561484ebbd68d0a0475b27d consensus state has no leader
I20251215 14:55:16.106382 9435 tablet_bootstrap.cc:492] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:16.106554 9435 ts_tablet_manager.cc:1403] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.131s user 0.018s sys 0.013s
I20251215 14:55:16.107285 9435 raft_consensus.cc:359] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.107455 9435 raft_consensus.cc:385] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.107508 9435 raft_consensus.cc:740] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.107697 9435 consensus_queue.cc:260] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.108217 9435 ts_tablet_manager.cc:1434] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:16.108656 9435 tablet_bootstrap.cc:492] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:16.111485 9435 tablet_bootstrap.cc:654] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.123612 9426 tablet_bootstrap.cc:492] T 5bfe8cc0805247de9df4a59d461818f3 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:16.125320 9426 tablet_bootstrap.cc:654] T 5bfe8cc0805247de9df4a59d461818f3 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.141664 9435 tablet_bootstrap.cc:492] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:16.141899 9435 ts_tablet_manager.cc:1403] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.033s user 0.004s sys 0.006s
I20251215 14:55:16.144121 9435 raft_consensus.cc:359] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.144400 9435 raft_consensus.cc:385] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.145583 10289 consensus_queue.cc:1048] T 3c6cfff573434fbcb18feaf6a8e6a153 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:16.144518 9435 raft_consensus.cc:740] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.147720 9435 consensus_queue.cc:260] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.148658 9435 ts_tablet_manager.cc:1434] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s
I20251215 14:55:16.149574 9435 tablet_bootstrap.cc:492] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:16.155622 9435 tablet_bootstrap.cc:654] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:16.166133 8787 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5e5c1626a30444bf987a7d7e09a586f7 consensus state has no leader
I20251215 14:55:16.170398 8783 master_service.cc:954] ReplaceTablet: received request to replace tablet a1c5659fd65f40b0ab72c164afb8d3fe from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:16.171749 8785 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 54aadbaafb1040b0a40c5818186547f8
I20251215 14:55:16.173156 8787 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c7e52357bee2478fa198e148bb7408d1" } modify_external_catalogs: true
I20251215 14:55:16.173399 8787 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c7e52357bee2478fa198e148bb7408d1" } modify_external_catalogs: true
W20251215 14:55:16.174602 8788 catalog_manager.cc:5487] Ignoring report from unknown tablet c7f760639a664cfb9f4af5578154b981
I20251215 14:55:16.174777 8781 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_961210c318cf477d87a5d6f9dae90d3d" } new_table_name: "default.Table_81685ba007164006bf5a1b6d404cdf63" modify_external_catalogs: true
I20251215 14:55:16.175479 8784 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 41e0d694b1af46b19138ccbffea96f28
I20251215 14:55:16.175642 10434 consensus_queue.cc:1048] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:16.176676 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_61d6d3c362414399b4e4d0d7773fa65e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.176853 8978 leader_election.cc:343] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.177023 8978 leader_election.cc:304] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
W20251215 14:55:16.177277 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61d6d3c362414399b4e4d0d7773fa65e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.177285 10434 raft_consensus.cc:2749] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:16.177462 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_9b4f9c9551944cd1b35e3a614a458474"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.178037 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9b4f9c9551944cd1b35e3a614a458474 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.180850 8785 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_b72e710c503a43c6a815fc53ae465467" } modify_external_catalogs: true
I20251215 14:55:16.181051 8785 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_b72e710c503a43c6a815fc53ae465467" } modify_external_catalogs: true
I20251215 14:55:16.182255 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c2d1dff42cc348af8cf3acb02a77771f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.182901 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2d1dff42cc348af8cf3acb02a77771f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:16.184026 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 56816add0a61454c9980ad09f5815b09
W20251215 14:55:16.184120 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 65ea0509d8eb42bdb2291ff01e8d3bd6
W20251215 14:55:16.184195 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 034fec793ae74fcda0c73f1cea291311
W20251215 14:55:16.184252 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet f830b4af355e480bbe75d6060585529e
W20251215 14:55:16.184330 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 2d75636265f14a428aae592438064ea2
W20251215 14:55:16.184387 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet a0a74645593d46fcbc0235ec6a4670d8
W20251215 14:55:16.184458 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 82ca60c5a63744ffb0a0c0a140ef665e
W20251215 14:55:16.184571 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 194bb745ecb849cb9092fee1afb7dbe6
W20251215 14:55:16.184643 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 9bf4a899338f4bcfac099b5099a22f05
I20251215 14:55:16.185276 8782 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet a639396098a941249afd9c3560073131 (table default.Table_404807c380fa4483ac5e0545eb3028cd [id=5cc820ec2c8b427db1c89647b295363e]). Expected version 1 got 0
I20251215 14:55:16.186475 8782 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_57448b5f02144c98859bff51ab101fe2" } new_table_name: "default.Table_01b15bbef6604cbfb5d1bc97a6067a1c" modify_external_catalogs: true
I20251215 14:55:16.188796 8784 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_846dce0df4e24591ad236b2eedaeecff" } new_table_name: "default.Table_ad300576ad4145bd9eec36368c3c863c" modify_external_catalogs: true
I20251215 14:55:16.190053 10556 tablet.cc:1722] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:16.192034 9011 tablet_service.cc:1552] Processing DeleteTablet for tablet 41e0d694b1af46b19138ccbffea96f28 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:16.198549 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 41e0d694b1af46b19138ccbffea96f28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41e0d694b1af46b19138ccbffea96f28 already in progress: creating tablet
I20251215 14:55:16.207026 9427 consensus_queue.cc:260] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.211596 9427 ts_tablet_manager.cc:1434] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.129s user 0.002s sys 0.000s
I20251215 14:55:16.211961 9427 tablet_bootstrap.cc:492] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:16.213711 9427 tablet_bootstrap.cc:654] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.216423 10521 tablet.cc:1722] T e0c88310853f47b0aa1af9a3d676bef6 P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:16.218073 10527 consensus_queue.cc:1048] T 88206b17f94242378a35d5314611ac1a P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:16.218972 10527 consensus_queue.cc:1048] T accc3fdaf8e64b0f96b45150a59516bf P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:16.219584 8978 leader_election.cc:304] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:16.219799 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "65ea0509d8eb42bdb2291ff01e8d3bd6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:16.220875 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "65ea0509d8eb42bdb2291ff01e8d3bd6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:16.222906 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7634179e7bef4b95ae6e06b4581888e7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:16.227003 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "034fec793ae74fcda0c73f1cea291311" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:16.227751 10506 log.cc:927] Time spent T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Append to log took a long time: real 0.071s user 0.001s sys 0.000s
I20251215 14:55:16.229079 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "034fec793ae74fcda0c73f1cea291311" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:16.230933 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "21a98ce868924690b8a5715f4103c360" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:16.234385 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56816add0a61454c9980ad09f5815b09" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:16.236294 8978 leader_election.cc:304] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:16.236575 10525 raft_consensus.cc:2804] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:16.236872 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b8a2a337e54321afd67f7562c412a0" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:16.236943 10525 raft_consensus.cc:493] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:16.237160 10525 raft_consensus.cc:3060] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.242293 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56816add0a61454c9980ad09f5815b09" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:16.245824 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 9c4be1c01418432492268598f97289a0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 9c4be1c01418432492268598f97289a0 already in progress: creating tablet
I20251215 14:55:16.245884 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet 41e0d694b1af46b19138ccbffea96f28 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:16.246973 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 6beaf5ae37ce41fd9123d6b3560351b7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6beaf5ae37ce41fd9123d6b3560351b7 already in progress: creating tablet
I20251215 14:55:16.248246 8779 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet f45f8b2fbf754d359deb666cb605c789
W20251215 14:55:16.248502 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet ebeebb8f49ef4858804e2ed0b31b2196 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ebeebb8f49ef4858804e2ed0b31b2196 already in progress: creating tablet
I20251215 14:55:16.249001 8779 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_a6572e88e8114dc3aeab103ce83947af" } new_table_name: "default.Table_7bc3a5ba9cdd47e59948a8e4ff01dfbe" modify_external_catalogs: true
W20251215 14:55:16.249915 9249 leader_election.cc:343] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:16.250298 9249 leader_election.cc:343] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:16.250367 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 41e0d694b1af46b19138ccbffea96f28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41e0d694b1af46b19138ccbffea96f28 already in progress: creating tablet
I20251215 14:55:16.250512 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet f45f8b2fbf754d359deb666cb605c789 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:16.250619 9249 consensus_peers.cc:597] T f830b4af355e480bbe75d6060585529e P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20251215 14:55:16.251772 9249 leader_election.cc:343] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:16.251878 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet f45f8b2fbf754d359deb666cb605c789 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f45f8b2fbf754d359deb666cb605c789 already in progress: creating tablet
I20251215 14:55:16.251899 9249 leader_election.cc:304] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:16.252645 10345 raft_consensus.cc:2749] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:16.253014 9011 tablet_service.cc:1552] Processing DeleteTablet for tablet f45f8b2fbf754d359deb666cb605c789 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:16.253935 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet f45f8b2fbf754d359deb666cb605c789 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f45f8b2fbf754d359deb666cb605c789 already in progress: creating tablet
W20251215 14:55:16.255548 9249 consensus_peers.cc:597] T a0a74645593d46fcbc0235ec6a4670d8 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20251215 14:55:16.256872 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 6: this message will repeat every 5th retry.
W20251215 14:55:16.258450 9249 leader_election.cc:343] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:16.261175 9249 leader_election.cc:343] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:16.262545 9249 leader_election.cc:343] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.262717 9249 leader_election.cc:304] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:16.263123 10345 raft_consensus.cc:2749] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:16.265743 9249 leader_election.cc:343] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:16.267854 8781 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e512c231686948619d338fa0fc8aae03 consensus state has no leader
I20251215 14:55:16.268923 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_7b2f1802f1a54482a674dbb5d0fd73a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.269997 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 58926ab073974e2c8b725d5061a544d5
W20251215 14:55:16.271356 9249 leader_election.cc:343] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.271409 8783 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet a1c5659fd65f40b0ab72c164afb8d3fe
I20251215 14:55:16.271585 9249 leader_election.cc:304] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:16.271847 8783 catalog_manager.cc:6724] ReplaceTablet: tablet a1c5659fd65f40b0ab72c164afb8d3fe deleted and replaced by tablet ecb2ae12f3de4d45b984e731bfbb3ed1
I20251215 14:55:16.272063 10345 raft_consensus.cc:2749] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:16.272182 8787 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet a60a795ff6ef43e4bae4c45f28aba05b
W20251215 14:55:16.273948 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b2f1802f1a54482a674dbb5d0fd73a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.273981 8785 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 798eb606957b4cf7a737ec1636437581
W20251215 14:55:16.274727 8784 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e8ffa009bae84660b331ebeddcccc266 consensus state has no leader
I20251215 14:55:16.274839 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet a1c5659fd65f40b0ab72c164afb8d3fe with delete_type TABLET_DATA_DELETED (replaced by tablet ecb2ae12f3de4d45b984e731bfbb3ed1) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:16.275447 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet 798eb606957b4cf7a737ec1636437581 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:16.276198 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet a1c5659fd65f40b0ab72c164afb8d3fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1c5659fd65f40b0ab72c164afb8d3fe already in progress: creating tablet
I20251215 14:55:16.276858 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet 798eb606957b4cf7a737ec1636437581 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:16.277473 9021 tablet_service.cc:1552] Processing DeleteTablet for tablet a1c5659fd65f40b0ab72c164afb8d3fe with delete_type TABLET_DATA_DELETED (replaced by tablet ecb2ae12f3de4d45b984e731bfbb3ed1) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:16.278126 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet 798eb606957b4cf7a737ec1636437581 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 798eb606957b4cf7a737ec1636437581 already in progress: creating tablet
W20251215 14:55:16.278469 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet a1c5659fd65f40b0ab72c164afb8d3fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1c5659fd65f40b0ab72c164afb8d3fe already in progress: creating tablet
I20251215 14:55:16.274856 9435 tablet_bootstrap.cc:492] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:16.278858 9435 ts_tablet_manager.cc:1403] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.130s user 0.008s sys 0.002s
W20251215 14:55:16.279126 9249 leader_election.cc:343] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.279677 9435 raft_consensus.cc:359] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.279851 9435 raft_consensus.cc:385] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.279918 9435 raft_consensus.cc:740] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.280130 9435 consensus_queue.cc:260] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.280629 9435 ts_tablet_manager.cc:1434] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:16.281163 9435 tablet_bootstrap.cc:492] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:16.282317 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet 798eb606957b4cf7a737ec1636437581 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 798eb606957b4cf7a737ec1636437581 already in progress: creating tablet
I20251215 14:55:16.284610 9435 tablet_bootstrap.cc:654] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.285934 8784 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 6ec16a234222470bb9cf8c29db536cc1 (table default.Table_1d4e6d3c6cb74511b929a8c022624c33 [id=c6a51393c76f4e7a83480bcca232e954]). Expected version 1 got 0
I20251215 14:55:16.293708 10527 raft_consensus.cc:2804] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:16.293864 10527 raft_consensus.cc:493] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:16.293943 10527 raft_consensus.cc:3060] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.293956 8784 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 6ec16a234222470bb9cf8c29db536cc1 (table default.Table_1d4e6d3c6cb74511b929a8c022624c33 [id=c6a51393c76f4e7a83480bcca232e954]). Expected version 1 got 0
I20251215 14:55:16.294696 9435 tablet_bootstrap.cc:492] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:16.294921 9435 ts_tablet_manager.cc:1403] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.000s
I20251215 14:55:16.294999 9156 tablet_service.cc:1552] Processing DeleteTablet for tablet 07fafc0eab704e42a793eeb32ac9a7d6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:15 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:16.295820 9156 tablet_service.cc:1552] Processing DeleteTablet for tablet 56f600c59b094e4f96acec978911a8a7 with delete_type TABLET_DATA_DELETED (replaced by tablet 531203af9c674c1bbb9e6a4c2be7eda3) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:16.296607 9156 tablet_service.cc:1552] Processing DeleteTablet for tablet cf6e4aa94f79403588dd1916226660fd with delete_type TABLET_DATA_DELETED (replaced by tablet a909bd3c7ff647c1a6a3edd7ede81757) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:16.296664 10527 raft_consensus.cc:515] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.297544 10527 leader_election.cc:290] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:16.298115 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "050260e67b924f13847b9550a91e274b" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:16.297627 9435 raft_consensus.cc:359] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:16.298450 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 62208.7us
I20251215 14:55:16.298524 9156 tablet_service.cc:1552] Processing DeleteTablet for tablet 41e0d694b1af46b19138ccbffea96f28 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:16.298663 9435 raft_consensus.cc:385] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251215 14:55:16.298995 8978 leader_election.cc:343] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.299186 9156 tablet_service.cc:1552] Processing DeleteTablet for tablet f45f8b2fbf754d359deb666cb605c789 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:16.299073 9435 raft_consensus.cc:740] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.300026 9156 tablet_service.cc:1552] Processing DeleteTablet for tablet a1c5659fd65f40b0ab72c164afb8d3fe with delete_type TABLET_DATA_DELETED (replaced by tablet ecb2ae12f3de4d45b984e731bfbb3ed1) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:16.300927 9156 tablet_service.cc:1552] Processing DeleteTablet for tablet 798eb606957b4cf7a737ec1636437581 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:16.300405 9435 consensus_queue.cc:260] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:16.301797 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 07fafc0eab704e42a793eeb32ac9a7d6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 07fafc0eab704e42a793eeb32ac9a7d6 already in progress: creating tablet
W20251215 14:55:16.302485 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 56f600c59b094e4f96acec978911a8a7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56f600c59b094e4f96acec978911a8a7 already in progress: creating tablet
I20251215 14:55:16.303685 9435 ts_tablet_manager.cc:1434] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s
W20251215 14:55:16.304905 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 90c0254840b442a3817171b06f2726c8
W20251215 14:55:16.305655 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet cf6e4aa94f79403588dd1916226660fd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf6e4aa94f79403588dd1916226660fd already in progress: creating tablet
I20251215 14:55:16.305408 9435 tablet_bootstrap.cc:492] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:16.306267 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 41e0d694b1af46b19138ccbffea96f28 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 41e0d694b1af46b19138ccbffea96f28 already in progress: creating tablet
W20251215 14:55:16.306953 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet f45f8b2fbf754d359deb666cb605c789 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f45f8b2fbf754d359deb666cb605c789 already in progress: creating tablet
W20251215 14:55:16.307657 8976 leader_election.cc:343] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:16.310002 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet a1c5659fd65f40b0ab72c164afb8d3fe because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a1c5659fd65f40b0ab72c164afb8d3fe already in progress: creating tablet
W20251215 14:55:16.310537 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet 798eb606957b4cf7a737ec1636437581 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 798eb606957b4cf7a737ec1636437581 already in progress: creating tablet
I20251215 14:55:16.315766 9435 tablet_bootstrap.cc:654] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:16.321516 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 35326e99d413431583b25d11269d09dc
W20251215 14:55:16.323308 8779 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 43593365acc74583a6cb78a39902be1e has no consensus state
I20251215 14:55:16.299319 8978 leader_election.cc:304] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:16.331892 10527 raft_consensus.cc:2749] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:16.333451 9435 tablet_bootstrap.cc:492] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:16.334389 9435 ts_tablet_manager.cc:1403] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.000s
I20251215 14:55:16.339944 9435 raft_consensus.cc:359] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.342938 10525 raft_consensus.cc:515] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.344465 10525 leader_election.cc:290] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:16.345057 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78b3f18a62d544b38a0682bf3bc00977" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:16.345638 8976 leader_election.cc:343] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.346009 10527 consensus_queue.cc:1048] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:16.346839 10527 consensus_queue.cc:1048] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:16.347656 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:55:16.347941 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:16.348341 10527 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:16.350286 10572 tablet.cc:1722] T e0c88310853f47b0aa1af9a3d676bef6 P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:16.351075 9435 raft_consensus.cc:385] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.351490 9435 raft_consensus.cc:740] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.352380 9435 consensus_queue.cc:260] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.355357 9435 ts_tablet_manager.cc:1434] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.020s user 0.003s sys 0.000s
I20251215 14:55:16.356469 9435 tablet_bootstrap.cc:492] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:16.359400 9426 tablet_bootstrap.cc:492] T 5bfe8cc0805247de9df4a59d461818f3 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:16.359557 9426 ts_tablet_manager.cc:1403] T 5bfe8cc0805247de9df4a59d461818f3 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.236s user 0.002s sys 0.002s
I20251215 14:55:16.361991 9435 tablet_bootstrap.cc:654] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.366394 8779 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_93abc1b542b8432284fd5c8965eefd8c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.367043 8779 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93abc1b542b8432284fd5c8965eefd8c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.368033 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ff84c6427c9a47c6a9e6f62771ffd886"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.369256 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ff84c6427c9a47c6a9e6f62771ffd886 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.370761 8785 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_511cbed8d41a49da9d58d7b8aae2576b" } new_table_name: "default.Table_d13e49139f6a417ab944ef4cf9deabed" modify_external_catalogs: true
I20251215 14:55:16.374696 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_10d22e1a78f14631b77205e8829d9ecd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:16.374774 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_49318a33b4dd415982185daec5fe9621"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.375304 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49318a33b4dd415982185daec5fe9621 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.375240 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_deeb2173d4294616a79df9807687cc18"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:16.375977 8787 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_8ad0b32830224acbb2af0187d4e1c783" } modify_external_catalogs: true
I20251215 14:55:16.376320 8787 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_8ad0b32830224acbb2af0187d4e1c783" } modify_external_catalogs: true
I20251215 14:55:16.376446 9435 tablet_bootstrap.cc:492] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:16.376663 9435 ts_tablet_manager.cc:1403] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.001s
W20251215 14:55:16.377662 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_10d22e1a78f14631b77205e8829d9ecd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.377840 9435 raft_consensus.cc:359] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.378155 9435 raft_consensus.cc:385] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.378300 9435 raft_consensus.cc:740] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.378628 9435 consensus_queue.cc:260] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.379451 9435 ts_tablet_manager.cc:1434] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
W20251215 14:55:16.375741 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_deeb2173d4294616a79df9807687cc18 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.381856 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_0f97a4422fc04db4b779ee10f1ce75e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.382395 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f97a4422fc04db4b779ee10f1ce75e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.383483 8782 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_eadbf387a9344a44866d99c147155c8c" } modify_external_catalogs: true
I20251215 14:55:16.383657 8782 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_eadbf387a9344a44866d99c147155c8c" } modify_external_catalogs: true
I20251215 14:55:16.387251 9435 tablet_bootstrap.cc:492] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:16.391505 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:16.391618 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77780f8cfe544db7baee2c761fe52ca2" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:16.396096 9042 raft_consensus.cc:3060] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.399072 10556 tablet.cc:1722] T bfead52afe8040a88ba0d826f482b1bd P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:16.401293 9042 raft_consensus.cc:2468] T 77780f8cfe544db7baee2c761fe52ca2 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
W20251215 14:55:16.404122 8785 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0581c1f533f9450997198fe5e4cf6a2f has no consensus state
I20251215 14:55:16.404557 8787 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet e6f6324610f44cefb0ce67fd76e0e001
I20251215 14:55:16.405973 8782 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet f4ec165149a74778aee1fb39c4d96871
I20251215 14:55:16.408886 9021 tablet_service.cc:1552] Processing DeleteTablet for tablet e6f6324610f44cefb0ce67fd76e0e001 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:16.409142 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet f4ec165149a74778aee1fb39c4d96871 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:16.410678 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet 7634179e7bef4b95ae6e06b4581888e7
W20251215 14:55:16.414753 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet e6f6324610f44cefb0ce67fd76e0e001 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6f6324610f44cefb0ce67fd76e0e001 already in progress: creating tablet
W20251215 14:55:16.415119 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet f4ec165149a74778aee1fb39c4d96871 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4ec165149a74778aee1fb39c4d96871 already in progress: creating tablet
I20251215 14:55:16.423589 9112 leader_election.cc:304] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters: e89303a500544272b601d7c29be802b4
I20251215 14:55:16.424010 10443 raft_consensus.cc:2804] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:16.424129 10443 raft_consensus.cc:697] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:16.428194 10525 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:16.428417 10525 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.429252 10525 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:16.424347 10443 consensus_queue.cc:237] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.434968 9152 tablet_service.cc:1552] Processing DeleteTablet for tablet e6f6324610f44cefb0ce67fd76e0e001 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:16.436759 10521 tablet.cc:1722] T bfead52afe8040a88ba0d826f482b1bd P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20251215 14:55:16.439726 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet e6f6324610f44cefb0ce67fd76e0e001 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6f6324610f44cefb0ce67fd76e0e001 already in progress: creating tablet
W20251215 14:55:16.440893 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:55:16.443826 9152 tablet_service.cc:1552] Processing DeleteTablet for tablet f4ec165149a74778aee1fb39c4d96871 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:16.445343 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet f4ec165149a74778aee1fb39c4d96871 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4ec165149a74778aee1fb39c4d96871 already in progress: creating tablet
I20251215 14:55:16.453444 8779 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_404807c380fa4483ac5e0545eb3028cd" } modify_external_catalogs: true
I20251215 14:55:16.453683 8779 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_404807c380fa4483ac5e0545eb3028cd" } modify_external_catalogs: true
I20251215 14:55:16.457403 9426 raft_consensus.cc:359] T 5bfe8cc0805247de9df4a59d461818f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.457597 9426 raft_consensus.cc:385] T 5bfe8cc0805247de9df4a59d461818f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.457649 9426 raft_consensus.cc:740] T 5bfe8cc0805247de9df4a59d461818f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.459971 10345 raft_consensus.cc:493] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:16.461043 10345 raft_consensus.cc:515] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.461431 9426 consensus_queue.cc:260] T 5bfe8cc0805247de9df4a59d461818f3 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.461716 10345 leader_election.cc:290] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:16.461936 9426 ts_tablet_manager.cc:1434] T 5bfe8cc0805247de9df4a59d461818f3 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.102s user 0.002s sys 0.000s
I20251215 14:55:16.462194 9426 tablet_bootstrap.cc:492] T 90c0254840b442a3817171b06f2726c8 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:16.464781 9435 tablet_bootstrap.cc:654] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.467149 8779 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet a639396098a941249afd9c3560073131
I20251215 14:55:16.466382 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ec16a234222470bb9cf8c29db536cc1" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:16.467753 9249 leader_election.cc:343] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.469458 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet a639396098a941249afd9c3560073131 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:16.469691 9426 tablet_bootstrap.cc:654] T 90c0254840b442a3817171b06f2726c8 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.469726 10533 tablet_replica.cc:333] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:16.469914 10533 raft_consensus.cc:2243] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:16.470113 10533 raft_consensus.cc:2272] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:16.470646 10533 ts_tablet_manager.cc:1916] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:16.473145 9435 tablet_bootstrap.cc:492] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:16.474162 8779 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_7bc3a5ba9cdd47e59948a8e4ff01dfbe" } new_table_name: "default.Table_befd8c21ec73402dbc8b8742b7971cbe" modify_external_catalogs: true
I20251215 14:55:16.474526 8784 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_9bf35df49ebd45828517508eed4a90d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.475116 8784 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9bf35df49ebd45828517508eed4a90d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.475706 8780 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_81685ba007164006bf5a1b6d404cdf63" } modify_external_catalogs: true
I20251215 14:55:16.475891 8780 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_81685ba007164006bf5a1b6d404cdf63" } modify_external_catalogs: true
I20251215 14:55:16.476378 8788 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_85664ed43073430ba25d65731ed7ca2e" } new_table_name: "default.Table_05e678552a414788ab9bf4f8e5e2fccd" modify_external_catalogs: true
I20251215 14:55:16.476987 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_c51b17f3569c4d6ab095b87ec21e8ef8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:16.473310 9435 ts_tablet_manager.cc:1403] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.087s user 0.004s sys 0.000s
W20251215 14:55:16.477458 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c51b17f3569c4d6ab095b87ec21e8ef8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.478080 9435 raft_consensus.cc:359] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.478273 9435 raft_consensus.cc:385] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.478335 9435 raft_consensus.cc:740] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.478533 9435 consensus_queue.cc:260] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.479038 9435 ts_tablet_manager.cc:1434] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:16.479244 9152 tablet_service.cc:1552] Processing DeleteTablet for tablet a639396098a941249afd9c3560073131 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:16.479514 10544 tablet_replica.cc:333] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:16.479717 10544 raft_consensus.cc:2243] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:16.479918 10544 raft_consensus.cc:2272] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:16.480422 9435 tablet_bootstrap.cc:492] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:16.480468 10544 ts_tablet_manager.cc:1916] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:16.482038 9435 tablet_bootstrap.cc:654] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.482540 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_f97b5a2d1db247b4841bce41a37cfd82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.483052 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f97b5a2d1db247b4841bce41a37cfd82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.484246 8785 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_eec6fe4b648b481ab6d411e3cf33dcca" } new_table_name: "default.Table_c21631fbd6834691b7b4e9b6ea65b848" modify_external_catalogs: true
I20251215 14:55:16.487485 8786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_3194032074824e83a1f02ad85fbba951" } modify_external_catalogs: true
I20251215 14:55:16.487685 8786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_3194032074824e83a1f02ad85fbba951" } modify_external_catalogs: true
I20251215 14:55:16.489800 10544 ts_tablet_manager.cc:1929] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:16.489908 10544 log.cc:1199] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/a639396098a941249afd9c3560073131
I20251215 14:55:16.490621 10544 ts_tablet_manager.cc:1950] T a639396098a941249afd9c3560073131 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:16.491346 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet a639396098a941249afd9c3560073131 (table default.Table_404807c380fa4483ac5e0545eb3028cd [id=5cc820ec2c8b427db1c89647b295363e]) successfully deleted
I20251215 14:55:16.504352 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "050260e67b924f13847b9550a91e274b" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:16.504572 9304 raft_consensus.cc:3060] T 050260e67b924f13847b9550a91e274b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.505726 9427 tablet_bootstrap.cc:492] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:16.505939 9427 ts_tablet_manager.cc:1403] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.294s user 0.001s sys 0.007s
I20251215 14:55:16.506726 9427 raft_consensus.cc:359] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.506963 9427 raft_consensus.cc:385] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.507292 9304 raft_consensus.cc:2468] T 050260e67b924f13847b9550a91e274b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:16.507104 9427 raft_consensus.cc:740] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.511397 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78b3f18a62d544b38a0682bf3bc00977" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:16.511607 9304 raft_consensus.cc:3060] T 78b3f18a62d544b38a0682bf3bc00977 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.514644 9304 raft_consensus.cc:2468] T 78b3f18a62d544b38a0682bf3bc00977 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:16.524737 10525 raft_consensus.cc:493] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:16.524940 10525 raft_consensus.cc:515] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.526021 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4cff0ed3782446397dbae8a2da52ed7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:16.526521 8976 leader_election.cc:343] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.526862 10525 leader_election.cc:290] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:16.536903 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 11a5a6a0895c49648c910fa2ea3ca373
W20251215 14:55:16.537077 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7
W20251215 14:55:16.537130 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 5560a21e16bb43c7903c1fc66429ecdf
W20251215 14:55:16.537214 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 77780f8cfe544db7baee2c761fe52ca2
W20251215 14:55:16.537300 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet 6ae72a1ded6e4faba1ad309d9a0e4a95
W20251215 14:55:16.537362 8781 catalog_manager.cc:5487] Ignoring report from unknown tablet ff4508c5a110427eb4d9d2eaaadace0b
I20251215 14:55:16.537995 8781 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_66a863188e16424797450ead992a2bba [id=066e8ae14004436cb8b4f3f740b45b19]). Expected version 5 got 0
I20251215 14:55:16.538211 8781 catalog_manager.cc:5746] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013) does not have the latest schema for tablet bfead52afe8040a88ba0d826f482b1bd (table default.Table_01b15bbef6604cbfb5d1bc97a6067a1c [id=d8410eb19405483eafbfc5b83e088c2d]). Expected version 2 got 1
I20251215 14:55:16.538589 8782 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c01c8c15541e45b98fa0cb0fa7502dac" } new_table_name: "default.Table_34ff40356e3b4819976ee8b3d0698efe" modify_external_catalogs: true
W20251215 14:55:16.539011 8788 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a5b0004e03d4c068419eb00ebadf3f9 consensus state has no leader
I20251215 14:55:16.540280 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_cd12ba23af3241aabaa0b5443a350f0f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.540791 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd12ba23af3241aabaa0b5443a350f0f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:16.540795 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet d4cff0ed3782446397dbae8a2da52ed7
W20251215 14:55:16.542133 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 7c9141d604c34314a462b892076b7224
I20251215 14:55:16.543129 8780 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet e512c231686948619d338fa0fc8aae03
I20251215 14:55:16.543843 9152 tablet_service.cc:1552] Processing DeleteTablet for tablet e512c231686948619d338fa0fc8aae03 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:50264
W20251215 14:55:16.544579 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet e512c231686948619d338fa0fc8aae03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e512c231686948619d338fa0fc8aae03 already in progress: creating tablet
I20251215 14:55:16.546310 8783 master_service.cc:954] ReplaceTablet: received request to replace tablet 86f18ff40af547da85de8966b12f76f4 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:16.548005 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet e512c231686948619d338fa0fc8aae03 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:16.548593 8779 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 43593365acc74583a6cb78a39902be1e has no consensus state
I20251215 14:55:16.551524 9435 tablet_bootstrap.cc:492] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:16.551674 9435 ts_tablet_manager.cc:1403] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.071s user 0.006s sys 0.000s
I20251215 14:55:16.552454 9435 raft_consensus.cc:359] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.552635 9435 raft_consensus.cc:385] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.552708 9435 raft_consensus.cc:740] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.552976 9435 consensus_queue.cc:260] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.553484 9435 ts_tablet_manager.cc:1434] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:16.553754 9435 tablet_bootstrap.cc:492] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:16.553829 8779 master_service.cc:954] ReplaceTablet: received request to replace tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:16.557780 9427 consensus_queue.cc:260] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.558727 9427 ts_tablet_manager.cc:1434] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.053s user 0.001s sys 0.001s
I20251215 14:55:16.559157 9427 tablet_bootstrap.cc:492] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:16.560158 8785 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d531a17b6d1d47fa9606e0a8206b3bfd consensus state has no leader
I20251215 14:55:16.562083 9426 tablet_bootstrap.cc:492] T 90c0254840b442a3817171b06f2726c8 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:16.562444 9426 ts_tablet_manager.cc:1403] T 90c0254840b442a3817171b06f2726c8 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.100s user 0.002s sys 0.001s
I20251215 14:55:16.565378 9426 raft_consensus.cc:359] T 90c0254840b442a3817171b06f2726c8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.565835 9426 raft_consensus.cc:385] T 90c0254840b442a3817171b06f2726c8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.566047 9426 raft_consensus.cc:740] T 90c0254840b442a3817171b06f2726c8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.566642 10521 tablet.cc:1722] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20251215 14:55:16.566813 9426 consensus_queue.cc:260] T 90c0254840b442a3817171b06f2726c8 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.567229 10572 tablet.cc:1722] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20251215 14:55:16.568219 9426 ts_tablet_manager.cc:1434] T 90c0254840b442a3817171b06f2726c8 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20251215 14:55:16.568959 9426 tablet_bootstrap.cc:492] T 56816add0a61454c9980ad09f5815b09 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:16.573602 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ec16a234222470bb9cf8c29db536cc1" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:16.573799 9042 raft_consensus.cc:2468] T 6ec16a234222470bb9cf8c29db536cc1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:16.576560 8786 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet bb3b95d32c7044bd8a4451381c19aeba
I20251215 14:55:16.577001 8779 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet 08ca9ee6b76b4b13b7bc26d65dcc3979
I20251215 14:55:16.577384 8779 catalog_manager.cc:6724] ReplaceTablet: tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 deleted and replaced by tablet f35876372f544f9aa85e6d1a73c80bf8
I20251215 14:55:16.577458 9152 tablet_service.cc:1552] Processing DeleteTablet for tablet bb3b95d32c7044bd8a4451381c19aeba with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:16.577690 10544 tablet_replica.cc:333] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:16.577873 10544 raft_consensus.cc:2243] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:16.578059 10544 raft_consensus.cc:2272] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251215 14:55:16.578480 8782 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bc9c699d00b64239b3190e57f0f42011 consensus state has no leader
I20251215 14:55:16.578610 10544 ts_tablet_manager.cc:1916] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:16.580125 9152 tablet_service.cc:1552] Processing DeleteTablet for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 with delete_type TABLET_DATA_DELETED (replaced by tablet f35876372f544f9aa85e6d1a73c80bf8) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:16.580952 9013 tablet_service.cc:1552] Processing DeleteTablet for tablet bb3b95d32c7044bd8a4451381c19aeba with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:16.581060 9021 tablet_service.cc:1552] Processing DeleteTablet for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 with delete_type TABLET_DATA_DELETED (replaced by tablet f35876372f544f9aa85e6d1a73c80bf8) from {username='slave'} at 127.0.0.1:40622
I20251215 14:55:16.582067 9427 tablet_bootstrap.cc:654] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.589802 10544 ts_tablet_manager.cc:1929] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251215 14:55:16.590049 10544 log.cc:1199] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/bb3b95d32c7044bd8a4451381c19aeba
I20251215 14:55:16.590816 10544 ts_tablet_manager.cc:1950] T bb3b95d32c7044bd8a4451381c19aeba P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:16.584848 10533 ts_tablet_manager.cc:1929] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:16.591275 10533 log.cc:1199] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/a639396098a941249afd9c3560073131
I20251215 14:55:16.591610 10533 ts_tablet_manager.cc:1950] T a639396098a941249afd9c3560073131 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:16.592025 10544 tablet_replica.cc:333] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3: stopping tablet replica
I20251215 14:55:16.592031 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet bb3b95d32c7044bd8a4451381c19aeba (table default.Table_3194032074824e83a1f02ad85fbba951 [id=7ec65d77d89d4e40a60b716f721e2940]) successfully deleted
I20251215 14:55:16.592379 10544 raft_consensus.cc:2243] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:16.592638 10533 tablet_replica.cc:333] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:16.592820 10533 raft_consensus.cc:2243] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:16.593016 10533 raft_consensus.cc:2272] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:16.593020 10544 raft_consensus.cc:2272] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:16.593536 10533 ts_tablet_manager.cc:1916] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:16.595522 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet a639396098a941249afd9c3560073131 (table default.Table_404807c380fa4483ac5e0545eb3028cd [id=5cc820ec2c8b427db1c89647b295363e]) successfully deleted
I20251215 14:55:16.595356 10544 ts_tablet_manager.cc:1916] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251215 14:55:16.595815 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet e512c231686948619d338fa0fc8aae03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e512c231686948619d338fa0fc8aae03 already in progress: creating tablet
I20251215 14:55:16.602419 9426 tablet_bootstrap.cc:654] T 56816add0a61454c9980ad09f5815b09 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.607522 8779 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_a1f54fa8891f477eac38ebab96c6df39" } new_table_name: "default.Table_0d0e046980a2418d87a98b51b67c98d0" modify_external_catalogs: true
I20251215 14:55:16.607491 8787 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_b99432f934c244e39cd3f09546beb48c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:16.607810 9427 tablet_bootstrap.cc:492] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:16.607931 9427 ts_tablet_manager.cc:1403] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.049s user 0.003s sys 0.000s
W20251215 14:55:16.608135 8787 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b99432f934c244e39cd3f09546beb48c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.609278 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ddd17611b15446d899f5f8fa6029906f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.609759 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddd17611b15446d899f5f8fa6029906f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.611567 8786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c9b9e88efddf4c879e3987b947dd7645" } modify_external_catalogs: true
I20251215 14:55:16.611714 8786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c9b9e88efddf4c879e3987b947dd7645" } modify_external_catalogs: true
I20251215 14:55:16.612337 9427 raft_consensus.cc:359] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.612542 9427 raft_consensus.cc:385] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.612617 9427 raft_consensus.cc:740] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.612668 10533 ts_tablet_manager.cc:1929] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251215 14:55:16.612879 9427 consensus_queue.cc:260] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.613103 8785 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f1d7edf50eeb4a12b5adc5dcdfd7314f" } modify_external_catalogs: true
I20251215 14:55:16.613265 8785 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f1d7edf50eeb4a12b5adc5dcdfd7314f" } modify_external_catalogs: true
I20251215 14:55:16.613566 9427 ts_tablet_manager.cc:1434] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20251215 14:55:16.613600 8781 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_4ee4c9c110f444baa579c7df07eaad7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:16.613940 9427 tablet_bootstrap.cc:492] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:16.614075 8781 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ee4c9c110f444baa579c7df07eaad7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.614249 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_eb62d706a3b7489d891afdfe4d5e24dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.614698 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb62d706a3b7489d891afdfe4d5e24dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.615725 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_e91e31629d3f4fa0becc33e9a019568c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.616144 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e91e31629d3f4fa0becc33e9a019568c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:16.619097 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 5bfe8cc0805247de9df4a59d461818f3
I20251215 14:55:16.619313 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_77ed11a09ee541b4a884ed6723ab7eab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.619753 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77ed11a09ee541b4a884ed6723ab7eab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:16.619925 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 77780f8cfe544db7baee2c761fe52ca2
I20251215 14:55:16.632313 10525 raft_consensus.cc:493] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:16.632556 10525 raft_consensus.cc:515] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.633147 10525 leader_election.cc:290] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:16.633662 10533 log.cc:1199] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/bb3b95d32c7044bd8a4451381c19aeba
I20251215 14:55:16.634068 10533 ts_tablet_manager.cc:1950] T bb3b95d32c7044bd8a4451381c19aeba P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:16.635098 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet bb3b95d32c7044bd8a4451381c19aeba (table default.Table_3194032074824e83a1f02ad85fbba951 [id=7ec65d77d89d4e40a60b716f721e2940]) successfully deleted
W20251215 14:55:16.642940 8779 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e48a6b6dfe094c34b30b8d3a44c66435 consensus state has no leader
I20251215 14:55:16.645799 8784 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_01b15bbef6604cbfb5d1bc97a6067a1c [id=d8410eb19405483eafbfc5b83e088c2d] alter complete (version 2)
I20251215 14:55:16.646088 8786 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 025c464691b043fb904a48aa9c3bda6e
I20251215 14:55:16.648373 8785 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet 6eb673f9ae0648f4a248db335c67745d
I20251215 14:55:16.652024 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7634179e7bef4b95ae6e06b4581888e7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:16.652704 9289 tablet_service.cc:1552] Processing DeleteTablet for tablet f4ec165149a74778aee1fb39c4d96871 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:16.652907 9276 tablet_service.cc:1552] Processing DeleteTablet for tablet a639396098a941249afd9c3560073131 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:33372
W20251215 14:55:16.653837 8976 leader_election.cc:343] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.654618 9278 tablet_service.cc:1552] Processing DeleteTablet for tablet e512c231686948619d338fa0fc8aae03 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:16.654661 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet e6f6324610f44cefb0ce67fd76e0e001 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:16.654858 10345 raft_consensus.cc:493] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:16.655119 9435 tablet_bootstrap.cc:654] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.657305 10533 tablet_replica.cc:333] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156: stopping tablet replica
I20251215 14:55:16.661743 8785 master_service.cc:954] ReplaceTablet: received request to replace tablet 26648bf286c94b2495e565969f945858 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:16.665086 8784 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_6b689570cd944426b4edf8342163ef0e [id=d0891c1ad38b48348b350482a3298f39] alter complete (version 1)
I20251215 14:55:16.669736 8784 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_df1aac21fb3a4eb5a83b087fa50c04d5" } modify_external_catalogs: true
I20251215 14:55:16.669961 8784 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_df1aac21fb3a4eb5a83b087fa50c04d5" } modify_external_catalogs: true
W20251215 14:55:16.659668 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 65838.7us
W20251215 14:55:16.671833 8785 catalog_manager.cc:5487] Ignoring report from unknown tablet 90c0254840b442a3817171b06f2726c8
I20251215 14:55:16.671878 8978 leader_election.cc:304] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:16.672413 10525 raft_consensus.cc:2804] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:16.672539 10525 raft_consensus.cc:697] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:16.672749 10525 consensus_queue.cc:237] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.678465 9295 tablet_service.cc:1552] Processing DeleteTablet for tablet bb3b95d32c7044bd8a4451381c19aeba with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:16.678861 9280 tablet_service.cc:1552] Processing DeleteTablet for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 with delete_type TABLET_DATA_DELETED (replaced by tablet f35876372f544f9aa85e6d1a73c80bf8) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:16.680351 8785 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_66a863188e16424797450ead992a2bba [id=066e8ae14004436cb8b4f3f740b45b19] alter complete (version 5)
I20251215 14:55:16.682291 8784 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet fd929dd8bbdb4d00b98691b0300b1ae6
I20251215 14:55:16.662741 10572 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:40622 (request call id 318) took 1113 ms. Trace:
I20251215 14:55:16.689704 9944 tablet_replica.cc:333] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:16.689718 10345 raft_consensus.cc:515] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.689667 9971 raft_consensus.cc:493] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:16.665239 9427 tablet_bootstrap.cc:654] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.689361 10572 rpcz_store.cc:276] 1215 14:55:15.549476 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:15.549633 (+ 157us) service_pool.cc:225] Handling call
1215 14:55:16.662722 (+1113089us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:15.757120 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
1215 14:55:15.759793 (+ 2673us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
1215 14:55:15.759803 (+ 10us) alter_schema_op.cc:66] Acquired schema lock
1215 14:55:15.759812 (+ 9us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
1215 14:55:15.760595 (+ 783us) alter_schema_op.cc:128] START. Timestamp: 1765810515760535
1215 14:55:15.760599 (+ 4us) op_driver.cc:348] REPLICATION: starting
1215 14:55:15.771392 (+ 10793us) log.cc:844] Serialized 173 byte log entry
1215 14:55:16.565066 (+793674us) op_driver.cc:464] REPLICATION: finished
1215 14:55:16.567150 (+ 2084us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
1215 14:55:16.567801 (+ 651us) log.cc:844] Serialized 5 byte log entry
1215 14:55:16.627057 (+ 59256us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:16.627371 (+ 314us) log.cc:844] Serialized 14 byte log entry
1215 14:55:16.662671 (+ 35300us) alter_schema_op.cc:73] Released schema lock
1215 14:55:16.662677 (+ 6us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":2019,"prepare.queue_time_us":185946,"prepare.run_cpu_time_us":62615,"prepare.run_wall_time_us":372404,"replication_time_us":804435,"thread_start_us":530808,"threads_started":2,"wal-append.queue_time_us":388027}]]}
I20251215 14:55:16.692458 9944 raft_consensus.cc:2243] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Raft consensus shutting down.
W20251215 14:55:16.693159 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet f4ec165149a74778aee1fb39c4d96871 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f4ec165149a74778aee1fb39c4d96871 already in progress: creating tablet
I20251215 14:55:16.695657 9426 tablet_bootstrap.cc:492] T 56816add0a61454c9980ad09f5815b09 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:16.695866 9426 ts_tablet_manager.cc:1403] T 56816add0a61454c9980ad09f5815b09 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.127s user 0.006s sys 0.000s
I20251215 14:55:16.696586 9426 raft_consensus.cc:359] T 56816add0a61454c9980ad09f5815b09 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.696753 9426 raft_consensus.cc:385] T 56816add0a61454c9980ad09f5815b09 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.696966 9426 raft_consensus.cc:740] T 56816add0a61454c9980ad09f5815b09 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.697172 9426 consensus_queue.cc:260] T 56816add0a61454c9980ad09f5815b09 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.697674 9426 ts_tablet_manager.cc:1434] T 56816add0a61454c9980ad09f5815b09 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:16.708655 9426 tablet_bootstrap.cc:492] T 82ca60c5a63744ffb0a0c0a140ef665e P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:16.701117 9427 tablet_bootstrap.cc:492] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:16.711440 9427 ts_tablet_manager.cc:1403] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.098s user 0.003s sys 0.001s
W20251215 14:55:16.711552 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 56816add0a61454c9980ad09f5815b09
I20251215 14:55:16.712704 9427 raft_consensus.cc:359] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.712962 10544 ts_tablet_manager.cc:1929] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:16.712977 9427 raft_consensus.cc:385] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.713035 9427 raft_consensus.cc:740] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.713279 9427 consensus_queue.cc:260] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.714010 9427 ts_tablet_manager.cc:1434] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:16.715344 10544 log.cc:1199] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-1/wal/wals/08ca9ee6b76b4b13b7bc26d65dcc3979
I20251215 14:55:16.715780 10544 ts_tablet_manager.cc:1950] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 3ea5306c36594ef4a62211f2bd6669a3: Deleting consensus metadata
I20251215 14:55:16.717613 8773 catalog_manager.cc:4985] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1]) successfully deleted
I20251215 14:55:16.716478 9426 tablet_bootstrap.cc:654] T 82ca60c5a63744ffb0a0c0a140ef665e P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.721521 9427 tablet_bootstrap.cc:492] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:16.723194 9427 tablet_bootstrap.cc:654] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.692123 9971 raft_consensus.cc:515] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.726612 10528 raft_consensus.cc:493] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:16.726797 9944 raft_consensus.cc:2272] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:16.727576 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4cff0ed3782446397dbae8a2da52ed7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:16.728490 10521 tablet.cc:1717] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3: Skipping requested alter to schema version 5, tablet already version 5
W20251215 14:55:16.729175 9249 leader_election.cc:343] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:16.729871 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 56816add0a61454c9980ad09f5815b09
I20251215 14:55:16.729972 9971 leader_election.cc:290] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:16.730677 10528 raft_consensus.cc:515] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:16.735282 9249 consensus_peers.cc:597] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:16.735996 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58926ab073974e2c8b725d5061a544d5" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:16.736124 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79f3a7a065d243c98b465a984bd2b1f9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:16.739259 9944 ts_tablet_manager.cc:1916] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:16.728363 10572 tablet.cc:1717] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156: Skipping requested alter to schema version 5, tablet already version 5
W20251215 14:55:16.731535 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 47529.5us
I20251215 14:55:16.734915 10533 raft_consensus.cc:2243] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:16.740078 10533 raft_consensus.cc:2272] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:16.740104 10572 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:40622 (request call id 334) took 1107 ms. Trace:
I20251215 14:55:16.740188 10572 rpcz_store.cc:276] 1215 14:55:15.632356 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:15.707879 (+ 75523us) service_pool.cc:225] Handling call
1215 14:55:16.739833 (+1031954us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:16.129271 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
1215 14:55:16.129405 (+ 134us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
1215 14:55:16.662751 (+533346us) alter_schema_op.cc:66] Acquired schema lock
1215 14:55:16.662762 (+ 11us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
1215 14:55:16.662798 (+ 36us) alter_schema_op.cc:128] START. Timestamp: 1765810516662976
1215 14:55:16.662801 (+ 3us) op_driver.cc:348] REPLICATION: starting
1215 14:55:16.662965 (+ 164us) log.cc:844] Serialized 173 byte log entry
1215 14:55:16.728248 (+ 65283us) op_driver.cc:464] REPLICATION: finished
1215 14:55:16.728331 (+ 83us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
1215 14:55:16.739586 (+ 11255us) log.cc:844] Serialized 94 byte log entry
1215 14:55:16.739796 (+ 210us) alter_schema_op.cc:73] Released schema lock
1215 14:55:16.739801 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":37,"prepare.queue_time_us":395519,"prepare.run_cpu_time_us":47702,"prepare.run_wall_time_us":533795,"raft.queue_time_us":327,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":212,"replication_time_us":65415}]]}
I20251215 14:55:16.740718 10533 ts_tablet_manager.cc:1916] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:16.740913 10443 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:16.741065 10443 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.742064 10443 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:16.744186 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_891e61b0fc2149c9994b75f57d81e5b4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:16.744133 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_aaaece6baafc4c299ecfb6f33614063a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.744747 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_891e61b0fc2149c9994b75f57d81e5b4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:16.744748 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aaaece6baafc4c299ecfb6f33614063a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.746557 8788 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d0e2271b8caf4c5ea5c37795dcd476b8" } modify_external_catalogs: true
I20251215 14:55:16.746742 8788 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_d0e2271b8caf4c5ea5c37795dcd476b8" } modify_external_catalogs: true
I20251215 14:55:16.746766 10601 raft_consensus.cc:493] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:16.746876 10601 raft_consensus.cc:515] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.746927 8784 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_aa15b16216e74f26a2e14fccb6f83000" } new_table_name: "default.Table_5556b8e6f0fe4cd89350e90bbd7fae0b" modify_external_catalogs: true
I20251215 14:55:16.746501 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_817c452d9f0a407a89733a78665825ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:16.747944 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bfe8cc0805247de9df4a59d461818f3" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:16.748032 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_817c452d9f0a407a89733a78665825ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.748119 9179 raft_consensus.cc:2468] T 5bfe8cc0805247de9df4a59d461818f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:16.748551 8781 master_service.cc:954] ReplaceTablet: received request to replace tablet 5dc81eb40614463cb5017475b378eea6 from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:16.748759 8976 leader_election.cc:304] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:16.748965 10527 raft_consensus.cc:2804] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 14:55:16.749025 10527 raft_consensus.cc:493] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:16.749115 10527 raft_consensus.cc:3060] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:16.750980 8781 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_feadd6e18a8f4153b4cd423f6ca5c0ba" } new_table_name: "default.Table_259aa1cf78a2407db7baf431aa89658b" modify_external_catalogs: true
I20251215 14:55:16.751545 10572 tablet.cc:1717] T bafc5063058a469bb9c9b3e5345eb1be P 67978ac4539d4b289e53f4eedd9a8156: Skipping requested alter to schema version 5, tablet already version 5
I20251215 14:55:16.751703 10527 raft_consensus.cc:515] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.752113 10521 tablet.cc:1717] T bafc5063058a469bb9c9b3e5345eb1be P 3ea5306c36594ef4a62211f2bd6669a3: Skipping requested alter to schema version 5, tablet already version 5
I20251215 14:55:16.752229 8978 leader_election.cc:304] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:16.752328 10601 leader_election.cc:290] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:16.752579 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bfe8cc0805247de9df4a59d461818f3" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:16.752724 9179 raft_consensus.cc:3060] T 5bfe8cc0805247de9df4a59d461818f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 2
I20251215 14:55:16.752725 10525 raft_consensus.cc:2804] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:16.752822 10525 raft_consensus.cc:697] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:16.753018 10525 consensus_queue.cc:237] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:16.754112 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:55:16.754240 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:16.754890 10434 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:16.755300 9179 raft_consensus.cc:2468] T 5bfe8cc0805247de9df4a59d461818f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 2.
I20251215 14:55:16.755671 8976 leader_election.cc:304] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:16.755918 10434 raft_consensus.cc:2804] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 14:55:16.756018 10434 raft_consensus.cc:697] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:16.756311 10434 consensus_queue.cc:237] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.757598 10345 leader_election.cc:290] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:16.757807 9249 leader_election.cc:343] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:16.758077 9249 leader_election.cc:343] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.757805 10528 leader_election.cc:290] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:16.758335 10527 leader_election.cc:290] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:16.762540 8786 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_f898e8de467442898e4adb8820306601" } new_table_name: "default.Table_539ae0f9e4d64ecbbb40bca010e5fba8" modify_external_catalogs: true
I20251215 14:55:16.763826 10443 raft_consensus.cc:493] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:16.763979 10443 raft_consensus.cc:515] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.764811 10443 leader_election.cc:290] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:16.765455 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b65b63ce3ec49f9a0d2d77d69a85fd7" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
W20251215 14:55:16.767850 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 5dd36ea0aa53460f9c1fda4b31063fa7
W20251215 14:55:16.767946 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 3c6cfff573434fbcb18feaf6a8e6a153
W20251215 14:55:16.768077 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 15b8a2a337e54321afd67f7562c412a0
W20251215 14:55:16.768178 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 21a98ce868924690b8a5715f4103c360
W20251215 14:55:16.768289 8787 catalog_manager.cc:5487] Ignoring report from unknown tablet 38e50a7f2bdd4907ab41436b59397ea6
I20251215 14:55:16.769076 8787 catalog_manager.cc:5654] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129). New cstate: current_term: 1 leader_uuid: "67978ac4539d4b289e53f4eedd9a8156" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } health_report { overall_health: UNKNOWN } } }
W20251215 14:55:16.775094 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:55:16.776492 9179 raft_consensus.cc:3060] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.776942 9944 ts_tablet_manager.cc:1929] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251215 14:55:16.777426 9944 log.cc:1199] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/a639396098a941249afd9c3560073131
I20251215 14:55:16.778008 9944 ts_tablet_manager.cc:1950] T a639396098a941249afd9c3560073131 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:16.784358 9944 tablet_replica.cc:333] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4: stopping tablet replica
I20251215 14:55:16.787170 9944 raft_consensus.cc:2243] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Raft consensus shutting down.
I20251215 14:55:16.788127 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b65b63ce3ec49f9a0d2d77d69a85fd7" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:16.790261 9944 raft_consensus.cc:2272] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:16.791285 10443 raft_consensus.cc:493] T 56816add0a61454c9980ad09f5815b09 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:16.791437 10443 raft_consensus.cc:515] T 56816add0a61454c9980ad09f5815b09 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.792048 10443 leader_election.cc:290] T 56816add0a61454c9980ad09f5815b09 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:16.793355 9944 ts_tablet_manager.cc:1916] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251215 14:55:16.793444 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:55:16.793551 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:16.793900 9112 leader_election.cc:304] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:16.794795 10559 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:16.795957 10533 ts_tablet_manager.cc:1929] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20251215 14:55:16.796839 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:16.796911 9426 tablet_bootstrap.cc:492] T 82ca60c5a63744ffb0a0c0a140ef665e P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:16.797178 9426 ts_tablet_manager.cc:1403] T 82ca60c5a63744ffb0a0c0a140ef665e P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.089s user 0.003s sys 0.002s
I20251215 14:55:16.796746 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56816add0a61454c9980ad09f5815b09" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:16.798730 9426 raft_consensus.cc:359] T 82ca60c5a63744ffb0a0c0a140ef665e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.799371 10533 log.cc:1199] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-0/wal/wals/08ca9ee6b76b4b13b7bc26d65dcc3979
I20251215 14:55:16.799306 9426 raft_consensus.cc:385] T 82ca60c5a63744ffb0a0c0a140ef665e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.799584 9426 raft_consensus.cc:740] T 82ca60c5a63744ffb0a0c0a140ef665e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.799721 10533 ts_tablet_manager.cc:1950] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P 67978ac4539d4b289e53f4eedd9a8156: Deleting consensus metadata
I20251215 14:55:16.800258 8772 catalog_manager.cc:4985] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1]) successfully deleted
I20251215 14:55:16.800204 9426 consensus_queue.cc:260] T 82ca60c5a63744ffb0a0c0a140ef665e P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.802753 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56816add0a61454c9980ad09f5815b09" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:16.802943 9041 raft_consensus.cc:2393] T 56816add0a61454c9980ad09f5815b09 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:16.803864 8779 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_e62f7a2cd08046bb89a4ee467ab9c916" } new_table_name: "default.Table_11bd06e0cea44252b4cf0e27aca273da" modify_external_catalogs: true
I20251215 14:55:16.805583 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_2a586410982d469996670e8172d79de8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.806149 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2a586410982d469996670e8172d79de8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.807598 10612 tablet.cc:1722] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:16.808259 9426 ts_tablet_manager.cc:1434] T 82ca60c5a63744ffb0a0c0a140ef665e P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s
I20251215 14:55:16.809545 10600 raft_consensus.cc:493] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:16.809695 10600 raft_consensus.cc:515] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.810580 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79f3a7a065d243c98b465a984bd2b1f9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:16.811064 8976 leader_election.cc:343] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.813441 9426 tablet_bootstrap.cc:492] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:16.814283 10600 leader_election.cc:290] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:16.811357 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7634179e7bef4b95ae6e06b4581888e7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:16.818480 9306 raft_consensus.cc:2468] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:16.821403 9112 leader_election.cc:304] T 56816add0a61454c9980ad09f5815b09 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:16.821744 10443 raft_consensus.cc:3060] T 56816add0a61454c9980ad09f5815b09 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.811872 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bfe8cc0805247de9df4a59d461818f3" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:16.811998 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bfe8cc0805247de9df4a59d461818f3" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:16.822501 9312 raft_consensus.cc:2468] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:16.812348 9248 leader_election.cc:304] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:16.822932 10345 raft_consensus.cc:2804] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:16.823014 10345 raft_consensus.cc:493] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:16.823102 10345 raft_consensus.cc:3060] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.825529 10345 raft_consensus.cc:515] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:16.825700 8779 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6a7a401d5386499183b6560411f593b6 consensus state has no leader
I20251215 14:55:16.825917 8788 catalog_manager.cc:5936] Not sending DeleteTablet requests; no consensus state for tablet fff8a8cf505d44238003cbc5ceb1c59d
I20251215 14:55:16.826054 8779 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_0ab920fea5f34b65b38a501fdc8e199d" } modify_external_catalogs: true
W20251215 14:55:16.826270 8786 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf18d0368ee948a38d35ec47b732f6cc consensus state has no leader
I20251215 14:55:16.826524 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ec16a234222470bb9cf8c29db536cc1" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:16.826723 8779 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_0ab920fea5f34b65b38a501fdc8e199d" } modify_external_catalogs: true
W20251215 14:55:16.827009 9249 leader_election.cc:343] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.827193 10345 leader_election.cc:290] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:16.827880 10528 consensus_queue.cc:1048] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:16.827980 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 90c0254840b442a3817171b06f2726c8
W20251215 14:55:16.828066 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet accc3fdaf8e64b0f96b45150a59516bf
W20251215 14:55:16.828109 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 88206b17f94242378a35d5314611ac1a
W20251215 14:55:16.828161 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 35ade4502ed7497a82b362d38c65244a
W20251215 14:55:16.828207 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 3c6cfff573434fbcb18feaf6a8e6a153
W20251215 14:55:16.828271 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 123361ef48714d859ee5ac85c3c37d08
W20251215 14:55:16.828316 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 5dd36ea0aa53460f9c1fda4b31063fa7
W20251215 14:55:16.829438 8781 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0fed3b34844e4e5b8518c0165df342d1 consensus state has no leader
I20251215 14:55:16.829847 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58926ab073974e2c8b725d5061a544d5" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:16.830009 9041 raft_consensus.cc:2468] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:16.831336 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4cff0ed3782446397dbae8a2da52ed7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:16.831466 9041 raft_consensus.cc:2468] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:16.832121 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79f3a7a065d243c98b465a984bd2b1f9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:16.832252 9041 raft_consensus.cc:2468] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
W20251215 14:55:16.833179 8784 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce147d1fcda2480daa557276c33a6096 consensus state has no leader
I20251215 14:55:16.834923 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet a639396098a941249afd9c3560073131 (table default.Table_404807c380fa4483ac5e0545eb3028cd [id=5cc820ec2c8b427db1c89647b295363e]) successfully deleted
W20251215 14:55:16.835139 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet e512c231686948619d338fa0fc8aae03 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e512c231686948619d338fa0fc8aae03 already in progress: creating tablet
W20251215 14:55:16.835398 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet e6f6324610f44cefb0ce67fd76e0e001 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6f6324610f44cefb0ce67fd76e0e001 already in progress: creating tablet
I20251215 14:55:16.835709 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6ec16a234222470bb9cf8c29db536cc1" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:16.835834 9041 raft_consensus.cc:3060] T 6ec16a234222470bb9cf8c29db536cc1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.838352 9041 raft_consensus.cc:2468] T 6ec16a234222470bb9cf8c29db536cc1 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:16.840931 10345 raft_consensus.cc:493] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:16.841135 10443 raft_consensus.cc:2749] T 56816add0a61454c9980ad09f5815b09 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:16.841198 10345 raft_consensus.cc:515] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.814886 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4cff0ed3782446397dbae8a2da52ed7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:16.818253 9435 tablet_bootstrap.cc:492] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:16.842161 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35326e99d413431583b25d11269d09dc" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:16.842346 9315 raft_consensus.cc:2468] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:16.842365 9435 ts_tablet_manager.cc:1403] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.289s user 0.006s sys 0.006s
W20251215 14:55:16.842762 9249 leader_election.cc:343] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.843055 10345 leader_election.cc:290] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:16.843152 9435 raft_consensus.cc:359] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.843357 9435 raft_consensus.cc:385] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.843432 9435 raft_consensus.cc:740] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
W20251215 14:55:16.843588 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 804ad50f38314be3bf9e118eee9fe748
I20251215 14:55:16.843634 9435 consensus_queue.cc:260] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:16.843750 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 88206b17f94242378a35d5314611ac1a
W20251215 14:55:16.843937 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 3c6cfff573434fbcb18feaf6a8e6a153
W20251215 14:55:16.844022 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 5dd36ea0aa53460f9c1fda4b31063fa7
I20251215 14:55:16.844285 10572 tablet.cc:1722] T 2811b8ffdb614c91b0d3d4e6e039245b P 67978ac4539d4b289e53f4eedd9a8156: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:16.844439 8784 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet 2811b8ffdb614c91b0d3d4e6e039245b (table default.Table_12b99071f9224445935f70cba021453f [id=53315a8cf3bd4a05b1c5e30fd0acdd56]). Expected version 1 got 0
I20251215 14:55:16.844614 8784 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_66a863188e16424797450ead992a2bba [id=066e8ae14004436cb8b4f3f740b45b19]). Expected version 5 got 0
I20251215 14:55:16.844663 10559 raft_consensus.cc:2749] T 2b65b63ce3ec49f9a0d2d77d69a85fd7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:16.846025 8978 leader_election.cc:304] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:16.846256 10525 raft_consensus.cc:2804] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:16.846316 10525 raft_consensus.cc:493] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:16.846369 10525 raft_consensus.cc:3060] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.848474 8781 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c9ff0075955547bfba3e55a69194c7e7" } modify_external_catalogs: true
I20251215 14:55:16.848554 10572 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:40622 (request call id 335) took 1121 ms. Trace:
I20251215 14:55:16.848644 8781 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c9ff0075955547bfba3e55a69194c7e7" } modify_external_catalogs: true
I20251215 14:55:16.848963 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_31b03f712c4546baaf70d3b95ae2def1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.849531 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31b03f712c4546baaf70d3b95ae2def1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.849891 8785 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_a89329a9c0bb47988daf2e89cccc08b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.850358 8785 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a89329a9c0bb47988daf2e89cccc08b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.850862 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_9f7ebee2cdca4b1a8bf4f03cbbf13f6b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.851351 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f7ebee2cdca4b1a8bf4f03cbbf13f6b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.852391 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_f571d7802cef49df9e1c370eb13c6225"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.852789 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f571d7802cef49df9e1c370eb13c6225 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.853567 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_d876b4c5b49041329ece14f623b164d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.854049 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d876b4c5b49041329ece14f623b164d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:16.848634 10572 rpcz_store.cc:276] 1215 14:55:15.727000 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:15.728607 (+ 1607us) service_pool.cc:225] Handling call
1215 14:55:16.848539 (+1119932us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1215 14:55:15.935107 (+ 0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
1215 14:55:15.950814 (+ 15707us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
1215 14:55:15.950824 (+ 10us) alter_schema_op.cc:66] Acquired schema lock
1215 14:55:15.950833 (+ 9us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
1215 14:55:15.950883 (+ 50us) alter_schema_op.cc:128] START. Timestamp: 1765810515950828
1215 14:55:15.950886 (+ 3us) op_driver.cc:348] REPLICATION: starting
1215 14:55:15.952319 (+ 1433us) log.cc:844] Serialized 173 byte log entry
1215 14:55:16.844150 (+891831us) op_driver.cc:464] REPLICATION: finished
1215 14:55:16.844257 (+ 107us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
1215 14:55:16.844688 (+ 431us) log.cc:844] Serialized 5 byte log entry
1215 14:55:16.847686 (+ 2998us) tablet_metadata.cc:641] Metadata flushed
1215 14:55:16.847925 (+ 239us) log.cc:844] Serialized 14 byte log entry
1215 14:55:16.848496 (+ 571us) alter_schema_op.cc:73] Released schema lock
1215 14:55:16.848501 (+ 5us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":36,"prepare.queue_time_us":201716,"prepare.run_cpu_time_us":5396,"prepare.run_wall_time_us":118927,"raft.queue_time_us":165,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":5,"replication_time_us":893230,"thread_start_us":355197,"threads_started":2,"wal-append.queue_time_us":81652}]]}
I20251215 14:55:16.849242 10525 raft_consensus.cc:515] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.855489 8787 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_9f648c3cee4545d1b7501496db60f858" } new_table_name: "default.Table_89b4a7a3b7124af3986512c42ff0082e" modify_external_catalogs: true
W20251215 14:55:16.855654 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7
I20251215 14:55:16.855980 9435 ts_tablet_manager.cc:1434] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20251215 14:55:16.856175 10525 leader_election.cc:290] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:16.856331 9435 tablet_bootstrap.cc:492] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:16.857091 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7634179e7bef4b95ae6e06b4581888e7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:16.857725 8976 leader_election.cc:343] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.858016 9435 tablet_bootstrap.cc:654] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.861865 9427 tablet_bootstrap.cc:492] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:16.862104 9427 ts_tablet_manager.cc:1403] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.141s user 0.006s sys 0.002s
I20251215 14:55:16.864116 9174 raft_consensus.cc:3060] T 82ca60c5a63744ffb0a0c0a140ef665e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.864015 9427 raft_consensus.cc:359] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.864418 9427 raft_consensus.cc:385] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.864553 9427 raft_consensus.cc:740] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.864982 9427 consensus_queue.cc:260] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.865517 10527 raft_consensus.cc:493] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:16.865623 10527 raft_consensus.cc:515] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.866603 10527 leader_election.cc:290] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:16.867784 9427 ts_tablet_manager.cc:1434] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20251215 14:55:16.868541 9427 tablet_bootstrap.cc:492] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:16.870190 9944 ts_tablet_manager.cc:1929] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251215 14:55:16.870330 9944 log.cc:1199] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/bb3b95d32c7044bd8a4451381c19aeba
I20251215 14:55:16.870716 9944 ts_tablet_manager.cc:1950] T bb3b95d32c7044bd8a4451381c19aeba P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:16.871023 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "682cafa003a64138a01024be2573fe34" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:16.871676 9944 tablet_replica.cc:333] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4: stopping tablet replica
W20251215 14:55:16.871647 8976 leader_election.cc:343] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.878481 9944 raft_consensus.cc:2243] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251215 14:55:16.880383 9944 raft_consensus.cc:2272] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251215 14:55:16.880187 9435 tablet_bootstrap.cc:492] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
W20251215 14:55:16.884279 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 3c274c9002544af4947aa4ee76a705ce
I20251215 14:55:16.880990 9944 ts_tablet_manager.cc:1916] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251215 14:55:16.881243 9435 ts_tablet_manager.cc:1403] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.003s
I20251215 14:55:16.888099 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79f3a7a065d243c98b465a984bd2b1f9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:16.888213 9435 raft_consensus.cc:359] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.888422 9435 raft_consensus.cc:385] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:16.888511 9435 raft_consensus.cc:740] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:16.888652 9315 raft_consensus.cc:2468] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
W20251215 14:55:16.889180 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 82ca60c5a63744ffb0a0c0a140ef665e
W20251215 14:55:16.890594 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 2b65b63ce3ec49f9a0d2d77d69a85fd7
I20251215 14:55:16.895215 9435 consensus_queue.cc:260] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.895814 9435 ts_tablet_manager.cc:1434] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20251215 14:55:16.896131 9435 tablet_bootstrap.cc:492] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:16.897902 9435 tablet_bootstrap.cc:654] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:16.899411 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 78b3f18a62d544b38a0682bf3bc00977
I20251215 14:55:16.899458 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_91c90306189840c9a7b4a2464a08d046"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:16.900892 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 5bfe8cc0805247de9df4a59d461818f3
W20251215 14:55:16.901779 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91c90306189840c9a7b4a2464a08d046 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:16.902956 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 18cd1f63d51e4565bb8c55be13e3e099
I20251215 14:55:16.902834 9426 tablet_bootstrap.cc:654] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.905790 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7634179e7bef4b95ae6e06b4581888e7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:16.905992 9315 raft_consensus.cc:3060] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.907936 9944 ts_tablet_manager.cc:1929] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251215 14:55:16.908064 9944 log.cc:1199] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4: Deleting WAL directory at /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/ts-2/wal/wals/08ca9ee6b76b4b13b7bc26d65dcc3979
I20251215 14:55:16.908614 10616 raft_consensus.cc:493] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:16.908936 9315 raft_consensus.cc:2468] T 7634179e7bef4b95ae6e06b4581888e7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:16.911978 9179 raft_consensus.cc:3060] T 90c0254840b442a3817171b06f2726c8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.914716 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "682cafa003a64138a01024be2573fe34" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:16.916201 10616 raft_consensus.cc:515] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.917333 10616 leader_election.cc:290] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:16.917486 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b8a2a337e54321afd67f7562c412a0" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:16.917994 8976 leader_election.cc:343] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.917100 9427 tablet_bootstrap.cc:654] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:16.920504 8978 leader_election.cc:304] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:16.921252 10616 raft_consensus.cc:2804] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:16.921419 10616 raft_consensus.cc:493] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:16.921609 10616 raft_consensus.cc:3060] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.922479 9944 ts_tablet_manager.cc:1950] T 08ca9ee6b76b4b13b7bc26d65dcc3979 P e89303a500544272b601d7c29be802b4: Deleting consensus metadata
I20251215 14:55:16.923372 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet bb3b95d32c7044bd8a4451381c19aeba (table default.Table_3194032074824e83a1f02ad85fbba951 [id=7ec65d77d89d4e40a60b716f721e2940]) successfully deleted
I20251215 14:55:16.927582 10621 tablet.cc:1722] T 2811b8ffdb614c91b0d3d4e6e039245b P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:16.931233 10622 tablet.cc:1722] T e0c88310853f47b0aa1af9a3d676bef6 P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:16.933033 8779 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet d39e0db04f3c4bd3831c00b2b4825035
I20251215 14:55:16.935664 9152 tablet_service.cc:1552] Processing DeleteTablet for tablet d39e0db04f3c4bd3831c00b2b4825035 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:16.937077 9021 tablet_service.cc:1552] Processing DeleteTablet for tablet d39e0db04f3c4bd3831c00b2b4825035 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:16.938491 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet d39e0db04f3c4bd3831c00b2b4825035 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d39e0db04f3c4bd3831c00b2b4825035 already in progress: creating tablet
W20251215 14:55:16.938781 8779 catalog_manager.cc:5487] Ignoring report from unknown tablet accc3fdaf8e64b0f96b45150a59516bf
I20251215 14:55:16.939410 8779 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_4ba7459ea1c0439bad879f6514a8b032" } modify_external_catalogs: true
I20251215 14:55:16.939703 8779 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_4ba7459ea1c0439bad879f6514a8b032" } modify_external_catalogs: true
I20251215 14:55:16.942282 9248 leader_election.cc:304] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
W20251215 14:55:16.942381 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet d39e0db04f3c4bd3831c00b2b4825035 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d39e0db04f3c4bd3831c00b2b4825035 already in progress: creating tablet
I20251215 14:55:16.943004 9248 leader_election.cc:304] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:16.944727 9971 raft_consensus.cc:2804] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:16.944834 9971 raft_consensus.cc:493] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:16.944917 9971 raft_consensus.cc:3060] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.945112 10606 consensus_queue.cc:1048] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:16.945683 10606 raft_consensus.cc:2804] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:16.945789 10606 raft_consensus.cc:493] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:16.945879 10606 raft_consensus.cc:3060] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.947455 8781 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: Sending DeleteTablet for 3 replicas of tablet c4929bdb04914251b75a11d6936f1ee0
I20251215 14:55:16.948223 8781 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c733908dc722410a9fecd7f50d888e4a" } modify_external_catalogs: true
I20251215 14:55:16.948220 9971 raft_consensus.cc:515] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.948432 8781 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_c733908dc722410a9fecd7f50d888e4a" } modify_external_catalogs: true
I20251215 14:55:16.948943 10606 raft_consensus.cc:515] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.949393 9971 leader_election.cc:290] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:16.950013 9152 tablet_service.cc:1552] Processing DeleteTablet for tablet c4929bdb04914251b75a11d6936f1ee0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:50264
I20251215 14:55:16.950044 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58926ab073974e2c8b725d5061a544d5" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:16.950102 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4cff0ed3782446397dbae8a2da52ed7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:16.949770 10606 leader_election.cc:290] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:16.950760 9021 tablet_service.cc:1552] Processing DeleteTablet for tablet c4929bdb04914251b75a11d6936f1ee0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:40622
W20251215 14:55:16.951465 9249 leader_election.cc:343] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:16.951686 9249 leader_election.cc:343] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:16.951920 9249 consensus_peers.cc:597] T 034fec793ae74fcda0c73f1cea291311 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:16.952003 10622 tablet.cc:1722] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
W20251215 14:55:16.952307 8773 catalog_manager.cc:4965] TS 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): delete failed for tablet c4929bdb04914251b75a11d6936f1ee0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4929bdb04914251b75a11d6936f1ee0 already in progress: creating tablet
I20251215 14:55:16.952529 9248 leader_election.cc:304] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:16.953192 10345 raft_consensus.cc:2804] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:16.953334 10345 raft_consensus.cc:493] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:16.953486 10345 raft_consensus.cc:3060] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.960041 10345 raft_consensus.cc:515] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:16.961993 8772 catalog_manager.cc:4965] TS 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): delete failed for tablet c4929bdb04914251b75a11d6936f1ee0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4929bdb04914251b75a11d6936f1ee0 already in progress: creating tablet
I20251215 14:55:16.962313 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79f3a7a065d243c98b465a984bd2b1f9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:16.962855 9249 leader_election.cc:343] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:16.964184 10345 leader_election.cc:290] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:16.965690 9248 leader_election.cc:304] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:16.968509 9971 raft_consensus.cc:2804] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:16.968739 9971 raft_consensus.cc:697] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
W20251215 14:55:16.968621 9248 leader_election.cc:343] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 35326e99d413431583b25d11269d09dc
I20251215 14:55:16.969095 9971 consensus_queue.cc:237] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:16.969549 9248 leader_election.cc:304] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:16.970075 10606 raft_consensus.cc:2749] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:16.973497 8775 catalog_manager.cc:4985] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1]) successfully deleted
I20251215 14:55:16.985596 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58926ab073974e2c8b725d5061a544d5" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:16.985800 9034 raft_consensus.cc:3060] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.986035 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4cff0ed3782446397dbae8a2da52ed7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:16.988399 9034 raft_consensus.cc:2468] T 58926ab073974e2c8b725d5061a544d5 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:16.990728 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79f3a7a065d243c98b465a984bd2b1f9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:16.990872 9034 raft_consensus.cc:3060] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:16.993680 9034 raft_consensus.cc:2468] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
W20251215 14:55:16.996160 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 6: this message will repeat every 5th retry.
I20251215 14:55:16.996385 10606 consensus_queue.cc:1048] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
W20251215 14:55:16.999560 8783 catalog_manager.cc:5487] Ignoring report from unknown tablet 66f2c74e55f04a6fa4b2c238c0a6b901
I20251215 14:55:17.000159 8783 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet bfead52afe8040a88ba0d826f482b1bd (table default.Table_01b15bbef6604cbfb5d1bc97a6067a1c [id=d8410eb19405483eafbfc5b83e088c2d]). Expected version 2 got 1
I20251215 14:55:17.000365 8783 catalog_manager.cc:5746] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959) does not have the latest schema for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_66a863188e16424797450ead992a2bba [id=066e8ae14004436cb8b4f3f740b45b19]). Expected version 5 got 0
W20251215 14:55:17.003754 8787 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8e1a8070f9ab448088009e9a22a340f7 has no consensus state
I20251215 14:55:17.001444 10624 tablet.cc:1722] T bfead52afe8040a88ba0d826f482b1bd P e89303a500544272b601d7c29be802b4: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251215 14:55:17.005426 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet d39e0db04f3c4bd3831c00b2b4825035 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:17.012140 10621 tablet.cc:1717] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4: Skipping requested alter to schema version 5, tablet already version 5
I20251215 14:55:17.014479 10612 tablet.cc:1717] T bafc5063058a469bb9c9b3e5345eb1be P e89303a500544272b601d7c29be802b4: Skipping requested alter to schema version 5, tablet already version 5
I20251215 14:55:17.015637 8784 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 40747def373e4b19abfa5d21ba0a4315: default.Table_12b99071f9224445935f70cba021453f [id=53315a8cf3bd4a05b1c5e30fd0acdd56] alter complete (version 1)
I20251215 14:55:17.016330 9290 tablet_service.cc:1552] Processing DeleteTablet for tablet c4929bdb04914251b75a11d6936f1ee0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-15 14:55:16 UTC) from {username='slave'} at 127.0.0.1:33372
I20251215 14:55:17.016762 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b8a2a337e54321afd67f7562c412a0" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:17.017037 9315 raft_consensus.cc:2468] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
W20251215 14:55:17.019599 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 92331.6us
I20251215 14:55:17.019861 8978 leader_election.cc:304] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
W20251215 14:55:17.020218 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet d39e0db04f3c4bd3831c00b2b4825035 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d39e0db04f3c4bd3831c00b2b4825035 already in progress: creating tablet
I20251215 14:55:17.020727 10600 raft_consensus.cc:2764] T 79f3a7a065d243c98b465a984bd2b1f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20251215 14:55:17.021495 8978 leader_election.cc:304] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.021787 10601 raft_consensus.cc:2804] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:17.021886 10601 raft_consensus.cc:697] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:17.022107 10601 consensus_queue.cc:237] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:17.023290 8775 catalog_manager.cc:4965] TS e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): delete failed for tablet c4929bdb04914251b75a11d6936f1ee0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c4929bdb04914251b75a11d6936f1ee0 already in progress: creating tablet
I20251215 14:55:17.029336 8784 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_893ed18a678f46a78f4d19c1fc95039b" } new_table_name: "default.Table_d1f5de637f874750891dfad92fccd141" modify_external_catalogs: true
I20251215 14:55:17.030807 8782 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_670861e659694b79a9225aba5f756f78" } new_table_name: "default.Table_fbefdfcff9c24a7387730593f0614c71" modify_external_catalogs: true
I20251215 14:55:17.032166 9248 leader_election.cc:304] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.032655 10345 raft_consensus.cc:2804] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:17.032780 10345 raft_consensus.cc:697] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:17.033023 10345 consensus_queue.cc:237] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.035490 8788 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_18dd90baa61747d18f1607a9b645fe77"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:17.036298 8787 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ad300576ad4145bd9eec36368c3c863c" } modify_external_catalogs: true
I20251215 14:55:17.036448 8787 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_ad300576ad4145bd9eec36368c3c863c" } modify_external_catalogs: true
W20251215 14:55:17.037190 8788 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_18dd90baa61747d18f1607a9b645fe77 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:17.038820 8786 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_4f0255fe15c14c4e95150c3496e2240c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:17.041796 8786 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f0255fe15c14c4e95150c3496e2240c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:17.043593 8785 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_10d22e1a78f14631b77205e8829d9ecd" } new_table_name: "default.Table_5f190dee62f0401ab90ffee22472a385" modify_external_catalogs: true
I20251215 14:55:17.044821 8780 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_b7e8e496ff654bdea9558a04abb32447" } new_table_name: "default.Table_a9cedf6d4849459aac405e6510afcde0" modify_external_catalogs: true
I20251215 14:55:17.045413 9248 leader_election.cc:304] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.045665 9971 raft_consensus.cc:2804] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:17.045800 9971 raft_consensus.cc:697] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:17.046056 9971 consensus_queue.cc:237] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.051420 8783 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_d666cc46d2244865b38c9bf01597ba90"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:17.052953 8783 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d666cc46d2244865b38c9bf01597ba90 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:17.058660 10528 consensus_queue.cc:1048] T 56816add0a61454c9980ad09f5815b09 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:17.060179 10616 raft_consensus.cc:515] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.060587 9038 raft_consensus.cc:2393] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:17.061605 10616 leader_election.cc:290] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.061985 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4cff0ed3782446397dbae8a2da52ed7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:17.062469 8976 leader_election.cc:343] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.084785 9248 leader_election.cc:304] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:17.085433 10528 raft_consensus.cc:2749] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:17.088268 9361 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
W20251215 14:55:17.094446 8772 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet e9f514f7656247fd90f550b4132a15e6 (table default.Table_787c39536e88473bbbab7c495042cd8a [id=dde6a8e342ce4d899f05dd06b2a63bdd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e9f514f7656247fd90f550b4132a15e6 consensus state has no leader
W20251215 14:55:17.099723 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 78262.6us
W20251215 14:55:17.101078 8978 leader_election.cc:343] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.101425 8978 leader_election.cc:304] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:17.101751 10601 raft_consensus.cc:2749] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:17.115186 9435 tablet_bootstrap.cc:492] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:17.115474 9435 ts_tablet_manager.cc:1403] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.219s user 0.009s sys 0.021s
I20251215 14:55:17.115558 9426 tablet_bootstrap.cc:492] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.115828 9426 ts_tablet_manager.cc:1403] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.305s user 0.020s sys 0.018s
I20251215 14:55:17.117806 9435 raft_consensus.cc:359] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.117805 9426 raft_consensus.cc:359] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.118295 9426 raft_consensus.cc:385] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.118495 9426 raft_consensus.cc:740] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.119421 9426 consensus_queue.cc:260] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.121156 8978 leader_election.cc:304] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.121883 10601 raft_consensus.cc:2804] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:17.121994 10601 raft_consensus.cc:493] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:17.122121 10601 raft_consensus.cc:3060] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.122347 9426 ts_tablet_manager.cc:1434] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20251215 14:55:17.124857 10601 raft_consensus.cc:515] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.125913 9435 raft_consensus.cc:385] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.125949 10601 leader_election.cc:290] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.126053 9427 tablet_bootstrap.cc:492] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:17.126111 9435 raft_consensus.cc:740] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.126338 9427 ts_tablet_manager.cc:1403] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.258s user 0.015s sys 0.026s
I20251215 14:55:17.126598 9435 consensus_queue.cc:260] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.127377 9435 ts_tablet_manager.cc:1434] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20251215 14:55:17.128178 9426 tablet_bootstrap.cc:492] T f830b4af355e480bbe75d6060585529e P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.129724 9427 raft_consensus.cc:359] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.131145 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b8a2a337e54321afd67f7562c412a0" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:17.130764 9427 raft_consensus.cc:385] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251215 14:55:17.131809 8976 leader_election.cc:343] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.131706 9427 raft_consensus.cc:740] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.134244 9435 tablet_bootstrap.cc:492] T 3af4f753a04b429a857e018f201ae6ed P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:17.133810 9427 consensus_queue.cc:260] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.136618 9435 tablet_bootstrap.cc:654] T 3af4f753a04b429a857e018f201ae6ed P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.136467 9427 ts_tablet_manager.cc:1434] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.010s user 0.002s sys 0.002s
I20251215 14:55:17.139686 9426 tablet_bootstrap.cc:654] T f830b4af355e480bbe75d6060585529e P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.140295 9427 tablet_bootstrap.cc:492] T 123361ef48714d859ee5ac85c3c37d08 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:17.148911 9427 tablet_bootstrap.cc:654] T 123361ef48714d859ee5ac85c3c37d08 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.161618 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4cff0ed3782446397dbae8a2da52ed7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:17.161952 9303 raft_consensus.cc:2393] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:17.163962 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b8a2a337e54321afd67f7562c412a0" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:17.164191 9303 raft_consensus.cc:3060] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.165337 9435 tablet_bootstrap.cc:492] T 3af4f753a04b429a857e018f201ae6ed P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:17.165513 9435 ts_tablet_manager.cc:1403] T 3af4f753a04b429a857e018f201ae6ed P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.000s
I20251215 14:55:17.166394 9435 raft_consensus.cc:359] T 3af4f753a04b429a857e018f201ae6ed P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.166580 9435 raft_consensus.cc:385] T 3af4f753a04b429a857e018f201ae6ed P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.166651 9435 raft_consensus.cc:740] T 3af4f753a04b429a857e018f201ae6ed P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.166916 9435 consensus_queue.cc:260] T 3af4f753a04b429a857e018f201ae6ed P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.167526 9435 ts_tablet_manager.cc:1434] T 3af4f753a04b429a857e018f201ae6ed P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:17.168218 9303 raft_consensus.cc:2468] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:17.169359 9435 tablet_bootstrap.cc:492] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:17.175853 8784 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 66249f9be0334affb4f4b0e7dd9212ea consensus state has no leader
W20251215 14:55:17.177847 8782 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d45d6eebc703414fa9028faab9fc993c consensus state has no leader
I20251215 14:55:17.179563 9971 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:17.179725 8782 catalog_manager.cc:5487] Ignoring report from unknown tablet 82ca60c5a63744ffb0a0c0a140ef665e
I20251215 14:55:17.179731 9971 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.180225 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_b7ef4076616f4c029ea82806d6ca3f78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251215 14:55:17.180567 9971 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.181185 8788 master_service.cc:954] ReplaceTablet: received request to replace tablet 32432afc6e8d458bb7ed7abc42fb3dde from {username='slave'} at 127.0.0.1:49790
I20251215 14:55:17.181638 8788 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_539ae0f9e4d64ecbbb40bca010e5fba8" } modify_external_catalogs: true
I20251215 14:55:17.181810 8788 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_539ae0f9e4d64ecbbb40bca010e5fba8" } modify_external_catalogs: true
I20251215 14:55:17.182505 8786 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_7b2f1802f1a54482a674dbb5d0fd73a0" } modify_external_catalogs: true
I20251215 14:55:17.182660 8786 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:49790:
table { table_name: "default.Table_7b2f1802f1a54482a674dbb5d0fd73a0" } modify_external_catalogs: true
W20251215 14:55:17.182729 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:55:17.183185 8785 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6e2ccb7f59d24739a230e240f112df02 has no consensus state
I20251215 14:55:17.183422 8785 master_service.cc:954] ReplaceTablet: received request to replace tablet ca2bba36b0f54aadb3980aa41dfd0eb0 from {username='slave'} at 127.0.0.1:49790
W20251215 14:55:17.183737 8780 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 46bd8e49fff5473f8787742f6023ddbe consensus state has no leader
I20251215 14:55:17.184087 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_104a076c48034eb6b55e0fbf6c14c0bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:17.184602 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_104a076c48034eb6b55e0fbf6c14c0bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:17.184541 9427 tablet_bootstrap.cc:492] T 123361ef48714d859ee5ac85c3c37d08 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
W20251215 14:55:17.188189 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:55:17.188311 9249 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:17.185464 9427 ts_tablet_manager.cc:1403] T 123361ef48714d859ee5ac85c3c37d08 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.007s
I20251215 14:55:17.189213 9971 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:55:17.191941 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 034fec793ae74fcda0c73f1cea291311
W20251215 14:55:17.192044 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet accc3fdaf8e64b0f96b45150a59516bf
W20251215 14:55:17.192143 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 65ea0509d8eb42bdb2291ff01e8d3bd6
W20251215 14:55:17.192226 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 6ae72a1ded6e4faba1ad309d9a0e4a95
W20251215 14:55:17.192301 8784 catalog_manager.cc:5487] Ignoring report from unknown tablet 88206b17f94242378a35d5314611ac1a
W20251215 14:55:17.192916 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b7ef4076616f4c029ea82806d6ca3f78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:17.195335 9435 tablet_bootstrap.cc:654] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.197160 9427 raft_consensus.cc:359] T 123361ef48714d859ee5ac85c3c37d08 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.198875 9427 raft_consensus.cc:385] T 123361ef48714d859ee5ac85c3c37d08 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.199766 9427 raft_consensus.cc:740] T 123361ef48714d859ee5ac85c3c37d08 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.200853 9427 consensus_queue.cc:260] T 123361ef48714d859ee5ac85c3c37d08 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.205637 9426 tablet_bootstrap.cc:492] T f830b4af355e480bbe75d6060585529e P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.205960 9426 ts_tablet_manager.cc:1403] T f830b4af355e480bbe75d6060585529e P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.078s user 0.005s sys 0.009s
I20251215 14:55:17.207571 9426 raft_consensus.cc:359] T f830b4af355e480bbe75d6060585529e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.207907 9426 raft_consensus.cc:385] T f830b4af355e480bbe75d6060585529e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.208053 9426 raft_consensus.cc:740] T f830b4af355e480bbe75d6060585529e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.208895 8978 leader_election.cc:304] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:17.208523 9426 consensus_queue.cc:260] T f830b4af355e480bbe75d6060585529e P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.210500 9426 ts_tablet_manager.cc:1434] T f830b4af355e480bbe75d6060585529e P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:17.211097 9426 tablet_bootstrap.cc:492] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.212368 9427 ts_tablet_manager.cc:1434] T 123361ef48714d859ee5ac85c3c37d08 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.023s user 0.004s sys 0.000s
I20251215 14:55:17.214521 9427 tablet_bootstrap.cc:492] T 804ad50f38314be3bf9e118eee9fe748 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:17.219862 9971 raft_consensus.cc:493] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.220041 9971 raft_consensus.cc:515] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.220710 9971 leader_election.cc:290] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.221542 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c274c9002544af4947aa4ee76a705ce" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:17.222317 9249 leader_election.cc:343] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.224069 9426 tablet_bootstrap.cc:654] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.227080 9427 tablet_bootstrap.cc:654] T 804ad50f38314be3bf9e118eee9fe748 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.231868 8782 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_b251ec387f874d5abe4b7bfdb45ca814"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:17.233461 8782 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b251ec387f874d5abe4b7bfdb45ca814 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251215 14:55:17.232074 8780 catalog_manager.cc:5487] Ignoring report from unknown tablet 65ea0509d8eb42bdb2291ff01e8d3bd6
W20251215 14:55:17.233951 8780 catalog_manager.cc:5487] Ignoring report from unknown tablet 56816add0a61454c9980ad09f5815b09
W20251215 14:55:17.234097 8780 catalog_manager.cc:5487] Ignoring report from unknown tablet 11a5a6a0895c49648c910fa2ea3ca373
W20251215 14:55:17.234200 8780 catalog_manager.cc:5487] Ignoring report from unknown tablet 90c0254840b442a3817171b06f2726c8
W20251215 14:55:17.234319 8780 catalog_manager.cc:5487] Ignoring report from unknown tablet 82ca60c5a63744ffb0a0c0a140ef665e
I20251215 14:55:17.234941 8780 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49790:
name: "default.Table_ea3a04d7575b425c864c4e10de2e7246"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251215 14:55:17.235687 8780 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea3a04d7575b425c864c4e10de2e7246 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251215 14:55:17.238806 9427 tablet_bootstrap.cc:492] T 804ad50f38314be3bf9e118eee9fe748 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:17.239035 9427 ts_tablet_manager.cc:1403] T 804ad50f38314be3bf9e118eee9fe748 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.025s user 0.005s sys 0.002s
I20251215 14:55:17.239493 10601 raft_consensus.cc:493] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.239836 9427 raft_consensus.cc:359] T 804ad50f38314be3bf9e118eee9fe748 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.239995 9427 raft_consensus.cc:385] T 804ad50f38314be3bf9e118eee9fe748 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.240042 9427 raft_consensus.cc:740] T 804ad50f38314be3bf9e118eee9fe748 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.240238 9427 consensus_queue.cc:260] T 804ad50f38314be3bf9e118eee9fe748 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.239845 10601 raft_consensus.cc:515] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.240584 9427 ts_tablet_manager.cc:1434] T 804ad50f38314be3bf9e118eee9fe748 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251215 14:55:17.241164 9427 tablet_bootstrap.cc:492] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:17.242062 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3af4f753a04b429a857e018f201ae6ed" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:17.242532 8976 leader_election.cc:343] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.242722 9427 tablet_bootstrap.cc:654] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.243129 10616 raft_consensus.cc:2749] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:17.243345 10601 leader_election.cc:290] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.244262 9426 tablet_bootstrap.cc:492] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.244397 9426 ts_tablet_manager.cc:1403] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.004s
I20251215 14:55:17.245122 9426 raft_consensus.cc:359] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.245285 9426 raft_consensus.cc:385] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.245330 9426 raft_consensus.cc:740] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.245501 9426 consensus_queue.cc:260] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.245988 9426 ts_tablet_manager.cc:1434] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:17.246371 9426 tablet_bootstrap.cc:492] T accc3fdaf8e64b0f96b45150a59516bf P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.248106 9426 tablet_bootstrap.cc:654] T accc3fdaf8e64b0f96b45150a59516bf P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.251349 9427 tablet_bootstrap.cc:492] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:17.251487 9427 ts_tablet_manager.cc:1403] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.003s
I20251215 14:55:17.252194 9427 raft_consensus.cc:359] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.252367 9427 raft_consensus.cc:385] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.252415 9427 raft_consensus.cc:740] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.251058 8978 leader_election.cc:304] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.253114 9427 consensus_queue.cc:260] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.253574 9427 ts_tablet_manager.cc:1434] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:17.253860 9427 tablet_bootstrap.cc:492] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:17.253566 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c274c9002544af4947aa4ee76a705ce" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:17.255438 9427 tablet_bootstrap.cc:654] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.258158 9426 tablet_bootstrap.cc:492] T accc3fdaf8e64b0f96b45150a59516bf P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.258278 9426 ts_tablet_manager.cc:1403] T accc3fdaf8e64b0f96b45150a59516bf P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20251215 14:55:17.259245 9435 tablet_bootstrap.cc:492] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:17.259460 9435 ts_tablet_manager.cc:1403] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.090s user 0.004s sys 0.000s
I20251215 14:55:17.260275 9435 raft_consensus.cc:359] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.261144 9426 raft_consensus.cc:359] T accc3fdaf8e64b0f96b45150a59516bf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.261413 9435 raft_consensus.cc:385] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.261529 9435 raft_consensus.cc:740] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.261814 9435 consensus_queue.cc:260] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.262025 9426 raft_consensus.cc:385] T accc3fdaf8e64b0f96b45150a59516bf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.262135 9426 raft_consensus.cc:740] T accc3fdaf8e64b0f96b45150a59516bf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.262372 9426 consensus_queue.cc:260] T accc3fdaf8e64b0f96b45150a59516bf P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.262955 9435 ts_tablet_manager.cc:1434] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251215 14:55:17.263378 9426 ts_tablet_manager.cc:1434] T accc3fdaf8e64b0f96b45150a59516bf P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:17.263768 9435 tablet_bootstrap.cc:492] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:17.265578 9435 tablet_bootstrap.cc:654] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.267467 9427 tablet_bootstrap.cc:492] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:17.267673 9427 ts_tablet_manager.cc:1403] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
W20251215 14:55:17.258563 9248 leader_election.cc:343] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.268407 9248 leader_election.cc:304] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:17.268496 9427 raft_consensus.cc:359] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.268932 9427 raft_consensus.cc:385] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.269002 9427 raft_consensus.cc:740] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.269191 9427 consensus_queue.cc:260] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.269676 9427 ts_tablet_manager.cc:1434] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:17.269949 9427 tablet_bootstrap.cc:492] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:17.271811 9971 raft_consensus.cc:2749] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:17.271953 9426 tablet_bootstrap.cc:492] T 88206b17f94242378a35d5314611ac1a P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.273471 9426 tablet_bootstrap.cc:654] T 88206b17f94242378a35d5314611ac1a P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:17.274865 8683 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 130711us
I20251215 14:55:17.274557 10616 raft_consensus.cc:2804] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:17.277372 9971 raft_consensus.cc:493] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.277518 9971 raft_consensus.cc:515] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.278200 9971 leader_election.cc:290] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.279739 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5830296559264b609909486aa15c9e2e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:17.280332 9249 leader_election.cc:343] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.277067 10616 raft_consensus.cc:697] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:17.281442 10616 consensus_queue.cc:237] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.282169 9427 tablet_bootstrap.cc:654] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.283751 9426 tablet_bootstrap.cc:492] T 88206b17f94242378a35d5314611ac1a P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.284013 9426 ts_tablet_manager.cc:1403] T 88206b17f94242378a35d5314611ac1a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.005s
I20251215 14:55:17.284770 9426 raft_consensus.cc:359] T 88206b17f94242378a35d5314611ac1a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.284940 9426 raft_consensus.cc:385] T 88206b17f94242378a35d5314611ac1a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.284991 9426 raft_consensus.cc:740] T 88206b17f94242378a35d5314611ac1a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.286849 9426 consensus_queue.cc:260] T 88206b17f94242378a35d5314611ac1a P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.287357 9426 ts_tablet_manager.cc:1434] T 88206b17f94242378a35d5314611ac1a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20251215 14:55:17.288486 9435 tablet_bootstrap.cc:492] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:17.288682 9435 ts_tablet_manager.cc:1403] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.003s
I20251215 14:55:17.289317 9226 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:17.289541 9435 raft_consensus.cc:359] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.289805 9435 raft_consensus.cc:385] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.289914 9435 raft_consensus.cc:740] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.290232 9426 tablet_bootstrap.cc:492] T 2811b8ffdb614c91b0d3d4e6e039245b P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.290503 9435 consensus_queue.cc:260] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.291790 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5830296559264b609909486aa15c9e2e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:17.292335 9426 tablet_bootstrap.cc:654] T 2811b8ffdb614c91b0d3d4e6e039245b P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.294333 9435 ts_tablet_manager.cc:1434] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20251215 14:55:17.294649 9435 tablet_bootstrap.cc:492] T 9beef04f876d40d89dac5970ac6828e9 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:17.296432 9435 tablet_bootstrap.cc:654] T 9beef04f876d40d89dac5970ac6828e9 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:17.296868 9248 leader_election.cc:343] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.299424 9248 leader_election.cc:304] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:17.302017 9426 tablet_bootstrap.cc:492] T 2811b8ffdb614c91b0d3d4e6e039245b P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.302150 9426 ts_tablet_manager.cc:1403] T 2811b8ffdb614c91b0d3d4e6e039245b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20251215 14:55:17.302388 9971 raft_consensus.cc:2749] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:17.302821 9426 raft_consensus.cc:359] T 2811b8ffdb614c91b0d3d4e6e039245b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.302971 9426 raft_consensus.cc:385] T 2811b8ffdb614c91b0d3d4e6e039245b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.303015 9426 raft_consensus.cc:740] T 2811b8ffdb614c91b0d3d4e6e039245b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.303211 9426 consensus_queue.cc:260] T 2811b8ffdb614c91b0d3d4e6e039245b P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.303650 9426 ts_tablet_manager.cc:1434] T 2811b8ffdb614c91b0d3d4e6e039245b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251215 14:55:17.303893 9426 tablet_bootstrap.cc:492] T a0a74645593d46fcbc0235ec6a4670d8 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.304977 9971 raft_consensus.cc:493] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.305179 9971 raft_consensus.cc:515] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.305508 9426 tablet_bootstrap.cc:654] T a0a74645593d46fcbc0235ec6a4670d8 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.306301 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "804ad50f38314be3bf9e118eee9fe748" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:17.306885 9249 leader_election.cc:343] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.307111 9971 leader_election.cc:290] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.316720 9426 tablet_bootstrap.cc:492] T a0a74645593d46fcbc0235ec6a4670d8 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.316871 9426 ts_tablet_manager.cc:1403] T a0a74645593d46fcbc0235ec6a4670d8 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20251215 14:55:17.317589 9426 raft_consensus.cc:359] T a0a74645593d46fcbc0235ec6a4670d8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.317773 9426 raft_consensus.cc:385] T a0a74645593d46fcbc0235ec6a4670d8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.317821 9426 raft_consensus.cc:740] T a0a74645593d46fcbc0235ec6a4670d8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.318003 9426 consensus_queue.cc:260] T a0a74645593d46fcbc0235ec6a4670d8 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.318506 9426 ts_tablet_manager.cc:1434] T a0a74645593d46fcbc0235ec6a4670d8 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:17.319032 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "804ad50f38314be3bf9e118eee9fe748" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:17.319247 9041 raft_consensus.cc:2468] T 804ad50f38314be3bf9e118eee9fe748 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:17.323338 9426 tablet_bootstrap.cc:492] T 3c6cfff573434fbcb18feaf6a8e6a153 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.325074 9426 tablet_bootstrap.cc:654] T 3c6cfff573434fbcb18feaf6a8e6a153 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.328125 9427 tablet_bootstrap.cc:492] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:17.328262 9427 ts_tablet_manager.cc:1403] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.058s user 0.003s sys 0.010s
I20251215 14:55:17.329015 9427 raft_consensus.cc:359] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.329187 9427 raft_consensus.cc:385] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.329241 9427 raft_consensus.cc:740] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.329427 9427 consensus_queue.cc:260] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.329874 9427 ts_tablet_manager.cc:1434] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:17.330129 9427 tablet_bootstrap.cc:492] T 35ade4502ed7497a82b362d38c65244a P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:17.331679 9427 tablet_bootstrap.cc:654] T 35ade4502ed7497a82b362d38c65244a P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.333487 9435 tablet_bootstrap.cc:492] T 9beef04f876d40d89dac5970ac6828e9 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:17.333729 9435 ts_tablet_manager.cc:1403] T 9beef04f876d40d89dac5970ac6828e9 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.039s user 0.006s sys 0.006s
I20251215 14:55:17.333822 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3af4f753a04b429a857e018f201ae6ed" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:17.334086 9312 raft_consensus.cc:2468] T 3af4f753a04b429a857e018f201ae6ed P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:17.334559 9435 raft_consensus.cc:359] T 9beef04f876d40d89dac5970ac6828e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.334833 9435 raft_consensus.cc:385] T 9beef04f876d40d89dac5970ac6828e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.334952 9435 raft_consensus.cc:740] T 9beef04f876d40d89dac5970ac6828e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.335249 9435 consensus_queue.cc:260] T 9beef04f876d40d89dac5970ac6828e9 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.335844 9435 ts_tablet_manager.cc:1434] T 9beef04f876d40d89dac5970ac6828e9 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:17.336916 9435 tablet_bootstrap.cc:492] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:17.342747 9435 tablet_bootstrap.cc:654] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.343736 9427 tablet_bootstrap.cc:492] T 35ade4502ed7497a82b362d38c65244a P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:17.344753 9427 ts_tablet_manager.cc:1403] T 35ade4502ed7497a82b362d38c65244a P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.000s
I20251215 14:55:17.345526 9427 raft_consensus.cc:359] T 35ade4502ed7497a82b362d38c65244a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.346913 9427 raft_consensus.cc:385] T 35ade4502ed7497a82b362d38c65244a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.347239 9427 raft_consensus.cc:740] T 35ade4502ed7497a82b362d38c65244a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.347599 9427 consensus_queue.cc:260] T 35ade4502ed7497a82b362d38c65244a P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.348664 9427 ts_tablet_manager.cc:1434] T 35ade4502ed7497a82b362d38c65244a P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251215 14:55:17.349678 9427 tablet_bootstrap.cc:492] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:17.351778 9427 tablet_bootstrap.cc:654] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.359076 9426 tablet_bootstrap.cc:492] T 3c6cfff573434fbcb18feaf6a8e6a153 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.359339 9426 ts_tablet_manager.cc:1403] T 3c6cfff573434fbcb18feaf6a8e6a153 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.004s
I20251215 14:55:17.360085 9426 raft_consensus.cc:359] T 3c6cfff573434fbcb18feaf6a8e6a153 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.360328 9426 raft_consensus.cc:385] T 3c6cfff573434fbcb18feaf6a8e6a153 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.360426 9426 raft_consensus.cc:740] T 3c6cfff573434fbcb18feaf6a8e6a153 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.360662 9426 consensus_queue.cc:260] T 3c6cfff573434fbcb18feaf6a8e6a153 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.360785 8978 leader_election.cc:304] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.361209 9426 ts_tablet_manager.cc:1434] T 3c6cfff573434fbcb18feaf6a8e6a153 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:17.361415 10616 raft_consensus.cc:2804] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:17.361459 9426 tablet_bootstrap.cc:492] T 034fec793ae74fcda0c73f1cea291311 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.361552 10616 raft_consensus.cc:493] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:17.361673 10616 raft_consensus.cc:3060] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.362995 9426 tablet_bootstrap.cc:654] T 034fec793ae74fcda0c73f1cea291311 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:17.364356 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:17.365005 10616 raft_consensus.cc:515] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.372188 9435 tablet_bootstrap.cc:492] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:17.373157 9435 ts_tablet_manager.cc:1403] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.036s user 0.008s sys 0.003s
I20251215 14:55:17.373483 9971 raft_consensus.cc:493] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.373764 9971 raft_consensus.cc:515] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.374368 9971 leader_election.cc:290] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.375012 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "123361ef48714d859ee5ac85c3c37d08" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:17.375535 9249 leader_election.cc:343] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:17.376152 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:17.376336 9426 tablet_bootstrap.cc:492] T 034fec793ae74fcda0c73f1cea291311 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.376452 9426 ts_tablet_manager.cc:1403] T 034fec793ae74fcda0c73f1cea291311 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20251215 14:55:17.377192 9426 raft_consensus.cc:359] T 034fec793ae74fcda0c73f1cea291311 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.377342 9426 raft_consensus.cc:385] T 034fec793ae74fcda0c73f1cea291311 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.377394 9426 raft_consensus.cc:740] T 034fec793ae74fcda0c73f1cea291311 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.377557 9426 consensus_queue.cc:260] T 034fec793ae74fcda0c73f1cea291311 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.378041 9426 ts_tablet_manager.cc:1434] T 034fec793ae74fcda0c73f1cea291311 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:17.378284 9435 raft_consensus.cc:359] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.378472 9435 raft_consensus.cc:385] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.378556 9435 raft_consensus.cc:740] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.378762 9435 consensus_queue.cc:260] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.383491 9435 ts_tablet_manager.cc:1434] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20251215 14:55:17.381791 9248 leader_election.cc:304] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.383726 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3af4f753a04b429a857e018f201ae6ed" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:17.384054 9426 tablet_bootstrap.cc:492] T 15b8a2a337e54321afd67f7562c412a0 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:17.384361 8976 leader_election.cc:343] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.385394 10606 raft_consensus.cc:2804] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:17.385486 10606 raft_consensus.cc:493] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:17.385587 10606 raft_consensus.cc:3060] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.385738 9426 tablet_bootstrap.cc:654] T 15b8a2a337e54321afd67f7562c412a0 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.387301 9427 tablet_bootstrap.cc:492] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:17.387419 9427 ts_tablet_manager.cc:1403] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.005s
I20251215 14:55:17.386801 10616 leader_election.cc:290] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.388633 10606 raft_consensus.cc:515] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.389791 10606 leader_election.cc:290] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.388126 9427 raft_consensus.cc:359] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.391072 9427 raft_consensus.cc:385] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.391151 9427 raft_consensus.cc:740] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.391189 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "804ad50f38314be3bf9e118eee9fe748" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:17.391369 9427 consensus_queue.cc:260] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:17.391687 9249 leader_election.cc:343] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.391840 9427 ts_tablet_manager.cc:1434] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20251215 14:55:17.392091 9427 tablet_bootstrap.cc:492] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:17.393265 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "123361ef48714d859ee5ac85c3c37d08" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:17.393466 9041 raft_consensus.cc:2468] T 123361ef48714d859ee5ac85c3c37d08 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:17.393627 9427 tablet_bootstrap.cc:654] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.394400 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "804ad50f38314be3bf9e118eee9fe748" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:17.394551 9041 raft_consensus.cc:3060] T 804ad50f38314be3bf9e118eee9fe748 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.397130 9041 raft_consensus.cc:2468] T 804ad50f38314be3bf9e118eee9fe748 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:17.397192 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3af4f753a04b429a857e018f201ae6ed" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:17.397408 9312 raft_consensus.cc:3060] T 3af4f753a04b429a857e018f201ae6ed P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.401218 9312 raft_consensus.cc:2468] T 3af4f753a04b429a857e018f201ae6ed P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:17.383838 9435 tablet_bootstrap.cc:492] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:17.408043 8978 leader_election.cc:304] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.408563 10616 raft_consensus.cc:2804] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:17.408764 10616 raft_consensus.cc:697] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:17.409006 10616 consensus_queue.cc:237] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.409277 9427 tablet_bootstrap.cc:492] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:17.409439 9427 ts_tablet_manager.cc:1403] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.005s
I20251215 14:55:17.410256 9427 raft_consensus.cc:359] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.410430 9427 raft_consensus.cc:385] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.410511 9427 raft_consensus.cc:740] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.410751 9427 consensus_queue.cc:260] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.411260 9427 ts_tablet_manager.cc:1434] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:17.411540 9427 tablet_bootstrap.cc:492] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:17.413014 9427 tablet_bootstrap.cc:654] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.414523 9426 tablet_bootstrap.cc:492] T 15b8a2a337e54321afd67f7562c412a0 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.414670 9426 ts_tablet_manager.cc:1403] T 15b8a2a337e54321afd67f7562c412a0 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.001s
I20251215 14:55:17.415180 9971 raft_consensus.cc:493] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.415319 9971 raft_consensus.cc:515] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.415422 9426 raft_consensus.cc:359] T 15b8a2a337e54321afd67f7562c412a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.415552 9426 raft_consensus.cc:385] T 15b8a2a337e54321afd67f7562c412a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.415596 9426 raft_consensus.cc:740] T 15b8a2a337e54321afd67f7562c412a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.415959 9971 leader_election.cc:290] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.416152 9426 consensus_queue.cc:260] T 15b8a2a337e54321afd67f7562c412a0 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.416316 10613 raft_consensus.cc:493] T 3c6cfff573434fbcb18feaf6a8e6a153 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.416407 10613 raft_consensus.cc:515] T 3c6cfff573434fbcb18feaf6a8e6a153 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.416615 9426 ts_tablet_manager.cc:1434] T 15b8a2a337e54321afd67f7562c412a0 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:17.416875 9426 tablet_bootstrap.cc:492] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.416963 10613 leader_election.cc:290] T 3c6cfff573434fbcb18feaf6a8e6a153 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.418121 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "682cafa003a64138a01024be2573fe34" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:17.417426 9248 leader_election.cc:304] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.418234 9426 tablet_bootstrap.cc:654] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:17.419104 9249 leader_election.cc:343] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.419682 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c6cfff573434fbcb18feaf6a8e6a153" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:17.420692 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c6cfff573434fbcb18feaf6a8e6a153" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:17.421164 9112 leader_election.cc:304] T 3c6cfff573434fbcb18feaf6a8e6a153 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:17.421509 10561 raft_consensus.cc:2749] T 3c6cfff573434fbcb18feaf6a8e6a153 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:17.431711 9435 tablet_bootstrap.cc:654] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.432301 9427 tablet_bootstrap.cc:492] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:17.432466 9427 ts_tablet_manager.cc:1403] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.001s
I20251215 14:55:17.432914 10606 raft_consensus.cc:2804] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:17.433271 9427 raft_consensus.cc:359] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.433449 9427 raft_consensus.cc:385] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.433619 9427 raft_consensus.cc:740] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.434610 10606 raft_consensus.cc:493] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:17.434619 9248 leader_election.cc:304] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.434765 10606 raft_consensus.cc:3060] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.434310 9427 consensus_queue.cc:260] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.443125 10601 raft_consensus.cc:493] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.443351 10601 raft_consensus.cc:515] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.443971 10601 leader_election.cc:290] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.444149 10345 raft_consensus.cc:2804] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:17.445561 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6229b8bc8d3d446c944c819670b10d54" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:17.445487 9427 ts_tablet_manager.cc:1434] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.012s user 0.004s sys 0.000s
I20251215 14:55:17.446319 10345 raft_consensus.cc:697] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:17.446593 10345 consensus_queue.cc:237] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:17.447965 8976 leader_election.cc:343] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.448954 9427 tablet_bootstrap.cc:492] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:17.450109 9426 tablet_bootstrap.cc:492] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.450146 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "682cafa003a64138a01024be2573fe34" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:17.450150 10606 raft_consensus.cc:515] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.450368 9426 ts_tablet_manager.cc:1403] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.034s user 0.000s sys 0.007s
I20251215 14:55:17.450359 9040 raft_consensus.cc:2468] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:17.450754 10606 leader_election.cc:290] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.451154 9426 raft_consensus.cc:359] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.451332 9426 raft_consensus.cc:385] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.451380 9426 raft_consensus.cc:740] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.451540 9426 consensus_queue.cc:260] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.451821 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "123361ef48714d859ee5ac85c3c37d08" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:17.452998 9249 leader_election.cc:343] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.453262 9426 ts_tablet_manager.cc:1434] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:17.453289 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6229b8bc8d3d446c944c819670b10d54" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
W20251215 14:55:17.453728 8978 leader_election.cc:343] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.453869 9426 tablet_bootstrap.cc:492] T 79f3a7a065d243c98b465a984bd2b1f9 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.453809 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "123361ef48714d859ee5ac85c3c37d08" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:17.453897 8978 leader_election.cc:304] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:17.453987 9038 raft_consensus.cc:3060] T 123361ef48714d859ee5ac85c3c37d08 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.454157 10601 raft_consensus.cc:2749] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:17.455423 9248 leader_election.cc:304] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.456564 9038 raft_consensus.cc:2468] T 123361ef48714d859ee5ac85c3c37d08 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:17.457347 9426 tablet_bootstrap.cc:654] T 79f3a7a065d243c98b465a984bd2b1f9 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.458851 10606 raft_consensus.cc:2804] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:17.458954 10606 raft_consensus.cc:493] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:17.459045 10606 raft_consensus.cc:3060] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.461628 10606 raft_consensus.cc:515] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.462659 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "682cafa003a64138a01024be2573fe34" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:17.463366 9249 leader_election.cc:343] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.466519 9427 tablet_bootstrap.cc:654] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.467231 10606 leader_election.cc:290] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.467725 9248 leader_election.cc:304] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.468168 9971 raft_consensus.cc:2804] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:17.468312 9971 raft_consensus.cc:697] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:17.468547 9971 consensus_queue.cc:237] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.472529 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "682cafa003a64138a01024be2573fe34" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:17.472844 9038 raft_consensus.cc:3060] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.475405 9038 raft_consensus.cc:2468] T 682cafa003a64138a01024be2573fe34 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:17.475828 9248 leader_election.cc:304] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.476202 10606 raft_consensus.cc:2804] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:17.476428 10606 raft_consensus.cc:697] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:17.476676 10606 consensus_queue.cc:237] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.483676 9426 tablet_bootstrap.cc:492] T 79f3a7a065d243c98b465a984bd2b1f9 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.484274 9426 ts_tablet_manager.cc:1403] T 79f3a7a065d243c98b465a984bd2b1f9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.005s
I20251215 14:55:17.486580 9426 raft_consensus.cc:359] T 79f3a7a065d243c98b465a984bd2b1f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.489799 9426 raft_consensus.cc:385] T 79f3a7a065d243c98b465a984bd2b1f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.497280 9426 raft_consensus.cc:740] T 79f3a7a065d243c98b465a984bd2b1f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.497632 9426 consensus_queue.cc:260] T 79f3a7a065d243c98b465a984bd2b1f9 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.498317 9426 ts_tablet_manager.cc:1434] T 79f3a7a065d243c98b465a984bd2b1f9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20251215 14:55:17.498636 9426 tablet_bootstrap.cc:492] T 7634179e7bef4b95ae6e06b4581888e7 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.500057 9426 tablet_bootstrap.cc:654] T 7634179e7bef4b95ae6e06b4581888e7 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.503003 10606 raft_consensus.cc:493] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.503281 10606 raft_consensus.cc:515] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.504241 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35ade4502ed7497a82b362d38c65244a" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:17.504402 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35ade4502ed7497a82b362d38c65244a" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:17.504451 9038 raft_consensus.cc:2468] T 35ade4502ed7497a82b362d38c65244a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
W20251215 14:55:17.504902 9249 leader_election.cc:343] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.505177 9248 leader_election.cc:304] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.505481 10606 leader_election.cc:290] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.505771 10606 raft_consensus.cc:2804] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:17.505927 10606 raft_consensus.cc:493] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:17.506055 10606 raft_consensus.cc:3060] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.508905 10606 raft_consensus.cc:515] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.513347 9435 tablet_bootstrap.cc:492] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:17.513557 9435 ts_tablet_manager.cc:1403] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.130s user 0.003s sys 0.006s
I20251215 14:55:17.514513 9435 raft_consensus.cc:359] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.514789 9435 raft_consensus.cc:385] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.514902 9435 raft_consensus.cc:740] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.517247 9435 consensus_queue.cc:260] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.517964 9435 ts_tablet_manager.cc:1434] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20251215 14:55:17.518654 9435 tablet_bootstrap.cc:492] T 2ebdaff1fcbe4b27b6da28f010d1af1a P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:17.518759 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35ade4502ed7497a82b362d38c65244a" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:17.518957 9038 raft_consensus.cc:3060] T 35ade4502ed7497a82b362d38c65244a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.520527 9435 tablet_bootstrap.cc:654] T 2ebdaff1fcbe4b27b6da28f010d1af1a P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.521493 9038 raft_consensus.cc:2468] T 35ade4502ed7497a82b362d38c65244a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:17.522013 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35ade4502ed7497a82b362d38c65244a" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:17.522742 9249 leader_election.cc:343] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.523100 9174 raft_consensus.cc:3060] T a0a74645593d46fcbc0235ec6a4670d8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.526427 9248 leader_election.cc:304] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.526716 10345 raft_consensus.cc:2804] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:17.526845 10345 raft_consensus.cc:697] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:17.527119 10345 consensus_queue.cc:237] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.527729 10527 consensus_queue.cc:1048] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:17.528739 9427 tablet_bootstrap.cc:492] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:17.529194 9427 ts_tablet_manager.cc:1403] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.081s user 0.006s sys 0.008s
I20251215 14:55:17.529716 10527 raft_consensus.cc:493] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.529861 10527 raft_consensus.cc:515] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.530421 10527 leader_election.cc:290] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.530839 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "21a98ce868924690b8a5715f4103c360" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:17.531045 9303 raft_consensus.cc:2468] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:17.531337 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "21a98ce868924690b8a5715f4103c360" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:17.532444 8976 leader_election.cc:343] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.532601 10561 consensus_queue.cc:1048] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:17.534113 8978 leader_election.cc:304] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.534583 10616 raft_consensus.cc:2804] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:17.534693 10616 raft_consensus.cc:493] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:17.534919 10616 raft_consensus.cc:3060] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.537582 10616 raft_consensus.cc:515] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.540509 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "21a98ce868924690b8a5715f4103c360" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:17.552989 10606 leader_election.cc:290] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.556578 10561 raft_consensus.cc:493] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.556725 10561 raft_consensus.cc:515] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.557302 10561 leader_election.cc:290] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.558435 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35326e99d413431583b25d11269d09dc" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:17.558706 9303 raft_consensus.cc:2468] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:17.559268 9115 leader_election.cc:304] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:17.559782 10561 raft_consensus.cc:2804] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:17.559850 10561 raft_consensus.cc:493] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:17.559898 10561 raft_consensus.cc:3060] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.562341 10561 raft_consensus.cc:515] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:17.562798 8976 leader_election.cc:343] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:17.563985 9112 leader_election.cc:343] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 35326e99d413431583b25d11269d09dc
W20251215 14:55:17.564155 9112 leader_election.cc:343] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 35326e99d413431583b25d11269d09dc
I20251215 14:55:17.564512 10561 leader_election.cc:290] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.565440 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35326e99d413431583b25d11269d09dc" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:17.565613 9306 raft_consensus.cc:3060] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.568027 10616 leader_election.cc:290] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.568158 9306 raft_consensus.cc:2468] T 35326e99d413431583b25d11269d09dc P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
W20251215 14:55:17.568190 8976 consensus_peers.cc:597] T 050260e67b924f13847b9550a91e274b P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:17.568449 9435 tablet_bootstrap.cc:492] T 2ebdaff1fcbe4b27b6da28f010d1af1a P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:17.568337 9427 raft_consensus.cc:359] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.568542 9427 raft_consensus.cc:385] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.568586 9435 ts_tablet_manager.cc:1403] T 2ebdaff1fcbe4b27b6da28f010d1af1a P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.001s
I20251215 14:55:17.568611 9427 raft_consensus.cc:740] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.568668 9115 leader_election.cc:304] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:17.568854 9427 consensus_queue.cc:260] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.569340 9427 ts_tablet_manager.cc:1434] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.040s user 0.002s sys 0.000s
I20251215 14:55:17.569340 9435 raft_consensus.cc:359] T 2ebdaff1fcbe4b27b6da28f010d1af1a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.569494 9435 raft_consensus.cc:385] T 2ebdaff1fcbe4b27b6da28f010d1af1a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.569590 9435 raft_consensus.cc:740] T 2ebdaff1fcbe4b27b6da28f010d1af1a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.569622 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "21a98ce868924690b8a5715f4103c360" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:17.569799 9303 raft_consensus.cc:3060] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.570138 9427 tablet_bootstrap.cc:492] T c8b49b3d98ef4e0988e9019fe82f8727 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:17.569804 9435 consensus_queue.cc:260] T 2ebdaff1fcbe4b27b6da28f010d1af1a P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.571709 9427 tablet_bootstrap.cc:654] T c8b49b3d98ef4e0988e9019fe82f8727 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.572638 9303 raft_consensus.cc:2468] T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:17.573711 8978 leader_election.cc:304] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.574148 10616 raft_consensus.cc:2804] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:17.574299 10616 raft_consensus.cc:697] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:17.574530 10616 consensus_queue.cc:237] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.576313 10561 raft_consensus.cc:2804] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:17.576761 10561 raft_consensus.cc:697] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:17.577096 10561 consensus_queue.cc:237] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.580814 9172 raft_consensus.cc:3060] T 65ea0509d8eb42bdb2291ff01e8d3bd6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.582293 9435 ts_tablet_manager.cc:1434] T 2ebdaff1fcbe4b27b6da28f010d1af1a P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.014s user 0.001s sys 0.001s
I20251215 14:55:17.582651 9435 tablet_bootstrap.cc:492] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:17.584559 9435 tablet_bootstrap.cc:654] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.587675 9426 tablet_bootstrap.cc:492] T 7634179e7bef4b95ae6e06b4581888e7 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.587819 9426 ts_tablet_manager.cc:1403] T 7634179e7bef4b95ae6e06b4581888e7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.089s user 0.005s sys 0.003s
I20251215 14:55:17.587818 9088 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:17.588516 9426 raft_consensus.cc:359] T 7634179e7bef4b95ae6e06b4581888e7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.588689 9426 raft_consensus.cc:385] T 7634179e7bef4b95ae6e06b4581888e7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.588742 9426 raft_consensus.cc:740] T 7634179e7bef4b95ae6e06b4581888e7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.588903 9426 consensus_queue.cc:260] T 7634179e7bef4b95ae6e06b4581888e7 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.589512 9426 ts_tablet_manager.cc:1434] T 7634179e7bef4b95ae6e06b4581888e7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:17.589768 9426 tablet_bootstrap.cc:492] T 050260e67b924f13847b9550a91e274b P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.591066 9426 tablet_bootstrap.cc:654] T 050260e67b924f13847b9550a91e274b P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:17.602722 8976 consensus_peers.cc:597] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:17.623539 9435 tablet_bootstrap.cc:492] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:17.623802 9435 ts_tablet_manager.cc:1403] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.041s user 0.005s sys 0.001s
I20251215 14:55:17.624693 9435 raft_consensus.cc:359] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.624920 9435 raft_consensus.cc:385] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.624994 9435 raft_consensus.cc:740] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.625239 9435 consensus_queue.cc:260] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.625514 9427 tablet_bootstrap.cc:492] T c8b49b3d98ef4e0988e9019fe82f8727 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:17.626106 9427 ts_tablet_manager.cc:1403] T c8b49b3d98ef4e0988e9019fe82f8727 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.056s user 0.005s sys 0.003s
I20251215 14:55:17.631824 10561 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.631985 10561 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.632301 9435 ts_tablet_manager.cc:1434] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20251215 14:55:17.632601 10561 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.632681 9435 tablet_bootstrap.cc:492] T a2a58a13b66641b0bdc710cf5d458689 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:17.634582 9435 tablet_bootstrap.cc:654] T a2a58a13b66641b0bdc710cf5d458689 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:17.635102 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:55:17.635600 9426 tablet_bootstrap.cc:492] T 050260e67b924f13847b9550a91e274b P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
W20251215 14:55:17.635634 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:55:17.635749 9426 ts_tablet_manager.cc:1403] T 050260e67b924f13847b9550a91e274b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.046s user 0.006s sys 0.000s
I20251215 14:55:17.635758 9112 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:17.636480 10561 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:17.636520 9426 raft_consensus.cc:359] T 050260e67b924f13847b9550a91e274b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.636703 9426 raft_consensus.cc:385] T 050260e67b924f13847b9550a91e274b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.636756 9426 raft_consensus.cc:740] T 050260e67b924f13847b9550a91e274b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.636957 9426 consensus_queue.cc:260] T 050260e67b924f13847b9550a91e274b P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.637461 9426 ts_tablet_manager.cc:1434] T 050260e67b924f13847b9550a91e274b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:17.637781 9426 tablet_bootstrap.cc:492] T 78b3f18a62d544b38a0682bf3bc00977 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.630779 9427 raft_consensus.cc:359] T c8b49b3d98ef4e0988e9019fe82f8727 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.639318 9426 tablet_bootstrap.cc:654] T 78b3f18a62d544b38a0682bf3bc00977 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.639281 9427 raft_consensus.cc:385] T c8b49b3d98ef4e0988e9019fe82f8727 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.641355 10561 raft_consensus.cc:493] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.641494 10561 raft_consensus.cc:515] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.642067 10561 leader_election.cc:290] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.642686 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dd36ea0aa53460f9c1fda4b31063fa7" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:17.643113 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dd36ea0aa53460f9c1fda4b31063fa7" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:17.645164 9112 leader_election.cc:304] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:17.645429 9427 raft_consensus.cc:740] T c8b49b3d98ef4e0988e9019fe82f8727 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.647305 10561 raft_consensus.cc:2749] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:17.648339 10561 raft_consensus.cc:493] T accc3fdaf8e64b0f96b45150a59516bf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.648456 10561 raft_consensus.cc:515] T accc3fdaf8e64b0f96b45150a59516bf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.648998 10561 leader_election.cc:290] T accc3fdaf8e64b0f96b45150a59516bf P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.649741 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "accc3fdaf8e64b0f96b45150a59516bf" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:17.650894 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "accc3fdaf8e64b0f96b45150a59516bf" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:17.650739 9427 consensus_queue.cc:260] T c8b49b3d98ef4e0988e9019fe82f8727 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.656352 9112 leader_election.cc:304] T accc3fdaf8e64b0f96b45150a59516bf P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:17.657099 10559 raft_consensus.cc:2749] T accc3fdaf8e64b0f96b45150a59516bf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:17.658461 10345 raft_consensus.cc:493] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.658717 10345 raft_consensus.cc:515] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.659641 10345 leader_election.cc:290] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.660415 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "66f2c74e55f04a6fa4b2c238c0a6b901" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:17.661020 9249 leader_election.cc:343] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.661162 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "66f2c74e55f04a6fa4b2c238c0a6b901" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:17.661432 9038 raft_consensus.cc:2468] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:17.661922 9248 leader_election.cc:304] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.662487 10345 raft_consensus.cc:2804] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:17.662592 10345 raft_consensus.cc:493] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:17.662731 10345 raft_consensus.cc:3060] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.665643 10345 raft_consensus.cc:515] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.666496 10345 leader_election.cc:290] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.667142 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "66f2c74e55f04a6fa4b2c238c0a6b901" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:17.667042 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "66f2c74e55f04a6fa4b2c238c0a6b901" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:17.668529 9038 raft_consensus.cc:3060] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.666282 9427 ts_tablet_manager.cc:1434] T c8b49b3d98ef4e0988e9019fe82f8727 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.039s user 0.004s sys 0.001s
I20251215 14:55:17.671077 9038 raft_consensus.cc:2468] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:17.672443 10561 raft_consensus.cc:493] T 15b8a2a337e54321afd67f7562c412a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.672560 10561 raft_consensus.cc:515] T 15b8a2a337e54321afd67f7562c412a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.673112 10561 leader_election.cc:290] T 15b8a2a337e54321afd67f7562c412a0 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.673995 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b8a2a337e54321afd67f7562c412a0" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:17.676043 9426 tablet_bootstrap.cc:492] T 78b3f18a62d544b38a0682bf3bc00977 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.676187 9426 ts_tablet_manager.cc:1403] T 78b3f18a62d544b38a0682bf3bc00977 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.000s
I20251215 14:55:17.675872 9427 tablet_bootstrap.cc:492] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:17.676911 9426 raft_consensus.cc:359] T 78b3f18a62d544b38a0682bf3bc00977 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.677085 9426 raft_consensus.cc:385] T 78b3f18a62d544b38a0682bf3bc00977 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.677145 9426 raft_consensus.cc:740] T 78b3f18a62d544b38a0682bf3bc00977 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.677341 9426 consensus_queue.cc:260] T 78b3f18a62d544b38a0682bf3bc00977 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.677896 9426 ts_tablet_manager.cc:1434] T 78b3f18a62d544b38a0682bf3bc00977 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:17.679688 9426 tablet_bootstrap.cc:492] T 6ec16a234222470bb9cf8c29db536cc1 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:17.680564 9249 leader_election.cc:343] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.681133 9426 tablet_bootstrap.cc:654] T 6ec16a234222470bb9cf8c29db536cc1 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.692050 9248 leader_election.cc:304] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.692427 10345 raft_consensus.cc:2804] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:17.697273 9427 tablet_bootstrap.cc:654] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.698290 9971 raft_consensus.cc:493] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.698429 9971 raft_consensus.cc:515] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.699499 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e48a6b6dfe094c34b30b8d3a44c66435" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:17.702078 9971 leader_election.cc:290] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.702440 10345 raft_consensus.cc:697] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:17.702955 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "15b8a2a337e54321afd67f7562c412a0" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:17.703194 9312 raft_consensus.cc:2393] T 15b8a2a337e54321afd67f7562c412a0 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:17.703835 9115 leader_election.cc:304] T 15b8a2a337e54321afd67f7562c412a0 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:17.704324 10561 raft_consensus.cc:3060] T 15b8a2a337e54321afd67f7562c412a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.706800 10561 raft_consensus.cc:2749] T 15b8a2a337e54321afd67f7562c412a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:17.707085 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e48a6b6dfe094c34b30b8d3a44c66435" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:17.707104 10616 consensus_queue.cc:1048] T 78b3f18a62d544b38a0682bf3bc00977 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20251215 14:55:17.707460 9038 raft_consensus.cc:2468] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
W20251215 14:55:17.708877 9249 leader_election.cc:343] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.709908 10345 consensus_queue.cc:237] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.712504 9248 leader_election.cc:304] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.716791 9971 raft_consensus.cc:2804] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:17.720151 9426 tablet_bootstrap.cc:492] T 6ec16a234222470bb9cf8c29db536cc1 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.722398 10561 raft_consensus.cc:493] T 88206b17f94242378a35d5314611ac1a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.720813 9426 ts_tablet_manager.cc:1403] T 6ec16a234222470bb9cf8c29db536cc1 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.005s
I20251215 14:55:17.722525 10561 raft_consensus.cc:515] T 88206b17f94242378a35d5314611ac1a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.722649 9361 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:17.723140 10561 leader_election.cc:290] T 88206b17f94242378a35d5314611ac1a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.724211 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88206b17f94242378a35d5314611ac1a" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:17.725915 9971 raft_consensus.cc:493] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:17.727864 9971 raft_consensus.cc:3060] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.729352 10690 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40747def373e4b19abfa5d21ba0a4315)
I20251215 14:55:17.729522 10690 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:17.729758 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88206b17f94242378a35d5314611ac1a" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:17.730607 10690 leader_election.cc:290] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cad1fca07ac7419cb608c21541f672f3 (127.8.121.190:44279), 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723)
I20251215 14:55:17.732425 9115 leader_election.cc:304] T 88206b17f94242378a35d5314611ac1a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:17.732892 10561 raft_consensus.cc:2749] T 88206b17f94242378a35d5314611ac1a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:17.732951 9971 raft_consensus.cc:515] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.733498 10616 raft_consensus.cc:493] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.733577 9971 leader_election.cc:290] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.735142 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e48a6b6dfe094c34b30b8d3a44c66435" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:17.735736 9249 leader_election.cc:343] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.741420 9426 raft_consensus.cc:359] T 6ec16a234222470bb9cf8c29db536cc1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.742695 9426 raft_consensus.cc:385] T 6ec16a234222470bb9cf8c29db536cc1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.743196 9426 raft_consensus.cc:740] T 6ec16a234222470bb9cf8c29db536cc1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.744001 9435 tablet_bootstrap.cc:492] T a2a58a13b66641b0bdc710cf5d458689 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:17.744947 10616 raft_consensus.cc:515] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.745656 10616 leader_election.cc:290] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.746840 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9beef04f876d40d89dac5970ac6828e9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:17.749163 8976 leader_election.cc:343] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.749166 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e48a6b6dfe094c34b30b8d3a44c66435" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:17.749509 9038 raft_consensus.cc:3060] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.750409 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9beef04f876d40d89dac5970ac6828e9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:17.751122 9435 ts_tablet_manager.cc:1403] T a2a58a13b66641b0bdc710cf5d458689 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.112s user 0.006s sys 0.006s
I20251215 14:55:17.752005 9312 raft_consensus.cc:2468] T 9beef04f876d40d89dac5970ac6828e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:17.753747 8978 leader_election.cc:304] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.754305 10527 raft_consensus.cc:2804] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:17.754396 10527 raft_consensus.cc:493] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:17.754483 10527 raft_consensus.cc:3060] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.755453 9038 raft_consensus.cc:2468] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:17.755798 9248 leader_election.cc:304] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.756188 9435 raft_consensus.cc:359] T a2a58a13b66641b0bdc710cf5d458689 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.756319 9435 raft_consensus.cc:385] T a2a58a13b66641b0bdc710cf5d458689 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.756356 9435 raft_consensus.cc:740] T a2a58a13b66641b0bdc710cf5d458689 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.756577 9435 consensus_queue.cc:260] T a2a58a13b66641b0bdc710cf5d458689 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.757021 9435 ts_tablet_manager.cc:1434] T a2a58a13b66641b0bdc710cf5d458689 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251215 14:55:17.757022 10527 raft_consensus.cc:515] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.757242 9435 tablet_bootstrap.cc:492] T f4203c4941184a66956ec9be8d703bb6 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:17.757640 10527 leader_election.cc:290] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.757946 9971 raft_consensus.cc:2804] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:17.757972 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9beef04f876d40d89dac5970ac6828e9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:17.758086 9303 raft_consensus.cc:3060] T 9beef04f876d40d89dac5970ac6828e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.758242 9971 raft_consensus.cc:697] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:17.758474 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9beef04f876d40d89dac5970ac6828e9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:17.758466 9971 consensus_queue.cc:237] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:17.759056 8976 leader_election.cc:343] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.760461 9303 raft_consensus.cc:2468] T 9beef04f876d40d89dac5970ac6828e9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:17.760851 8978 leader_election.cc:304] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.761158 10527 raft_consensus.cc:2804] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:17.761444 10527 raft_consensus.cc:697] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:17.762079 9435 tablet_bootstrap.cc:654] T f4203c4941184a66956ec9be8d703bb6 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.762038 10527 consensus_queue.cc:237] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.763649 9172 raft_consensus.cc:1275] T 5bfe8cc0805247de9df4a59d461818f3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 FOLLOWER]: Refusing update from remote peer 67978ac4539d4b289e53f4eedd9a8156: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 14:55:17.764279 10601 consensus_queue.cc:1048] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:17.768438 9303 raft_consensus.cc:3060] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:17.769899 9172 raft_consensus.cc:3060] T 2811b8ffdb614c91b0d3d4e6e039245b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.771029 9303 raft_consensus.cc:1275] T 5bfe8cc0805247de9df4a59d461818f3 P e89303a500544272b601d7c29be802b4 [term 2 FOLLOWER]: Refusing update from remote peer 67978ac4539d4b289e53f4eedd9a8156: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 14:55:17.772364 9435 tablet_bootstrap.cc:492] T f4203c4941184a66956ec9be8d703bb6 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:17.772506 10616 consensus_queue.cc:1048] T 5bfe8cc0805247de9df4a59d461818f3 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:17.772703 9435 ts_tablet_manager.cc:1403] T f4203c4941184a66956ec9be8d703bb6 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.001s
I20251215 14:55:17.776979 9435 raft_consensus.cc:359] T f4203c4941184a66956ec9be8d703bb6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.777673 9435 raft_consensus.cc:385] T f4203c4941184a66956ec9be8d703bb6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.777951 9435 raft_consensus.cc:740] T f4203c4941184a66956ec9be8d703bb6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.778767 9435 consensus_queue.cc:260] T f4203c4941184a66956ec9be8d703bb6 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.744681 9426 consensus_queue.cc:260] T 6ec16a234222470bb9cf8c29db536cc1 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.780730 10698 tablet.cc:1722] T 2811b8ffdb614c91b0d3d4e6e039245b P 3ea5306c36594ef4a62211f2bd6669a3: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251215 14:55:17.781765 9435 ts_tablet_manager.cc:1434] T f4203c4941184a66956ec9be8d703bb6 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20251215 14:55:17.782361 9435 tablet_bootstrap.cc:492] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:17.785480 9427 tablet_bootstrap.cc:492] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:17.787899 9427 ts_tablet_manager.cc:1403] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.114s user 0.006s sys 0.000s
I20251215 14:55:17.785297 9426 ts_tablet_manager.cc:1434] T 6ec16a234222470bb9cf8c29db536cc1 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.059s user 0.003s sys 0.000s
I20251215 14:55:17.792481 9426 tablet_bootstrap.cc:492] T 35ade4502ed7497a82b362d38c65244a P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.794544 9426 tablet_bootstrap.cc:654] T 35ade4502ed7497a82b362d38c65244a P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.795346 9435 tablet_bootstrap.cc:654] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.802747 9971 raft_consensus.cc:493] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.802894 9971 raft_consensus.cc:515] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.803460 9971 leader_election.cc:290] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.804169 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc50995f6d934b58ab5f6f6f370cb7e5" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:17.804739 9249 leader_election.cc:343] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.807610 9427 raft_consensus.cc:359] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.809183 9427 raft_consensus.cc:385] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.809897 9427 raft_consensus.cc:740] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.811417 9427 consensus_queue.cc:260] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.813269 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc50995f6d934b58ab5f6f6f370cb7e5" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:17.813486 9040 raft_consensus.cc:2468] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:17.816036 9426 tablet_bootstrap.cc:492] T 35ade4502ed7497a82b362d38c65244a P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.816274 9426 ts_tablet_manager.cc:1403] T 35ade4502ed7497a82b362d38c65244a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.000s
I20251215 14:55:17.816601 9248 leader_election.cc:304] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.816854 10345 raft_consensus.cc:2804] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:17.816936 10345 raft_consensus.cc:493] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:17.817000 10345 raft_consensus.cc:3060] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.814069 9427 ts_tablet_manager.cc:1434] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.026s user 0.003s sys 0.000s
I20251215 14:55:17.819962 9435 tablet_bootstrap.cc:492] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:17.820098 9435 ts_tablet_manager.cc:1403] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.004s
I20251215 14:55:17.819586 9426 raft_consensus.cc:359] T 35ade4502ed7497a82b362d38c65244a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.820974 9426 raft_consensus.cc:385] T 35ade4502ed7497a82b362d38c65244a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.821108 9435 raft_consensus.cc:359] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.821261 9435 raft_consensus.cc:385] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.821308 9435 raft_consensus.cc:740] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.821228 9426 raft_consensus.cc:740] T 35ade4502ed7497a82b362d38c65244a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.821482 9435 consensus_queue.cc:260] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.821951 9435 ts_tablet_manager.cc:1434] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:17.822206 9435 tablet_bootstrap.cc:492] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:17.822144 10506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Bootstrap replayed 1/1 log segments. Stats: ops{read=454 overwritten=0 applied=315 ignored=0} inserts{seen=241 ignored=0} mutations{seen=407 ignored=0} orphaned_commits=0. Pending: 139 replicates
I20251215 14:55:17.821889 9426 consensus_queue.cc:260] T 35ade4502ed7497a82b362d38c65244a P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.825410 9435 tablet_bootstrap.cc:654] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.826983 10506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Bootstrap complete.
I20251215 14:55:17.827953 10345 raft_consensus.cc:515] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.830622 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc50995f6d934b58ab5f6f6f370cb7e5" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:17.830544 10345 leader_election.cc:290] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.831806 9427 tablet_bootstrap.cc:492] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:17.831923 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc50995f6d934b58ab5f6f6f370cb7e5" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:17.832144 9040 raft_consensus.cc:3060] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.833204 9426 ts_tablet_manager.cc:1434] T 35ade4502ed7497a82b362d38c65244a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.016s user 0.002s sys 0.001s
W20251215 14:55:17.831147 9249 leader_election.cc:343] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.834178 9427 tablet_bootstrap.cc:654] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.834753 9040 raft_consensus.cc:2468] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:17.835975 9248 leader_election.cc:304] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.838119 9971 raft_consensus.cc:2804] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:17.838251 9971 raft_consensus.cc:697] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:17.838479 9971 consensus_queue.cc:237] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.847100 10345 consensus_queue.cc:1048] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:17.842324 9426 tablet_bootstrap.cc:492] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.848799 9172 raft_consensus.cc:3060] T 88206b17f94242378a35d5314611ac1a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.852562 9426 tablet_bootstrap.cc:654] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.873113 10559 raft_consensus.cc:493] T 35ade4502ed7497a82b362d38c65244a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.873291 9971 raft_consensus.cc:493] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:17.873281 10559 raft_consensus.cc:515] T 35ade4502ed7497a82b362d38c65244a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.873443 9971 raft_consensus.cc:515] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.873888 10559 leader_election.cc:290] T 35ade4502ed7497a82b362d38c65244a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:17.874310 9971 leader_election.cc:290] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.874413 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35ade4502ed7497a82b362d38c65244a" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:17.874449 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35ade4502ed7497a82b362d38c65244a" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:17.874688 9034 raft_consensus.cc:2393] T 35ade4502ed7497a82b362d38c65244a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:17.875109 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b49b3d98ef4e0988e9019fe82f8727" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:17.875321 9034 raft_consensus.cc:2468] T c8b49b3d98ef4e0988e9019fe82f8727 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:17.874837 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b49b3d98ef4e0988e9019fe82f8727" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:17.875739 9248 leader_election.cc:304] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:17.876058 9971 raft_consensus.cc:2804] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:17.876128 9971 raft_consensus.cc:493] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:17.876184 9971 raft_consensus.cc:3060] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.880585 9971 raft_consensus.cc:515] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.881889 9435 tablet_bootstrap.cc:492] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:17.882033 9435 ts_tablet_manager.cc:1403] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.060s user 0.004s sys 0.008s
I20251215 14:55:17.882951 9435 raft_consensus.cc:359] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.883088 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b49b3d98ef4e0988e9019fe82f8727" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:17.883147 9435 raft_consensus.cc:385] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.883229 9435 raft_consensus.cc:740] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.883299 9034 raft_consensus.cc:3060] T c8b49b3d98ef4e0988e9019fe82f8727 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.883455 9435 consensus_queue.cc:260] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.883996 9435 ts_tablet_manager.cc:1434] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:17.884282 9435 tablet_bootstrap.cc:492] T f4ec165149a74778aee1fb39c4d96871 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:17.884415 9971 leader_election.cc:290] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:17.875869 9112 leader_election.cc:304] T 35ade4502ed7497a82b362d38c65244a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:17.884161 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b49b3d98ef4e0988e9019fe82f8727" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:17.885787 9435 tablet_bootstrap.cc:654] T f4ec165149a74778aee1fb39c4d96871 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.885860 9034 raft_consensus.cc:2468] T c8b49b3d98ef4e0988e9019fe82f8727 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
W20251215 14:55:17.886184 9249 leader_election.cc:343] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.886413 10559 raft_consensus.cc:3060] T 35ade4502ed7497a82b362d38c65244a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.888821 10559 raft_consensus.cc:2749] T 35ade4502ed7497a82b362d38c65244a P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:17.890692 9249 leader_election.cc:343] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:17.892385 9248 leader_election.cc:304] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:17.892657 10345 raft_consensus.cc:2804] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:17.892853 10345 raft_consensus.cc:697] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:17.893146 10345 consensus_queue.cc:237] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.894369 10527 consensus_queue.cc:1048] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:17.903249 9427 tablet_bootstrap.cc:492] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:17.903429 9427 ts_tablet_manager.cc:1403] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.073s user 0.011s sys 0.010s
I20251215 14:55:17.904707 9426 tablet_bootstrap.cc:492] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.904099 9172 raft_consensus.cc:3060] T 6ec16a234222470bb9cf8c29db536cc1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.904909 9426 ts_tablet_manager.cc:1403] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.063s user 0.004s sys 0.000s
I20251215 14:55:17.905874 9427 raft_consensus.cc:359] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.906085 9427 raft_consensus.cc:385] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.906179 9427 raft_consensus.cc:740] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.906132 9426 raft_consensus.cc:359] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.906364 9426 raft_consensus.cc:385] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.906406 9427 consensus_queue.cc:260] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.906476 9426 raft_consensus.cc:740] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.906973 9427 ts_tablet_manager.cc:1434] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251215 14:55:17.907331 9427 tablet_bootstrap.cc:492] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:17.909231 9427 tablet_bootstrap.cc:654] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.910349 9426 consensus_queue.cc:260] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.912331 9426 ts_tablet_manager.cc:1434] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
W20251215 14:55:17.915184 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:17.916433 9174 raft_consensus.cc:3060] T 7634179e7bef4b95ae6e06b4581888e7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.918013 9426 tablet_bootstrap.cc:492] T fc50995f6d934b58ab5f6f6f370cb7e5 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.896256 10506 raft_consensus.cc:359] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Replica starting. Triggering 139 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:17.920351 10527 consensus_queue.cc:1048] T 7634179e7bef4b95ae6e06b4581888e7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:17.921659 9435 tablet_bootstrap.cc:492] T f4ec165149a74778aee1fb39c4d96871 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:17.921871 9435 ts_tablet_manager.cc:1403] T f4ec165149a74778aee1fb39c4d96871 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.038s user 0.007s sys 0.004s
I20251215 14:55:17.922613 9435 raft_consensus.cc:359] T f4ec165149a74778aee1fb39c4d96871 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.922792 9435 raft_consensus.cc:385] T f4ec165149a74778aee1fb39c4d96871 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.922843 9435 raft_consensus.cc:740] T f4ec165149a74778aee1fb39c4d96871 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.923030 9435 consensus_queue.cc:260] T f4ec165149a74778aee1fb39c4d96871 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.923460 9179 raft_consensus.cc:3060] T accc3fdaf8e64b0f96b45150a59516bf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.923673 9435 ts_tablet_manager.cc:1434] T f4ec165149a74778aee1fb39c4d96871 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:17.923954 9435 tablet_bootstrap.cc:492] T a93d01ea31a64dc2a8d8b03884675024 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:17.925426 9435 tablet_bootstrap.cc:654] T a93d01ea31a64dc2a8d8b03884675024 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.927181 9427 tablet_bootstrap.cc:492] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:17.927381 9427 ts_tablet_manager.cc:1403] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.000s
I20251215 14:55:17.928243 9427 raft_consensus.cc:359] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.928464 9427 raft_consensus.cc:385] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.928550 9427 raft_consensus.cc:740] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.928805 9427 consensus_queue.cc:260] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.929461 9427 ts_tablet_manager.cc:1434] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:17.929827 9427 tablet_bootstrap.cc:492] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:17.931407 9426 tablet_bootstrap.cc:654] T fc50995f6d934b58ab5f6f6f370cb7e5 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.931638 9427 tablet_bootstrap.cc:654] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.932245 9178 raft_consensus.cc:3060] T f830b4af355e480bbe75d6060585529e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:17.941332 9427 tablet_bootstrap.cc:492] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:17.941512 9427 ts_tablet_manager.cc:1403] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.002s
I20251215 14:55:17.944615 9426 tablet_bootstrap.cc:492] T fc50995f6d934b58ab5f6f6f370cb7e5 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.944846 9426 ts_tablet_manager.cc:1403] T fc50995f6d934b58ab5f6f6f370cb7e5 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.031s user 0.009s sys 0.001s
I20251215 14:55:17.948952 9427 raft_consensus.cc:359] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.949164 9427 raft_consensus.cc:385] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.949278 9427 raft_consensus.cc:740] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.949529 9427 consensus_queue.cc:260] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.951768 9427 ts_tablet_manager.cc:1434] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:17.952754 9427 tablet_bootstrap.cc:492] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:17.953722 9426 raft_consensus.cc:359] T fc50995f6d934b58ab5f6f6f370cb7e5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.953980 9426 raft_consensus.cc:385] T fc50995f6d934b58ab5f6f6f370cb7e5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.954360 9426 raft_consensus.cc:740] T fc50995f6d934b58ab5f6f6f370cb7e5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.954599 9427 tablet_bootstrap.cc:654] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.954869 9426 consensus_queue.cc:260] T fc50995f6d934b58ab5f6f6f370cb7e5 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.955396 9426 ts_tablet_manager.cc:1434] T fc50995f6d934b58ab5f6f6f370cb7e5 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20251215 14:55:17.955746 9426 tablet_bootstrap.cc:492] T e48a6b6dfe094c34b30b8d3a44c66435 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.965596 9971 consensus_queue.cc:1048] T 6ec16a234222470bb9cf8c29db536cc1 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:17.972191 9435 tablet_bootstrap.cc:492] T a93d01ea31a64dc2a8d8b03884675024 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:17.972375 9435 ts_tablet_manager.cc:1403] T a93d01ea31a64dc2a8d8b03884675024 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.012s
I20251215 14:55:17.973106 9435 raft_consensus.cc:359] T a93d01ea31a64dc2a8d8b03884675024 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.973331 9435 raft_consensus.cc:385] T a93d01ea31a64dc2a8d8b03884675024 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.973430 9435 raft_consensus.cc:740] T a93d01ea31a64dc2a8d8b03884675024 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.973655 9435 consensus_queue.cc:260] T a93d01ea31a64dc2a8d8b03884675024 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.974181 9435 ts_tablet_manager.cc:1434] T a93d01ea31a64dc2a8d8b03884675024 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
W20251215 14:55:17.974213 9249 consensus_peers.cc:597] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:17.974570 9435 tablet_bootstrap.cc:492] T 46bd8e49fff5473f8787742f6023ddbe P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:17.975919 9435 tablet_bootstrap.cc:654] T 46bd8e49fff5473f8787742f6023ddbe P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.978826 9426 tablet_bootstrap.cc:654] T e48a6b6dfe094c34b30b8d3a44c66435 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.982934 9426 tablet_bootstrap.cc:492] T e48a6b6dfe094c34b30b8d3a44c66435 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:17.983121 9426 ts_tablet_manager.cc:1403] T e48a6b6dfe094c34b30b8d3a44c66435 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.000s
I20251215 14:55:17.983902 9426 raft_consensus.cc:359] T e48a6b6dfe094c34b30b8d3a44c66435 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.984140 9426 raft_consensus.cc:385] T e48a6b6dfe094c34b30b8d3a44c66435 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:17.984241 9426 raft_consensus.cc:740] T e48a6b6dfe094c34b30b8d3a44c66435 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:17.984491 9426 consensus_queue.cc:260] T e48a6b6dfe094c34b30b8d3a44c66435 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:17.985044 9426 ts_tablet_manager.cc:1434] T e48a6b6dfe094c34b30b8d3a44c66435 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:17.985345 9426 tablet_bootstrap.cc:492] T 58926ab073974e2c8b725d5061a544d5 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:17.987041 9426 tablet_bootstrap.cc:654] T 58926ab073974e2c8b725d5061a544d5 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:17.998591 9435 tablet_bootstrap.cc:492] T 46bd8e49fff5473f8787742f6023ddbe P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:18.000093 10527 raft_consensus.cc:493] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.000255 10527 raft_consensus.cc:515] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.000861 10527 leader_election.cc:290] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.001978 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ebdaff1fcbe4b27b6da28f010d1af1a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:18.002542 8976 leader_election.cc:343] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.001341 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ebdaff1fcbe4b27b6da28f010d1af1a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.005434 9435 ts_tablet_manager.cc:1403] T 46bd8e49fff5473f8787742f6023ddbe P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.004s
I20251215 14:55:18.005451 9312 raft_consensus.cc:2468] T 2ebdaff1fcbe4b27b6da28f010d1af1a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:18.006068 8978 leader_election.cc:304] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.006222 9435 raft_consensus.cc:359] T 46bd8e49fff5473f8787742f6023ddbe P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.006349 10527 raft_consensus.cc:2804] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:18.006371 9435 raft_consensus.cc:385] T 46bd8e49fff5473f8787742f6023ddbe P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.006415 9435 raft_consensus.cc:740] T 46bd8e49fff5473f8787742f6023ddbe P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.006457 10527 raft_consensus.cc:493] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:18.006573 10527 raft_consensus.cc:3060] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.006631 9435 consensus_queue.cc:260] T 46bd8e49fff5473f8787742f6023ddbe P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.007073 9435 ts_tablet_manager.cc:1434] T 46bd8e49fff5473f8787742f6023ddbe P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251215 14:55:18.009328 10527 raft_consensus.cc:515] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.010581 9426 tablet_bootstrap.cc:492] T 58926ab073974e2c8b725d5061a544d5 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:18.011039 10527 leader_election.cc:290] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.011461 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ebdaff1fcbe4b27b6da28f010d1af1a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:18.011497 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ebdaff1fcbe4b27b6da28f010d1af1a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:18.011624 9312 raft_consensus.cc:3060] T 2ebdaff1fcbe4b27b6da28f010d1af1a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.011716 9426 ts_tablet_manager.cc:1403] T 58926ab073974e2c8b725d5061a544d5 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.026s user 0.007s sys 0.000s
W20251215 14:55:18.012014 8976 leader_election.cc:343] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.013530 9174 raft_consensus.cc:3060] T 79f3a7a065d243c98b465a984bd2b1f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.014231 9312 raft_consensus.cc:2468] T 2ebdaff1fcbe4b27b6da28f010d1af1a P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:18.014951 8978 leader_election.cc:304] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.015399 10616 raft_consensus.cc:2804] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:18.015556 10616 raft_consensus.cc:697] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:18.015812 10616 consensus_queue.cc:237] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.017493 9426 raft_consensus.cc:359] T 58926ab073974e2c8b725d5061a544d5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.019289 9426 raft_consensus.cc:385] T 58926ab073974e2c8b725d5061a544d5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.019650 9426 raft_consensus.cc:740] T 58926ab073974e2c8b725d5061a544d5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.021188 9426 consensus_queue.cc:260] T 58926ab073974e2c8b725d5061a544d5 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.024283 10635 consensus_queue.cc:1048] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.024505 9435 tablet_bootstrap.cc:492] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:18.028095 9435 tablet_bootstrap.cc:654] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.032163 9427 tablet_bootstrap.cc:492] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.032330 9427 ts_tablet_manager.cc:1403] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.080s user 0.005s sys 0.008s
I20251215 14:55:18.033098 9427 raft_consensus.cc:359] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.033293 9427 raft_consensus.cc:385] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.033367 9427 raft_consensus.cc:740] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.033596 9427 consensus_queue.cc:260] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.034060 9427 ts_tablet_manager.cc:1434] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:18.034339 9427 tablet_bootstrap.cc:492] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.036015 9427 tablet_bootstrap.cc:654] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.029440 10635 consensus_queue.cc:1048] T 79f3a7a065d243c98b465a984bd2b1f9 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.039198 9426 ts_tablet_manager.cc:1434] T 58926ab073974e2c8b725d5061a544d5 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.027s user 0.004s sys 0.000s
I20251215 14:55:18.045905 9426 tablet_bootstrap.cc:492] T 3c274c9002544af4947aa4ee76a705ce P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:18.054337 9427 tablet_bootstrap.cc:492] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.054497 9427 ts_tablet_manager.cc:1403] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.003s
I20251215 14:55:18.055338 9427 raft_consensus.cc:359] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.055538 9427 raft_consensus.cc:385] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.055632 9427 raft_consensus.cc:740] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.055866 9427 consensus_queue.cc:260] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.056458 9427 ts_tablet_manager.cc:1434] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:18.056739 9427 tablet_bootstrap.cc:492] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.058456 9427 tablet_bootstrap.cc:654] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.063813 10635 consensus_queue.cc:1048] T 58926ab073974e2c8b725d5061a544d5 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.064689 10443 raft_consensus.cc:493] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.073356 10443 raft_consensus.cc:515] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.064332 9426 tablet_bootstrap.cc:654] T 3c274c9002544af4947aa4ee76a705ce P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.074102 10443 leader_election.cc:290] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.074472 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4cff0ed3782446397dbae8a2da52ed7" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:18.074730 9038 raft_consensus.cc:2393] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:18.074702 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4cff0ed3782446397dbae8a2da52ed7" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.074923 9312 raft_consensus.cc:2393] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:18.075490 9115 leader_election.cc:304] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:18.075915 10443 raft_consensus.cc:3060] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.079893 10561 raft_consensus.cc:493] T 79f3a7a065d243c98b465a984bd2b1f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.080003 10561 raft_consensus.cc:515] T 79f3a7a065d243c98b465a984bd2b1f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.080602 10561 leader_election.cc:290] T 79f3a7a065d243c98b465a984bd2b1f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.081298 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79f3a7a065d243c98b465a984bd2b1f9" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:18.083691 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79f3a7a065d243c98b465a984bd2b1f9" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.084240 9115 leader_election.cc:304] T 79f3a7a065d243c98b465a984bd2b1f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:18.086895 10443 raft_consensus.cc:2749] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:18.092231 9172 raft_consensus.cc:3060] T 034fec793ae74fcda0c73f1cea291311 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:18.101019 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
I20251215 14:55:18.109869 10600 raft_consensus.cc:493] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.110040 10600 raft_consensus.cc:515] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.110608 10600 leader_election.cc:290] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.111141 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a93d01ea31a64dc2a8d8b03884675024" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.111305 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a93d01ea31a64dc2a8d8b03884675024" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:18.111363 9312 raft_consensus.cc:2468] T a93d01ea31a64dc2a8d8b03884675024 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:18.113729 10559 raft_consensus.cc:2749] T 79f3a7a065d243c98b465a984bd2b1f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 14:55:18.114827 9435 tablet_bootstrap.cc:492] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:18.114969 9435 ts_tablet_manager.cc:1403] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.091s user 0.006s sys 0.000s
I20251215 14:55:18.115713 9435 raft_consensus.cc:359] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.115899 9435 raft_consensus.cc:385] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.115950 9435 raft_consensus.cc:740] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.116119 9435 consensus_queue.cc:260] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.116359 8978 leader_election.cc:304] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:18.116573 9435 ts_tablet_manager.cc:1434] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20251215 14:55:18.116744 8976 leader_election.cc:343] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.116837 9435 tablet_bootstrap.cc:492] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:18.117049 10600 raft_consensus.cc:2804] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:18.117113 10600 raft_consensus.cc:493] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:18.117165 10600 raft_consensus.cc:3060] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.118898 9435 tablet_bootstrap.cc:654] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.119756 10600 raft_consensus.cc:515] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.120155 9427 tablet_bootstrap.cc:492] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.120312 9427 ts_tablet_manager.cc:1403] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.064s user 0.006s sys 0.001s
I20251215 14:55:18.120618 10600 leader_election.cc:290] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.120898 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a93d01ea31a64dc2a8d8b03884675024" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:18.121083 9312 raft_consensus.cc:3060] T a93d01ea31a64dc2a8d8b03884675024 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.121618 9427 raft_consensus.cc:359] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.121749 9427 raft_consensus.cc:385] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.121793 9427 raft_consensus.cc:740] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.121949 9427 consensus_queue.cc:260] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.123521 9312 raft_consensus.cc:2468] T a93d01ea31a64dc2a8d8b03884675024 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:18.123862 9427 ts_tablet_manager.cc:1434] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:18.124301 9427 tablet_bootstrap.cc:492] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.124372 8978 leader_election.cc:304] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:18.124625 10600 raft_consensus.cc:2804] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:18.124749 10600 raft_consensus.cc:697] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:18.126434 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a93d01ea31a64dc2a8d8b03884675024" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:18.127736 10616 raft_consensus.cc:493] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.127857 10616 raft_consensus.cc:515] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:18.133780 8976 leader_election.cc:343] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.131050 10600 consensus_queue.cc:237] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.136076 9426 tablet_bootstrap.cc:492] T 3c274c9002544af4947aa4ee76a705ce P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:18.136581 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f9c173d11f1449b829a54190313bea3" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:18.137194 8976 leader_election.cc:343] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.140631 9426 ts_tablet_manager.cc:1403] T 3c274c9002544af4947aa4ee76a705ce P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.091s user 0.007s sys 0.000s
I20251215 14:55:18.142303 9426 raft_consensus.cc:359] T 3c274c9002544af4947aa4ee76a705ce P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.142482 9426 raft_consensus.cc:385] T 3c274c9002544af4947aa4ee76a705ce P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.142541 9426 raft_consensus.cc:740] T 3c274c9002544af4947aa4ee76a705ce P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.142760 9426 consensus_queue.cc:260] T 3c274c9002544af4947aa4ee76a705ce P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.143258 9426 ts_tablet_manager.cc:1434] T 3c274c9002544af4947aa4ee76a705ce P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:18.143558 9426 tablet_bootstrap.cc:492] T 682cafa003a64138a01024be2573fe34 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:18.145258 9426 tablet_bootstrap.cc:654] T 682cafa003a64138a01024be2573fe34 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.150564 10616 leader_election.cc:290] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.151087 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f9c173d11f1449b829a54190313bea3" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.152382 9435 tablet_bootstrap.cc:492] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
W20251215 14:55:18.152395 8978 leader_election.cc:343] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.152508 8978 leader_election.cc:304] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:18.152639 9435 ts_tablet_manager.cc:1403] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.036s user 0.009s sys 0.001s
I20251215 14:55:18.152962 10616 raft_consensus.cc:2749] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:18.153891 9435 raft_consensus.cc:359] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.154212 9435 raft_consensus.cc:385] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.154358 9435 raft_consensus.cc:740] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.154768 9435 consensus_queue.cc:260] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.155951 9435 ts_tablet_manager.cc:1434] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:18.159010 9435 tablet_bootstrap.cc:492] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:18.159665 9427 tablet_bootstrap.cc:654] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.162689 9435 tablet_bootstrap.cc:654] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.174196 9435 tablet_bootstrap.cc:492] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:18.174348 9435 ts_tablet_manager.cc:1403] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20251215 14:55:18.183348 9435 raft_consensus.cc:359] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.183535 9435 raft_consensus.cc:385] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.183586 9435 raft_consensus.cc:740] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.183758 9435 consensus_queue.cc:260] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.184224 9435 ts_tablet_manager.cc:1434] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20251215 14:55:18.187304 9426 tablet_bootstrap.cc:492] T 682cafa003a64138a01024be2573fe34 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:18.187449 9426 ts_tablet_manager.cc:1403] T 682cafa003a64138a01024be2573fe34 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.044s user 0.008s sys 0.000s
I20251215 14:55:18.188956 9426 raft_consensus.cc:359] T 682cafa003a64138a01024be2573fe34 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.191010 10506 raft_consensus.cc:740] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: cad1fca07ac7419cb608c21541f672f3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.195552 9435 tablet_bootstrap.cc:492] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:18.195958 10506 consensus_queue.cc:260] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 365, Last appended: 2.454, Last appended by leader: 454, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:18.196408 9172 raft_consensus.cc:3060] T 5dd36ea0aa53460f9c1fda4b31063fa7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.201433 10600 raft_consensus.cc:493] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.201581 10600 raft_consensus.cc:515] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.201895 10616 raft_consensus.cc:493] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.202013 10616 raft_consensus.cc:515] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.202175 10600 leader_election.cc:290] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.202503 10616 leader_election.cc:290] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.203714 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bc9c699d00b64239b3190e57f0f42011" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:18.204100 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c274c9002544af4947aa4ee76a705ce" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:18.204252 9174 raft_consensus.cc:2468] T 3c274c9002544af4947aa4ee76a705ce P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:18.205047 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bc9c699d00b64239b3190e57f0f42011" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.205102 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c274c9002544af4947aa4ee76a705ce" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.205266 9303 raft_consensus.cc:2468] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
W20251215 14:55:18.205564 8978 leader_election.cc:343] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.205766 8978 leader_election.cc:304] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:18.206033 8976 leader_election.cc:343] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.206131 8976 leader_election.cc:304] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:18.207034 10616 raft_consensus.cc:2804] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:18.207109 10616 raft_consensus.cc:493] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:18.207187 10616 raft_consensus.cc:3060] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.208570 9427 tablet_bootstrap.cc:492] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.209046 9427 ts_tablet_manager.cc:1403] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.085s user 0.004s sys 0.008s
I20251215 14:55:18.209679 10616 raft_consensus.cc:515] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.210654 10745 sys_catalog.cc:455] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:55:18.210877 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c274c9002544af4947aa4ee76a705ce" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:18.211073 9303 raft_consensus.cc:3060] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.211220 9427 raft_consensus.cc:359] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.211639 9427 raft_consensus.cc:385] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.212002 9427 raft_consensus.cc:740] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.213182 9427 consensus_queue.cc:260] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.214105 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c274c9002544af4947aa4ee76a705ce" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:18.214282 9174 raft_consensus.cc:3060] T 3c274c9002544af4947aa4ee76a705ce P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.214991 9303 raft_consensus.cc:2468] T 3c274c9002544af4947aa4ee76a705ce P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:18.215251 10601 raft_consensus.cc:2749] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:18.216084 8978 leader_election.cc:304] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:18.216331 10601 raft_consensus.cc:2804] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:18.216425 10601 raft_consensus.cc:697] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:18.216646 10601 consensus_queue.cc:237] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.217258 9435 tablet_bootstrap.cc:654] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.217892 10745 sys_catalog.cc:458] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: This master's current role is: FOLLOWER
I20251215 14:55:18.211988 10746 sys_catalog.cc:455] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:55:18.218071 10746 sys_catalog.cc:458] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: This master's current role is: FOLLOWER
I20251215 14:55:18.217661 10506 sys_catalog.cc:565] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: configured and running, proceeding with master startup.
I20251215 14:55:18.220481 9174 raft_consensus.cc:2468] T 3c274c9002544af4947aa4ee76a705ce P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:18.222360 10616 leader_election.cc:290] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.224525 10559 raft_consensus.cc:493] T e48a6b6dfe094c34b30b8d3a44c66435 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.224676 10559 raft_consensus.cc:515] T e48a6b6dfe094c34b30b8d3a44c66435 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.225335 10559 leader_election.cc:290] T e48a6b6dfe094c34b30b8d3a44c66435 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.226603 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e48a6b6dfe094c34b30b8d3a44c66435" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:18.226845 9034 raft_consensus.cc:2393] T e48a6b6dfe094c34b30b8d3a44c66435 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:18.227754 9426 raft_consensus.cc:385] T 682cafa003a64138a01024be2573fe34 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.227829 9426 raft_consensus.cc:740] T 682cafa003a64138a01024be2573fe34 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.228027 9426 consensus_queue.cc:260] T 682cafa003a64138a01024be2573fe34 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.228137 10448 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1f310d741d8247488792985606a1c19e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1055 } } ignore_live_leader: false dest_uuid: "cad1fca07ac7419cb608c21541f672f3" is_pre_election: true
I20251215 14:55:18.228554 9426 ts_tablet_manager.cc:1434] T 682cafa003a64138a01024be2573fe34 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.040s user 0.001s sys 0.000s
I20251215 14:55:18.228829 9426 tablet_bootstrap.cc:492] T 3af4f753a04b429a857e018f201ae6ed P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:18.228701 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e48a6b6dfe094c34b30b8d3a44c66435" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.237355 10616 raft_consensus.cc:493] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.237409 9115 leader_election.cc:304] T e48a6b6dfe094c34b30b8d3a44c66435 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:18.237681 10616 raft_consensus.cc:515] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.237883 10559 raft_consensus.cc:3060] T e48a6b6dfe094c34b30b8d3a44c66435 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.238793 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4ec165149a74778aee1fb39c4d96871" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:18.239298 8976 leader_election.cc:343] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.240056 10616 leader_election.cc:290] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.240167 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4ec165149a74778aee1fb39c4d96871" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.240397 9312 raft_consensus.cc:2468] T f4ec165149a74778aee1fb39c4d96871 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:18.241385 8978 leader_election.cc:304] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.243364 10559 raft_consensus.cc:2749] T e48a6b6dfe094c34b30b8d3a44c66435 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:18.217339 9427 ts_tablet_manager.cc:1434] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20251215 14:55:18.245254 10527 raft_consensus.cc:2804] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:18.245335 10527 raft_consensus.cc:493] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:18.245394 10527 raft_consensus.cc:3060] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.246078 9427 tablet_bootstrap.cc:492] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.247815 10527 raft_consensus.cc:515] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.248399 10527 leader_election.cc:290] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.250131 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4ec165149a74778aee1fb39c4d96871" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:18.250334 9312 raft_consensus.cc:3060] T f4ec165149a74778aee1fb39c4d96871 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.250447 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4ec165149a74778aee1fb39c4d96871" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:18.251034 8976 leader_election.cc:343] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.252990 9312 raft_consensus.cc:2468] T f4ec165149a74778aee1fb39c4d96871 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:18.253448 8978 leader_election.cc:304] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.253811 10600 raft_consensus.cc:2804] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:18.253906 9427 tablet_bootstrap.cc:654] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.254135 10600 raft_consensus.cc:697] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:18.254451 10600 consensus_queue.cc:237] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.261077 9426 tablet_bootstrap.cc:654] T 3af4f753a04b429a857e018f201ae6ed P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.262698 9435 tablet_bootstrap.cc:492] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:18.262918 9435 ts_tablet_manager.cc:1403] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.069s user 0.005s sys 0.002s
I20251215 14:55:18.263733 10528 raft_consensus.cc:493] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.263886 10528 raft_consensus.cc:515] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.264572 10528 leader_election.cc:290] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:18.265017 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7fd7f0ff96c54765926c6d45ea6a20a5" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:18.265226 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7fd7f0ff96c54765926c6d45ea6a20a5" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:18.265482 9248 leader_election.cc:343] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.264321 9435 raft_consensus.cc:359] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:18.265723 9249 leader_election.cc:343] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.265775 9435 raft_consensus.cc:385] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.265918 9435 raft_consensus.cc:740] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.265828 9249 leader_election.cc:304] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:18.266325 9435 consensus_queue.cc:260] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.266721 10606 raft_consensus.cc:2749] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:18.267956 9435 ts_tablet_manager.cc:1434] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20251215 14:55:18.283028 10616 raft_consensus.cc:493] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.283331 10616 raft_consensus.cc:515] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.284257 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5830296559264b609909486aa15c9e2e" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:18.284762 8976 leader_election.cc:343] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.285194 10559 raft_consensus.cc:493] T 050260e67b924f13847b9550a91e274b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.285336 10559 raft_consensus.cc:515] T 050260e67b924f13847b9550a91e274b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.285585 10616 leader_election.cc:290] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.286195 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "050260e67b924f13847b9550a91e274b" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:18.286892 10559 leader_election.cc:290] T 050260e67b924f13847b9550a91e274b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.287484 9435 tablet_bootstrap.cc:492] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:18.287611 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "050260e67b924f13847b9550a91e274b" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.289633 9115 leader_election.cc:304] T 050260e67b924f13847b9550a91e274b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:18.290786 9435 tablet_bootstrap.cc:654] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.290946 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5830296559264b609909486aa15c9e2e" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.291111 9312 raft_consensus.cc:2468] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:18.291463 8978 leader_election.cc:304] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.291687 10756 raft_consensus.cc:2804] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:18.291750 10756 raft_consensus.cc:493] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:18.291805 10756 raft_consensus.cc:3060] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.292034 10559 raft_consensus.cc:2749] T 050260e67b924f13847b9550a91e274b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:18.294230 10756 raft_consensus.cc:515] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.295508 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5830296559264b609909486aa15c9e2e" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:18.296301 8976 leader_election.cc:343] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.296743 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5830296559264b609909486aa15c9e2e" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:18.297351 9312 raft_consensus.cc:3060] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.297465 10616 raft_consensus.cc:493] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.297585 10616 raft_consensus.cc:515] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.298466 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46bd8e49fff5473f8787742f6023ddbe" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:18.298933 8976 leader_election.cc:343] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.299762 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46bd8e49fff5473f8787742f6023ddbe" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.299615 10756 leader_election.cc:290] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.299938 9303 raft_consensus.cc:2468] T 46bd8e49fff5473f8787742f6023ddbe P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:18.300285 8978 leader_election.cc:304] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.300609 10616 leader_election.cc:290] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.300846 10616 raft_consensus.cc:2804] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:18.300904 10616 raft_consensus.cc:493] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251215 14:55:18.301036 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:18.301169 10616 raft_consensus.cc:3060] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.301874 9312 raft_consensus.cc:2468] T 5830296559264b609909486aa15c9e2e P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:18.302307 8978 leader_election.cc:304] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.302697 10527 raft_consensus.cc:2804] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:18.302799 10527 raft_consensus.cc:697] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:18.303009 10527 consensus_queue.cc:237] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.303874 10616 raft_consensus.cc:515] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.304766 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46bd8e49fff5473f8787742f6023ddbe" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:18.305254 8976 leader_election.cc:343] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.306257 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46bd8e49fff5473f8787742f6023ddbe" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:18.306430 9303 raft_consensus.cc:3060] T 46bd8e49fff5473f8787742f6023ddbe P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.309095 9303 raft_consensus.cc:2468] T 46bd8e49fff5473f8787742f6023ddbe P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:18.309428 8978 leader_election.cc:304] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.309811 10601 raft_consensus.cc:2804] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:18.309878 10616 leader_election.cc:290] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.309914 10601 raft_consensus.cc:697] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:18.310117 10601 consensus_queue.cc:237] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.311218 10528 raft_consensus.cc:493] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.311349 10528 raft_consensus.cc:515] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.311913 10528 leader_election.cc:290] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:18.312687 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6229b8bc8d3d446c944c819670b10d54" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:18.313023 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6229b8bc8d3d446c944c819670b10d54" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:18.313184 9034 raft_consensus.cc:2468] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
W20251215 14:55:18.313287 9249 leader_election.cc:343] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.313548 9248 leader_election.cc:304] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.313895 10606 raft_consensus.cc:2804] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:18.313956 10606 raft_consensus.cc:493] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:18.314007 10606 raft_consensus.cc:3060] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.316545 10606 raft_consensus.cc:515] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.317243 10606 leader_election.cc:290] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:18.318181 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6229b8bc8d3d446c944c819670b10d54" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:18.318787 9249 leader_election.cc:343] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.319849 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6229b8bc8d3d446c944c819670b10d54" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:18.320009 9034 raft_consensus.cc:3060] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.321357 9427 tablet_bootstrap.cc:492] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.321489 9427 ts_tablet_manager.cc:1403] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.076s user 0.007s sys 0.010s
I20251215 14:55:18.321905 10616 raft_consensus.cc:493] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.322019 10616 raft_consensus.cc:515] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.322219 9427 raft_consensus.cc:359] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.322371 9427 raft_consensus.cc:385] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.322417 9427 raft_consensus.cc:740] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.322504 9034 raft_consensus.cc:2468] T 6229b8bc8d3d446c944c819670b10d54 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:18.322628 9427 consensus_queue.cc:260] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.322921 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2a58a13b66641b0bdc710cf5d458689" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:18.323413 8976 leader_election.cc:343] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.323769 9248 leader_election.cc:304] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.324162 10528 raft_consensus.cc:493] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.324272 10528 raft_consensus.cc:515] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.324746 10345 raft_consensus.cc:2804] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:18.324817 10528 leader_election.cc:290] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:18.324854 10345 raft_consensus.cc:697] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:18.325073 10345 consensus_queue.cc:237] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.325621 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "396fe2752398427f840998609beba351" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:18.326030 9249 leader_election.cc:343] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.327303 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "396fe2752398427f840998609beba351" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:18.327785 9248 leader_election.cc:343] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.327885 9248 leader_election.cc:304] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:18.328127 10606 raft_consensus.cc:2749] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:18.328502 10616 leader_election.cc:290] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.328929 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2a58a13b66641b0bdc710cf5d458689" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.329087 9303 raft_consensus.cc:2468] T a2a58a13b66641b0bdc710cf5d458689 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:18.329497 8978 leader_election.cc:304] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.330214 10756 raft_consensus.cc:2804] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:18.330677 10756 raft_consensus.cc:493] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:18.331594 9427 ts_tablet_manager.cc:1434] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20251215 14:55:18.331775 9088 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:18.331984 9427 tablet_bootstrap.cc:492] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.331796 10756 raft_consensus.cc:3060] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.334754 9427 tablet_bootstrap.cc:654] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.334724 10756 raft_consensus.cc:515] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.335840 10600 raft_consensus.cc:493] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.336038 10600 raft_consensus.cc:515] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.336553 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2a58a13b66641b0bdc710cf5d458689" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:18.336788 10600 leader_election.cc:290] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:18.337271 8976 leader_election.cc:343] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.337289 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30b9f793bf4232ba848f569100a747" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.337560 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30b9f793bf4232ba848f569100a747" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:18.337785 8978 leader_election.cc:343] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:18.338145 8976 leader_election.cc:343] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.338234 8976 leader_election.cc:304] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:18.340499 10600 raft_consensus.cc:2749] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:18.343318 10756 leader_election.cc:290] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.345247 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2a58a13b66641b0bdc710cf5d458689" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:18.345499 9303 raft_consensus.cc:3060] T a2a58a13b66641b0bdc710cf5d458689 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.348320 9303 raft_consensus.cc:2468] T a2a58a13b66641b0bdc710cf5d458689 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:18.348407 10559 consensus_queue.cc:1048] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.349367 8978 leader_election.cc:304] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.349577 9426 tablet_bootstrap.cc:492] T 3af4f753a04b429a857e018f201ae6ed P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:18.349709 9426 ts_tablet_manager.cc:1403] T 3af4f753a04b429a857e018f201ae6ed P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.121s user 0.002s sys 0.005s
I20251215 14:55:18.349910 10756 raft_consensus.cc:2804] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:18.350068 10756 raft_consensus.cc:697] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
W20251215 14:55:18.350355 8844 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet c276eb6ad0414bb8ae5d553ae623edac (table default.Table_d27029eebe7b40ad85ba792bad6d92c5 [id=7ec65d77d89d4e40a60b716f721e2940], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet c276eb6ad0414bb8ae5d553ae623edac consensus state has no leader
I20251215 14:55:18.350453 10756 consensus_queue.cc:237] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.350530 9426 raft_consensus.cc:359] T 3af4f753a04b429a857e018f201ae6ed P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.350700 9426 raft_consensus.cc:385] T 3af4f753a04b429a857e018f201ae6ed P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.350756 9426 raft_consensus.cc:740] T 3af4f753a04b429a857e018f201ae6ed P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.350947 9426 consensus_queue.cc:260] T 3af4f753a04b429a857e018f201ae6ed P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.351454 9426 ts_tablet_manager.cc:1434] T 3af4f753a04b429a857e018f201ae6ed P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:18.351886 9426 tablet_bootstrap.cc:492] T 21a98ce868924690b8a5715f4103c360 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:18.353698 9426 tablet_bootstrap.cc:654] T 21a98ce868924690b8a5715f4103c360 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.360980 9435 tablet_bootstrap.cc:492] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:18.361857 9435 ts_tablet_manager.cc:1403] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.075s user 0.006s sys 0.000s
I20251215 14:55:18.362273 9226 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:18.365123 9427 tablet_bootstrap.cc:492] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.365280 9427 ts_tablet_manager.cc:1403] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.002s
I20251215 14:55:18.366001 9427 raft_consensus.cc:359] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.366185 9427 raft_consensus.cc:385] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.366245 9427 raft_consensus.cc:740] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.366477 9427 consensus_queue.cc:260] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.366998 9427 ts_tablet_manager.cc:1434] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:18.368899 9426 tablet_bootstrap.cc:492] T 21a98ce868924690b8a5715f4103c360 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:18.369053 9426 ts_tablet_manager.cc:1403] T 21a98ce868924690b8a5715f4103c360 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.001s
I20251215 14:55:18.369827 9426 raft_consensus.cc:359] T 21a98ce868924690b8a5715f4103c360 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.370010 9426 raft_consensus.cc:385] T 21a98ce868924690b8a5715f4103c360 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.370066 9426 raft_consensus.cc:740] T 21a98ce868924690b8a5715f4103c360 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.370363 9426 consensus_queue.cc:260] T 21a98ce868924690b8a5715f4103c360 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.370940 9426 ts_tablet_manager.cc:1434] T 21a98ce868924690b8a5715f4103c360 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:18.367110 9435 raft_consensus.cc:359] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.371313 9426 tablet_bootstrap.cc:492] T 123361ef48714d859ee5ac85c3c37d08 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:18.371817 9435 raft_consensus.cc:385] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.372757 9435 raft_consensus.cc:740] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.374269 9435 consensus_queue.cc:260] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.376734 9435 ts_tablet_manager.cc:1434] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20251215 14:55:18.377182 9435 tablet_bootstrap.cc:492] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:18.384449 9426 tablet_bootstrap.cc:654] T 123361ef48714d859ee5ac85c3c37d08 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.391372 9426 tablet_bootstrap.cc:492] T 123361ef48714d859ee5ac85c3c37d08 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:18.391530 9426 ts_tablet_manager.cc:1403] T 123361ef48714d859ee5ac85c3c37d08 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20251215 14:55:18.392033 9427 tablet_bootstrap.cc:492] T 745482d5b350403c97621609e6935340 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.392091 10600 consensus_queue.cc:1048] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.392706 9426 raft_consensus.cc:359] T 123361ef48714d859ee5ac85c3c37d08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.392879 9426 raft_consensus.cc:385] T 123361ef48714d859ee5ac85c3c37d08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.392937 9426 raft_consensus.cc:740] T 123361ef48714d859ee5ac85c3c37d08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.393122 9426 consensus_queue.cc:260] T 123361ef48714d859ee5ac85c3c37d08 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.393580 9426 ts_tablet_manager.cc:1434] T 123361ef48714d859ee5ac85c3c37d08 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:18.394305 9435 tablet_bootstrap.cc:654] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.395444 9427 tablet_bootstrap.cc:654] T 745482d5b350403c97621609e6935340 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.395632 9178 raft_consensus.cc:3060] T 682cafa003a64138a01024be2573fe34 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.403208 10345 consensus_queue.cc:1048] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.406184 9427 tablet_bootstrap.cc:492] T 745482d5b350403c97621609e6935340 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.406337 9427 ts_tablet_manager.cc:1403] T 745482d5b350403c97621609e6935340 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.001s
I20251215 14:55:18.407043 9427 raft_consensus.cc:359] T 745482d5b350403c97621609e6935340 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.407232 9427 raft_consensus.cc:385] T 745482d5b350403c97621609e6935340 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.407289 9427 raft_consensus.cc:740] T 745482d5b350403c97621609e6935340 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.407490 9427 consensus_queue.cc:260] T 745482d5b350403c97621609e6935340 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.407969 9427 ts_tablet_manager.cc:1434] T 745482d5b350403c97621609e6935340 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:18.408667 9427 tablet_bootstrap.cc:492] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.410002 9427 tablet_bootstrap.cc:654] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.411972 10345 consensus_queue.cc:1048] T 682cafa003a64138a01024be2573fe34 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.417466 9427 tablet_bootstrap.cc:492] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.417603 9427 ts_tablet_manager.cc:1403] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.002s
I20251215 14:55:18.418213 9427 raft_consensus.cc:359] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.418368 9427 raft_consensus.cc:385] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.418417 9427 raft_consensus.cc:740] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.419100 9427 consensus_queue.cc:260] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.420220 9427 ts_tablet_manager.cc:1434] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:18.421497 9435 tablet_bootstrap.cc:492] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:18.421710 9435 ts_tablet_manager.cc:1403] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.004s
I20251215 14:55:18.423084 9435 raft_consensus.cc:359] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.423406 9435 raft_consensus.cc:385] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.423527 9435 raft_consensus.cc:740] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.423864 9435 consensus_queue.cc:260] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.424786 9435 ts_tablet_manager.cc:1434] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:18.425406 9427 tablet_bootstrap.cc:492] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.426930 9427 tablet_bootstrap.cc:654] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.427217 9435 tablet_bootstrap.cc:492] T e9353aff4c0742c191b37d3a412ed411 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:18.433851 10601 consensus_queue.cc:1048] T 15b8a2a337e54321afd67f7562c412a0 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.435098 9435 tablet_bootstrap.cc:654] T e9353aff4c0742c191b37d3a412ed411 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.435657 9427 tablet_bootstrap.cc:492] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.435813 9427 ts_tablet_manager.cc:1403] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.002s
I20251215 14:55:18.436616 9427 raft_consensus.cc:359] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.436796 9427 raft_consensus.cc:385] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.436851 9427 raft_consensus.cc:740] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.437057 9427 consensus_queue.cc:260] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.439584 9427 ts_tablet_manager.cc:1434] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:18.439882 9427 tablet_bootstrap.cc:492] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.440743 9174 raft_consensus.cc:3060] T 050260e67b924f13847b9550a91e274b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.442960 10601 raft_consensus.cc:493] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.443077 10601 raft_consensus.cc:515] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.443462 9427 tablet_bootstrap.cc:654] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.443648 10601 leader_election.cc:290] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.445230 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4203c4941184a66956ec9be8d703bb6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:18.446317 10600 consensus_queue.cc:1048] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:18.446481 8976 leader_election.cc:343] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.446836 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4203c4941184a66956ec9be8d703bb6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.447009 9315 raft_consensus.cc:2468] T f4203c4941184a66956ec9be8d703bb6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:18.447507 8978 leader_election.cc:304] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.447746 10600 raft_consensus.cc:2804] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:18.447816 10600 raft_consensus.cc:493] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:18.447875 10600 raft_consensus.cc:3060] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.449712 9179 raft_consensus.cc:3060] T 3c6cfff573434fbcb18feaf6a8e6a153 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.450354 10600 raft_consensus.cc:515] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.451063 10600 leader_election.cc:290] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.451592 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4203c4941184a66956ec9be8d703bb6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:18.452086 8976 leader_election.cc:343] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:18.455262 9249 consensus_peers.cc:597] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:18.455708 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4203c4941184a66956ec9be8d703bb6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:18.455849 9315 raft_consensus.cc:3060] T f4203c4941184a66956ec9be8d703bb6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.456704 9435 tablet_bootstrap.cc:492] T e9353aff4c0742c191b37d3a412ed411 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:18.456766 9427 tablet_bootstrap.cc:492] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.456866 9427 ts_tablet_manager.cc:1403] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.001s
I20251215 14:55:18.456890 9435 ts_tablet_manager.cc:1403] T e9353aff4c0742c191b37d3a412ed411 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.030s user 0.005s sys 0.004s
I20251215 14:55:18.457650 9427 raft_consensus.cc:359] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.457790 9427 raft_consensus.cc:385] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.457839 9427 raft_consensus.cc:740] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.458006 9427 consensus_queue.cc:260] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.458065 9435 raft_consensus.cc:359] T e9353aff4c0742c191b37d3a412ed411 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.458269 9435 raft_consensus.cc:385] T e9353aff4c0742c191b37d3a412ed411 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.458348 9435 raft_consensus.cc:740] T e9353aff4c0742c191b37d3a412ed411 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.458568 9427 ts_tablet_manager.cc:1434] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:18.458815 9427 tablet_bootstrap.cc:492] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.458688 9435 consensus_queue.cc:260] T e9353aff4c0742c191b37d3a412ed411 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.459482 9435 ts_tablet_manager.cc:1434] T e9353aff4c0742c191b37d3a412ed411 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:18.459932 9435 tablet_bootstrap.cc:492] T 56f600c59b094e4f96acec978911a8a7 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:18.460935 9427 tablet_bootstrap.cc:654] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.462633 9435 tablet_bootstrap.cc:654] T 56f600c59b094e4f96acec978911a8a7 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.464263 9315 raft_consensus.cc:2468] T f4203c4941184a66956ec9be8d703bb6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:18.465456 10601 consensus_queue.cc:1048] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.469406 9427 tablet_bootstrap.cc:492] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.469537 9427 ts_tablet_manager.cc:1403] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.006s
I20251215 14:55:18.470256 9427 raft_consensus.cc:359] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:18.470418 9427 raft_consensus.cc:385] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.470471 9427 raft_consensus.cc:740] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.470651 9427 consensus_queue.cc:260] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:18.471114 9427 ts_tablet_manager.cc:1434] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:18.471405 9427 tablet_bootstrap.cc:492] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.472152 10606 consensus_queue.cc:1048] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.473022 9427 tablet_bootstrap.cc:654] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.476497 8978 leader_election.cc:304] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.476976 10601 raft_consensus.cc:2804] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:18.477108 10601 raft_consensus.cc:697] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:18.477329 10601 consensus_queue.cc:237] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.479231 10559 raft_consensus.cc:493] T 21a98ce868924690b8a5715f4103c360 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.479370 10559 raft_consensus.cc:515] T 21a98ce868924690b8a5715f4103c360 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.479940 10559 leader_election.cc:290] T 21a98ce868924690b8a5715f4103c360 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.480648 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "21a98ce868924690b8a5715f4103c360" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.481734 10606 consensus_queue.cc:1048] T 35ade4502ed7497a82b362d38c65244a P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.482010 9427 tablet_bootstrap.cc:492] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.482138 9427 ts_tablet_manager.cc:1403] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.008s
I20251215 14:55:18.482817 9427 raft_consensus.cc:359] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.482975 9427 raft_consensus.cc:385] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.483028 9427 raft_consensus.cc:740] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.483237 9427 consensus_queue.cc:260] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.483590 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "21a98ce868924690b8a5715f4103c360" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:18.484033 9112 leader_election.cc:304] T 21a98ce868924690b8a5715f4103c360 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:18.484158 9427 ts_tablet_manager.cc:1434] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:18.484432 9427 tablet_bootstrap.cc:492] T c4660d4e5cb84f3a983922c0b4aef90b P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.484615 10559 raft_consensus.cc:2749] T 21a98ce868924690b8a5715f4103c360 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:18.486150 9427 tablet_bootstrap.cc:654] T c4660d4e5cb84f3a983922c0b4aef90b P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.493462 9427 tablet_bootstrap.cc:492] T c4660d4e5cb84f3a983922c0b4aef90b P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.493904 9427 ts_tablet_manager.cc:1403] T c4660d4e5cb84f3a983922c0b4aef90b P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.001s
I20251215 14:55:18.495764 9427 raft_consensus.cc:359] T c4660d4e5cb84f3a983922c0b4aef90b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.496160 9427 raft_consensus.cc:385] T c4660d4e5cb84f3a983922c0b4aef90b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.496284 9427 raft_consensus.cc:740] T c4660d4e5cb84f3a983922c0b4aef90b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.496662 9427 consensus_queue.cc:260] T c4660d4e5cb84f3a983922c0b4aef90b P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.497895 9427 ts_tablet_manager.cc:1434] T c4660d4e5cb84f3a983922c0b4aef90b P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20251215 14:55:18.498855 9427 tablet_bootstrap.cc:492] T 14ac26b3a02449f8a7588151abe7ae10 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.502509 9427 tablet_bootstrap.cc:654] T 14ac26b3a02449f8a7588151abe7ae10 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.507445 10559 raft_consensus.cc:493] T 123361ef48714d859ee5ac85c3c37d08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.507624 10559 raft_consensus.cc:515] T 123361ef48714d859ee5ac85c3c37d08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.508778 10559 leader_election.cc:290] T 123361ef48714d859ee5ac85c3c37d08 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.509367 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "123361ef48714d859ee5ac85c3c37d08" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:18.509604 9040 raft_consensus.cc:2393] T 123361ef48714d859ee5ac85c3c37d08 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:18.510270 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "123361ef48714d859ee5ac85c3c37d08" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.510813 9115 leader_election.cc:304] T 123361ef48714d859ee5ac85c3c37d08 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:18.511411 10559 raft_consensus.cc:3060] T 123361ef48714d859ee5ac85c3c37d08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.514977 10559 raft_consensus.cc:2749] T 123361ef48714d859ee5ac85c3c37d08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:18.516685 9174 raft_consensus.cc:3060] T 21a98ce868924690b8a5715f4103c360 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.523029 10528 raft_consensus.cc:493] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.523244 10528 raft_consensus.cc:515] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.523886 10528 leader_election.cc:290] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:18.524843 9435 tablet_bootstrap.cc:492] T 56f600c59b094e4f96acec978911a8a7 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:18.525071 9435 ts_tablet_manager.cc:1403] T 56f600c59b094e4f96acec978911a8a7 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.065s user 0.030s sys 0.021s
I20251215 14:55:18.525231 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f9c173d11f1449b829a54190313bea3" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:18.526062 9249 leader_election.cc:343] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.526736 9435 raft_consensus.cc:359] T 56f600c59b094e4f96acec978911a8a7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.527076 9435 raft_consensus.cc:385] T 56f600c59b094e4f96acec978911a8a7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.527308 9435 raft_consensus.cc:740] T 56f600c59b094e4f96acec978911a8a7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.528152 9426 tablet_bootstrap.cc:492] T 9beef04f876d40d89dac5970ac6828e9 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:18.530097 10600 consensus_queue.cc:1048] T 21a98ce868924690b8a5715f4103c360 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.530341 9426 tablet_bootstrap.cc:654] T 9beef04f876d40d89dac5970ac6828e9 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.536042 9175 raft_consensus.cc:3060] T 3af4f753a04b429a857e018f201ae6ed P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.542445 10600 consensus_queue.cc:1048] T 3af4f753a04b429a857e018f201ae6ed P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.534340 9971 consensus_queue.cc:1048] T 804ad50f38314be3bf9e118eee9fe748 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20251215 14:55:18.527778 9435 consensus_queue.cc:260] T 56f600c59b094e4f96acec978911a8a7 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.550657 10600 raft_consensus.cc:493] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.550845 10600 raft_consensus.cc:515] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.551522 10600 leader_election.cc:290] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.551934 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9353aff4c0742c191b37d3a412ed411" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:18.551683 9435 ts_tablet_manager.cc:1434] T 56f600c59b094e4f96acec978911a8a7 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.026s user 0.003s sys 0.000s
W20251215 14:55:18.552521 8976 leader_election.cc:343] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.553759 9435 tablet_bootstrap.cc:492] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:18.560539 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9353aff4c0742c191b37d3a412ed411" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.560774 9315 raft_consensus.cc:2468] T e9353aff4c0742c191b37d3a412ed411 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:18.567214 9427 tablet_bootstrap.cc:492] T 14ac26b3a02449f8a7588151abe7ae10 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.567365 9427 ts_tablet_manager.cc:1403] T 14ac26b3a02449f8a7588151abe7ae10 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.069s user 0.020s sys 0.028s
I20251215 14:55:18.567917 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f9c173d11f1449b829a54190313bea3" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:18.568162 9034 raft_consensus.cc:2468] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:18.568133 9427 raft_consensus.cc:359] T 14ac26b3a02449f8a7588151abe7ae10 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.568315 9427 raft_consensus.cc:385] T 14ac26b3a02449f8a7588151abe7ae10 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.568374 9427 raft_consensus.cc:740] T 14ac26b3a02449f8a7588151abe7ae10 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.568557 9427 consensus_queue.cc:260] T 14ac26b3a02449f8a7588151abe7ae10 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.569025 9427 ts_tablet_manager.cc:1434] T 14ac26b3a02449f8a7588151abe7ae10 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:18.569283 9427 tablet_bootstrap.cc:492] T 1cb23f66c1b94751a9557e8b426dd434 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.570873 9427 tablet_bootstrap.cc:654] T 1cb23f66c1b94751a9557e8b426dd434 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.572567 9426 tablet_bootstrap.cc:492] T 9beef04f876d40d89dac5970ac6828e9 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:18.572814 9426 ts_tablet_manager.cc:1403] T 9beef04f876d40d89dac5970ac6828e9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.045s user 0.006s sys 0.004s
I20251215 14:55:18.573920 8978 leader_election.cc:304] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.574204 9426 raft_consensus.cc:359] T 9beef04f876d40d89dac5970ac6828e9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.574493 9426 raft_consensus.cc:385] T 9beef04f876d40d89dac5970ac6828e9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.574605 9426 raft_consensus.cc:740] T 9beef04f876d40d89dac5970ac6828e9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.574954 9426 consensus_queue.cc:260] T 9beef04f876d40d89dac5970ac6828e9 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.575896 9426 ts_tablet_manager.cc:1434] T 9beef04f876d40d89dac5970ac6828e9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20251215 14:55:18.576869 9248 leader_election.cc:304] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.577440 10345 raft_consensus.cc:2804] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:18.577526 10345 raft_consensus.cc:493] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:18.577584 10345 raft_consensus.cc:3060] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.578573 9427 tablet_bootstrap.cc:492] T 1cb23f66c1b94751a9557e8b426dd434 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.578685 9427 ts_tablet_manager.cc:1403] T 1cb23f66c1b94751a9557e8b426dd434 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20251215 14:55:18.579463 9427 raft_consensus.cc:359] T 1cb23f66c1b94751a9557e8b426dd434 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.579641 9427 raft_consensus.cc:385] T 1cb23f66c1b94751a9557e8b426dd434 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.579695 9427 raft_consensus.cc:740] T 1cb23f66c1b94751a9557e8b426dd434 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.579902 9427 consensus_queue.cc:260] T 1cb23f66c1b94751a9557e8b426dd434 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.580406 9427 ts_tablet_manager.cc:1434] T 1cb23f66c1b94751a9557e8b426dd434 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:18.580691 9427 tablet_bootstrap.cc:492] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.581135 9435 tablet_bootstrap.cc:654] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.581296 9426 tablet_bootstrap.cc:492] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:18.582404 9427 tablet_bootstrap.cc:654] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.585588 9427 tablet_bootstrap.cc:492] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.585728 9427 ts_tablet_manager.cc:1403] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s
I20251215 14:55:18.587620 9177 raft_consensus.cc:3060] T 9beef04f876d40d89dac5970ac6828e9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.587867 9426 tablet_bootstrap.cc:654] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.590798 10600 consensus_queue.cc:1048] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.591087 9427 raft_consensus.cc:359] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.591262 9427 raft_consensus.cc:385] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.591320 9427 raft_consensus.cc:740] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.591676 9427 consensus_queue.cc:260] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.595955 10601 raft_consensus.cc:2804] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20251215 14:55:18.595981 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:18.596171 10601 raft_consensus.cc:493] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:18.596331 10601 raft_consensus.cc:3060] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.598912 10601 raft_consensus.cc:515] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.599941 10601 leader_election.cc:290] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.599407 9427 ts_tablet_manager.cc:1434] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.014s user 0.002s sys 0.000s
I20251215 14:55:18.600370 9427 tablet_bootstrap.cc:492] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.601024 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9353aff4c0742c191b37d3a412ed411" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:18.601538 8976 leader_election.cc:343] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.601965 9427 tablet_bootstrap.cc:654] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.602962 9971 consensus_queue.cc:1048] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.605665 10443 raft_consensus.cc:493] T 78b3f18a62d544b38a0682bf3bc00977 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.605801 10443 raft_consensus.cc:515] T 78b3f18a62d544b38a0682bf3bc00977 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.606382 10443 leader_election.cc:290] T 78b3f18a62d544b38a0682bf3bc00977 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.607436 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78b3f18a62d544b38a0682bf3bc00977" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.608374 9426 tablet_bootstrap.cc:492] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:18.608589 9426 ts_tablet_manager.cc:1403] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.003s
I20251215 14:55:18.610280 9426 raft_consensus.cc:359] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.610543 9426 raft_consensus.cc:385] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.610656 9426 raft_consensus.cc:740] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.610962 9426 consensus_queue.cc:260] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.611864 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78b3f18a62d544b38a0682bf3bc00977" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:18.612360 9112 leader_election.cc:304] T 78b3f18a62d544b38a0682bf3bc00977 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:18.612807 10443 raft_consensus.cc:2749] T 78b3f18a62d544b38a0682bf3bc00977 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:18.615274 9435 tablet_bootstrap.cc:492] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:18.615490 9435 ts_tablet_manager.cc:1403] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.000s
I20251215 14:55:18.616951 9435 raft_consensus.cc:359] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.617291 9435 raft_consensus.cc:385] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.617400 9435 raft_consensus.cc:740] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.617758 9435 consensus_queue.cc:260] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.618611 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9353aff4c0742c191b37d3a412ed411" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:18.618806 9303 raft_consensus.cc:3060] T e9353aff4c0742c191b37d3a412ed411 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.619573 9435 ts_tablet_manager.cc:1434] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:18.620580 9435 tablet_bootstrap.cc:492] T 07fafc0eab704e42a793eeb32ac9a7d6 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:18.623713 9435 tablet_bootstrap.cc:654] T 07fafc0eab704e42a793eeb32ac9a7d6 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.625398 9426 ts_tablet_manager.cc:1434] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.017s user 0.002s sys 0.000s
I20251215 14:55:18.626057 9426 tablet_bootstrap.cc:492] T 5830296559264b609909486aa15c9e2e P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:18.627717 10527 consensus_queue.cc:1048] T 9beef04f876d40d89dac5970ac6828e9 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.628644 10712 mvcc.cc:204] Tried to move back new op lower bound from 7232759842533998592 to 7232759833039970304. Current Snapshot: MvccSnapshot[applied={T|T < 7232759842533998592 or (T in {7232759842533998592})}]
I20251215 14:55:18.628762 10345 raft_consensus.cc:515] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.631946 10345 leader_election.cc:290] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:18.634676 9303 raft_consensus.cc:2468] T e9353aff4c0742c191b37d3a412ed411 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:18.636215 9435 tablet_bootstrap.cc:492] T 07fafc0eab704e42a793eeb32ac9a7d6 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:18.636487 9435 ts_tablet_manager.cc:1403] T 07fafc0eab704e42a793eeb32ac9a7d6 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.001s
I20251215 14:55:18.637820 9435 raft_consensus.cc:359] T 07fafc0eab704e42a793eeb32ac9a7d6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.638092 9426 tablet_bootstrap.cc:654] T 5830296559264b609909486aa15c9e2e P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.638222 9435 raft_consensus.cc:385] T 07fafc0eab704e42a793eeb32ac9a7d6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.638384 9435 raft_consensus.cc:740] T 07fafc0eab704e42a793eeb32ac9a7d6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.638865 9971 consensus_queue.cc:1048] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.640142 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f9c173d11f1449b829a54190313bea3" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:18.638783 9435 consensus_queue.cc:260] T 07fafc0eab704e42a793eeb32ac9a7d6 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:18.640789 9249 leader_election.cc:343] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.640972 9435 ts_tablet_manager.cc:1434] T 07fafc0eab704e42a793eeb32ac9a7d6 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:18.641402 9435 tablet_bootstrap.cc:492] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:18.644173 9435 tablet_bootstrap.cc:654] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.646119 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f9c173d11f1449b829a54190313bea3" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:18.646301 9038 raft_consensus.cc:3060] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.652396 9426 tablet_bootstrap.cc:492] T 5830296559264b609909486aa15c9e2e P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:18.652534 9426 ts_tablet_manager.cc:1403] T 5830296559264b609909486aa15c9e2e P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.003s
I20251215 14:55:18.653373 9426 raft_consensus.cc:359] T 5830296559264b609909486aa15c9e2e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.653527 9426 raft_consensus.cc:385] T 5830296559264b609909486aa15c9e2e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.653582 9426 raft_consensus.cc:740] T 5830296559264b609909486aa15c9e2e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.653769 9426 consensus_queue.cc:260] T 5830296559264b609909486aa15c9e2e P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.654242 9426 ts_tablet_manager.cc:1434] T 5830296559264b609909486aa15c9e2e P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:18.654503 9426 tablet_bootstrap.cc:492] T 804ad50f38314be3bf9e118eee9fe748 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:18.655998 8978 leader_election.cc:304] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.656098 9426 tablet_bootstrap.cc:654] T 804ad50f38314be3bf9e118eee9fe748 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.656867 10600 raft_consensus.cc:2804] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:18.657207 10600 raft_consensus.cc:697] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:18.657490 10600 consensus_queue.cc:237] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.663664 9427 tablet_bootstrap.cc:492] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.663813 9427 ts_tablet_manager.cc:1403] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.064s user 0.012s sys 0.011s
I20251215 14:55:18.664618 9427 raft_consensus.cc:359] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.664773 9427 raft_consensus.cc:385] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.664819 9427 raft_consensus.cc:740] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.665700 9038 raft_consensus.cc:2468] T 7f9c173d11f1449b829a54190313bea3 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:18.668706 9427 consensus_queue.cc:260] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.669314 9427 ts_tablet_manager.cc:1434] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20251215 14:55:18.669603 9427 tablet_bootstrap.cc:492] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.671321 9427 tablet_bootstrap.cc:654] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.674861 10528 raft_consensus.cc:493] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.675026 10528 raft_consensus.cc:515] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.675727 10528 leader_election.cc:290] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:18.681249 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4660d4e5cb84f3a983922c0b4aef90b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:18.681492 9038 raft_consensus.cc:2468] T c4660d4e5cb84f3a983922c0b4aef90b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:18.676863 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4660d4e5cb84f3a983922c0b4aef90b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:18.688014 9249 leader_election.cc:343] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.667152 9175 raft_consensus.cc:3060] T 78b3f18a62d544b38a0682bf3bc00977 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:18.692723 9249 consensus_peers.cc:597] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:18.696697 9248 leader_election.cc:304] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.696817 9180 raft_consensus.cc:3060] T 66f2c74e55f04a6fa4b2c238c0a6b901 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.697190 9971 raft_consensus.cc:2804] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:18.697309 9971 raft_consensus.cc:697] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:18.697537 9971 consensus_queue.cc:237] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.700766 9971 consensus_queue.cc:1048] T 66f2c74e55f04a6fa4b2c238c0a6b901 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.701011 9427 tablet_bootstrap.cc:492] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.701160 9427 ts_tablet_manager.cc:1403] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.003s
I20251215 14:55:18.701882 9427 raft_consensus.cc:359] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.702042 9427 raft_consensus.cc:385] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.702087 9427 raft_consensus.cc:740] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.702268 9427 consensus_queue.cc:260] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.702724 9427 ts_tablet_manager.cc:1434] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:18.702979 9427 tablet_bootstrap.cc:492] T a7cb14a555914e25a50d98d13267c296 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.704814 9427 tablet_bootstrap.cc:654] T a7cb14a555914e25a50d98d13267c296 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.708263 9248 leader_election.cc:304] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.708599 9971 raft_consensus.cc:2804] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:18.708762 10528 consensus_queue.cc:1048] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.709494 9971 raft_consensus.cc:493] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:18.709698 9971 raft_consensus.cc:3060] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.710942 9427 tablet_bootstrap.cc:492] T a7cb14a555914e25a50d98d13267c296 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.711104 9427 ts_tablet_manager.cc:1403] T a7cb14a555914e25a50d98d13267c296 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.001s
I20251215 14:55:18.714478 9427 raft_consensus.cc:359] T a7cb14a555914e25a50d98d13267c296 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.714676 9427 raft_consensus.cc:385] T a7cb14a555914e25a50d98d13267c296 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.714740 9427 raft_consensus.cc:740] T a7cb14a555914e25a50d98d13267c296 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.714951 9427 consensus_queue.cc:260] T a7cb14a555914e25a50d98d13267c296 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.715544 9427 ts_tablet_manager.cc:1434] T a7cb14a555914e25a50d98d13267c296 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:18.715854 9427 tablet_bootstrap.cc:492] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.717730 9427 tablet_bootstrap.cc:654] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.718269 9971 raft_consensus.cc:515] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.721180 9971 leader_election.cc:290] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:18.723062 9427 tablet_bootstrap.cc:492] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.723232 9427 ts_tablet_manager.cc:1403] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20251215 14:55:18.728474 10527 raft_consensus.cc:493] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.728672 10527 raft_consensus.cc:515] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.732508 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4660d4e5cb84f3a983922c0b4aef90b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:18.732709 9038 raft_consensus.cc:3060] T c4660d4e5cb84f3a983922c0b4aef90b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.733070 10527 leader_election.cc:290] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.739622 10561 raft_consensus.cc:493] T fc50995f6d934b58ab5f6f6f370cb7e5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.739776 10561 raft_consensus.cc:515] T fc50995f6d934b58ab5f6f6f370cb7e5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.740442 10561 leader_election.cc:290] T fc50995f6d934b58ab5f6f6f370cb7e5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.742580 10635 consensus_queue.cc:1048] T 123361ef48714d859ee5ac85c3c37d08 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.743223 10606 consensus_queue.cc:1048] T e48a6b6dfe094c34b30b8d3a44c66435 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.748116 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "798eb606957b4cf7a737ec1636437581" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.753333 9426 tablet_bootstrap.cc:492] T 804ad50f38314be3bf9e118eee9fe748 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:18.753515 9426 ts_tablet_manager.cc:1403] T 804ad50f38314be3bf9e118eee9fe748 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.099s user 0.005s sys 0.009s
I20251215 14:55:18.754293 9426 raft_consensus.cc:359] T 804ad50f38314be3bf9e118eee9fe748 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.754505 9426 raft_consensus.cc:385] T 804ad50f38314be3bf9e118eee9fe748 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.754567 9426 raft_consensus.cc:740] T 804ad50f38314be3bf9e118eee9fe748 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.754781 9426 consensus_queue.cc:260] T 804ad50f38314be3bf9e118eee9fe748 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.755870 9426 ts_tablet_manager.cc:1434] T 804ad50f38314be3bf9e118eee9fe748 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:18.756208 9426 tablet_bootstrap.cc:492] T 6229b8bc8d3d446c944c819670b10d54 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:18.757921 9426 tablet_bootstrap.cc:654] T 6229b8bc8d3d446c944c819670b10d54 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.771653 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc50995f6d934b58ab5f6f6f370cb7e5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.773315 9426 tablet_bootstrap.cc:492] T 6229b8bc8d3d446c944c819670b10d54 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:18.773517 9426 ts_tablet_manager.cc:1403] T 6229b8bc8d3d446c944c819670b10d54 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.001s
W20251215 14:55:18.773754 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:18.774385 9426 raft_consensus.cc:359] T 6229b8bc8d3d446c944c819670b10d54 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.774595 9426 raft_consensus.cc:385] T 6229b8bc8d3d446c944c819670b10d54 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.774647 9426 raft_consensus.cc:740] T 6229b8bc8d3d446c944c819670b10d54 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.774863 9426 consensus_queue.cc:260] T 6229b8bc8d3d446c944c819670b10d54 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.775635 9426 ts_tablet_manager.cc:1434] T 6229b8bc8d3d446c944c819670b10d54 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:18.776562 9426 tablet_bootstrap.cc:492] T c4660d4e5cb84f3a983922c0b4aef90b P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:18.778239 9426 tablet_bootstrap.cc:654] T c4660d4e5cb84f3a983922c0b4aef90b P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.786437 10606 raft_consensus.cc:493] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.786662 10606 raft_consensus.cc:515] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.787360 10606 leader_election.cc:290] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:18.788372 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1cb23f66c1b94751a9557e8b426dd434" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:18.789019 9249 leader_election.cc:343] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.793162 9426 tablet_bootstrap.cc:492] T c4660d4e5cb84f3a983922c0b4aef90b P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:18.793334 9426 ts_tablet_manager.cc:1403] T c4660d4e5cb84f3a983922c0b4aef90b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20251215 14:55:18.794240 9426 raft_consensus.cc:359] T c4660d4e5cb84f3a983922c0b4aef90b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.794469 9426 raft_consensus.cc:385] T c4660d4e5cb84f3a983922c0b4aef90b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.794535 9426 raft_consensus.cc:740] T c4660d4e5cb84f3a983922c0b4aef90b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.794832 9426 consensus_queue.cc:260] T c4660d4e5cb84f3a983922c0b4aef90b P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.795470 9426 ts_tablet_manager.cc:1434] T c4660d4e5cb84f3a983922c0b4aef90b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:18.795819 9426 tablet_bootstrap.cc:492] T c8b49b3d98ef4e0988e9019fe82f8727 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:18.803643 9426 tablet_bootstrap.cc:654] T c8b49b3d98ef4e0988e9019fe82f8727 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.821138 9426 tablet_bootstrap.cc:492] T c8b49b3d98ef4e0988e9019fe82f8727 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:18.821327 9426 ts_tablet_manager.cc:1403] T c8b49b3d98ef4e0988e9019fe82f8727 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.000s
I20251215 14:55:18.822144 9426 raft_consensus.cc:359] T c8b49b3d98ef4e0988e9019fe82f8727 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.822335 9426 raft_consensus.cc:385] T c8b49b3d98ef4e0988e9019fe82f8727 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.822394 9426 raft_consensus.cc:740] T c8b49b3d98ef4e0988e9019fe82f8727 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.822635 9426 consensus_queue.cc:260] T c8b49b3d98ef4e0988e9019fe82f8727 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.823254 9426 ts_tablet_manager.cc:1434] T c8b49b3d98ef4e0988e9019fe82f8727 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:18.823565 9426 tablet_bootstrap.cc:492] T a93d01ea31a64dc2a8d8b03884675024 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:18.824409 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "798eb606957b4cf7a737ec1636437581" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:18.825543 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4660d4e5cb84f3a983922c0b4aef90b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:18.825783 9174 raft_consensus.cc:3060] T c4660d4e5cb84f3a983922c0b4aef90b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.825627 9426 tablet_bootstrap.cc:654] T a93d01ea31a64dc2a8d8b03884675024 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:18.833695 8976 leader_election.cc:343] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:18.834726 10808 log.cc:927] Time spent T 123361ef48714d859ee5ac85c3c37d08 P 67978ac4539d4b289e53f4eedd9a8156: Append to log took a long time: real 0.113s user 0.000s sys 0.000s
I20251215 14:55:18.831389 9177 raft_consensus.cc:3060] T fc50995f6d934b58ab5f6f6f370cb7e5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:18.838037 10768 log.cc:927] Time spent T 15b8a2a337e54321afd67f7562c412a0 P 3ea5306c36594ef4a62211f2bd6669a3: Append to log took a long time: real 0.102s user 0.000s sys 0.000s
W20251215 14:55:18.839272 10790 log.cc:927] Time spent T 21a98ce868924690b8a5715f4103c360 P e89303a500544272b601d7c29be802b4: Append to log took a long time: real 0.104s user 0.000s sys 0.000s
I20251215 14:55:18.843317 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc50995f6d934b58ab5f6f6f370cb7e5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:18.843541 9037 raft_consensus.cc:2393] T fc50995f6d934b58ab5f6f6f370cb7e5 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:18.847685 10601 raft_consensus.cc:493] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.847815 10601 raft_consensus.cc:515] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:18.848299 10601 leader_election.cc:290] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:18.848315 9038 raft_consensus.cc:2468] T c4660d4e5cb84f3a983922c0b4aef90b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:18.865855 9248 leader_election.cc:304] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:18.845302 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1cb23f66c1b94751a9557e8b426dd434" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:18.866703 9037 raft_consensus.cc:2468] T 1cb23f66c1b94751a9557e8b426dd434 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:18.867069 9248 leader_election.cc:304] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.867136 10606 raft_consensus.cc:2804] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:18.867267 10606 raft_consensus.cc:697] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:18.867517 10606 consensus_queue.cc:237] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.867883 10833 raft_consensus.cc:2804] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:18.867946 10833 raft_consensus.cc:493] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:18.868000 10833 raft_consensus.cc:3060] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.871464 10559 raft_consensus.cc:493] T 58926ab073974e2c8b725d5061a544d5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.871690 10559 raft_consensus.cc:515] T 58926ab073974e2c8b725d5061a544d5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.879282 9427 raft_consensus.cc:359] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.879472 9427 raft_consensus.cc:385] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.879521 9427 raft_consensus.cc:740] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.879712 9427 consensus_queue.cc:260] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.880182 9427 ts_tablet_manager.cc:1434] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.157s user 0.002s sys 0.000s
I20251215 14:55:18.880475 9427 tablet_bootstrap.cc:492] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.882879 9427 tablet_bootstrap.cc:654] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.903542 9971 raft_consensus.cc:493] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.903792 9971 raft_consensus.cc:515] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.904915 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "745482d5b350403c97621609e6935340" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:18.905457 9249 leader_election.cc:343] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.906051 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "745482d5b350403c97621609e6935340" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:18.906267 9034 raft_consensus.cc:2468] T 745482d5b350403c97621609e6935340 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:18.906049 10600 raft_consensus.cc:493] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.906669 10600 raft_consensus.cc:515] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.908244 10833 raft_consensus.cc:515] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.908776 10833 leader_election.cc:290] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:18.911361 10559 leader_election.cc:290] T 58926ab073974e2c8b725d5061a544d5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.912000 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58926ab073974e2c8b725d5061a544d5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:18.915503 9426 tablet_bootstrap.cc:492] T a93d01ea31a64dc2a8d8b03884675024 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:18.915648 9426 ts_tablet_manager.cc:1403] T a93d01ea31a64dc2a8d8b03884675024 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.092s user 0.011s sys 0.014s
I20251215 14:55:18.916368 9426 raft_consensus.cc:359] T a93d01ea31a64dc2a8d8b03884675024 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.916541 9426 raft_consensus.cc:385] T a93d01ea31a64dc2a8d8b03884675024 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.916589 9426 raft_consensus.cc:740] T a93d01ea31a64dc2a8d8b03884675024 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.916783 9426 consensus_queue.cc:260] T a93d01ea31a64dc2a8d8b03884675024 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.918205 9971 leader_election.cc:290] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:18.907255 10600 leader_election.cc:290] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.925138 9426 ts_tablet_manager.cc:1434] T a93d01ea31a64dc2a8d8b03884675024 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20251215 14:55:18.926102 9426 tablet_bootstrap.cc:492] T f4ec165149a74778aee1fb39c4d96871 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:18.931270 9426 tablet_bootstrap.cc:654] T f4ec165149a74778aee1fb39c4d96871 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.942026 9426 tablet_bootstrap.cc:492] T f4ec165149a74778aee1fb39c4d96871 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:18.942799 9426 ts_tablet_manager.cc:1403] T f4ec165149a74778aee1fb39c4d96871 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.001s
I20251215 14:55:18.943781 9426 raft_consensus.cc:359] T f4ec165149a74778aee1fb39c4d96871 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.948997 9427 tablet_bootstrap.cc:492] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:18.949162 9427 ts_tablet_manager.cc:1403] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.069s user 0.006s sys 0.003s
I20251215 14:55:18.949471 9426 raft_consensus.cc:385] T f4ec165149a74778aee1fb39c4d96871 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.949743 9426 raft_consensus.cc:740] T f4ec165149a74778aee1fb39c4d96871 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.949921 9427 raft_consensus.cc:359] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.950115 9427 raft_consensus.cc:385] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.950173 9427 raft_consensus.cc:740] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.950410 9427 consensus_queue.cc:260] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.950536 9426 consensus_queue.cc:260] T f4ec165149a74778aee1fb39c4d96871 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.951508 9426 ts_tablet_manager.cc:1434] T f4ec165149a74778aee1fb39c4d96871 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20251215 14:55:18.952303 9426 tablet_bootstrap.cc:492] T 56f600c59b094e4f96acec978911a8a7 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:18.952813 9249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 45635.9us
W20251215 14:55:18.956465 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 46386.8us
I20251215 14:55:18.958986 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1cb23f66c1b94751a9557e8b426dd434" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:18.960767 9426 tablet_bootstrap.cc:654] T 56f600c59b094e4f96acec978911a8a7 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:18.961748 9249 leader_election.cc:343] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:18.962661 10345 consensus_queue.cc:1048] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:18.963503 9248 leader_election.cc:304] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:18.964864 10528 raft_consensus.cc:2804] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:18.964995 10528 raft_consensus.cc:493] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:18.965132 10528 raft_consensus.cc:3060] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.967468 9426 tablet_bootstrap.cc:492] T 56f600c59b094e4f96acec978911a8a7 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:18.967599 9426 ts_tablet_manager.cc:1403] T 56f600c59b094e4f96acec978911a8a7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20251215 14:55:18.968340 9426 raft_consensus.cc:359] T 56f600c59b094e4f96acec978911a8a7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.968503 9426 raft_consensus.cc:385] T 56f600c59b094e4f96acec978911a8a7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.968559 9426 raft_consensus.cc:740] T 56f600c59b094e4f96acec978911a8a7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.968736 9426 consensus_queue.cc:260] T 56f600c59b094e4f96acec978911a8a7 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.969211 9426 ts_tablet_manager.cc:1434] T 56f600c59b094e4f96acec978911a8a7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:18.974678 10616 raft_consensus.cc:493] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.974962 10616 raft_consensus.cc:515] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.975579 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1cb23f66c1b94751a9557e8b426dd434" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:18.975654 10616 leader_election.cc:290] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.975767 9037 raft_consensus.cc:3060] T 1cb23f66c1b94751a9557e8b426dd434 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:18.976385 9427 ts_tablet_manager.cc:1434] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.027s user 0.001s sys 0.001s
I20251215 14:55:18.976565 9435 tablet_bootstrap.cc:492] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:18.976678 9435 ts_tablet_manager.cc:1403] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.335s user 0.105s sys 0.125s
I20251215 14:55:18.976728 9427 tablet_bootstrap.cc:492] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:18.977367 9435 raft_consensus.cc:359] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.977504 9435 raft_consensus.cc:385] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.977545 9435 raft_consensus.cc:740] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.977742 9435 consensus_queue.cc:260] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.978170 9435 ts_tablet_manager.cc:1434] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20251215 14:55:18.978354 9037 raft_consensus.cc:2468] T 1cb23f66c1b94751a9557e8b426dd434 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:18.978432 9435 tablet_bootstrap.cc:492] T 307f788967bd48e2b442657806e87fc4 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:18.978616 9427 tablet_bootstrap.cc:654] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.979966 9435 tablet_bootstrap.cc:654] T 307f788967bd48e2b442657806e87fc4 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:18.980713 8976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 133800us
I20251215 14:55:18.984337 10600 raft_consensus.cc:493] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:18.984519 10600 raft_consensus.cc:515] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.986008 10600 leader_election.cc:290] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:18.988132 9435 tablet_bootstrap.cc:492] T 307f788967bd48e2b442657806e87fc4 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:18.988303 9435 ts_tablet_manager.cc:1403] T 307f788967bd48e2b442657806e87fc4 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20251215 14:55:18.988327 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f600c59b094e4f96acec978911a8a7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:18.988510 9170 raft_consensus.cc:2468] T 56f600c59b094e4f96acec978911a8a7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:18.989100 9435 raft_consensus.cc:359] T 307f788967bd48e2b442657806e87fc4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.989290 9435 raft_consensus.cc:385] T 307f788967bd48e2b442657806e87fc4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:18.989343 9435 raft_consensus.cc:740] T 307f788967bd48e2b442657806e87fc4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:18.989547 9435 consensus_queue.cc:260] T 307f788967bd48e2b442657806e87fc4 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:18.990121 9435 ts_tablet_manager.cc:1434] T 307f788967bd48e2b442657806e87fc4 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:18.990439 9435 tablet_bootstrap.cc:492] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:18.991376 9426 tablet_bootstrap.cc:492] T f4203c4941184a66956ec9be8d703bb6 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:18.994691 9426 tablet_bootstrap.cc:654] T f4203c4941184a66956ec9be8d703bb6 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:18.999221 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "396fe2752398427f840998609beba351" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:19.001248 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6140a160980d49b09a5fda8475fc144f" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:19.004030 9174 raft_consensus.cc:2468] T c4660d4e5cb84f3a983922c0b4aef90b P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:19.005052 9435 tablet_bootstrap.cc:654] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.005774 9426 tablet_bootstrap.cc:492] T f4203c4941184a66956ec9be8d703bb6 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:19.005915 9426 ts_tablet_manager.cc:1403] T f4203c4941184a66956ec9be8d703bb6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20251215 14:55:19.006755 9426 raft_consensus.cc:359] T f4203c4941184a66956ec9be8d703bb6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.006973 9426 raft_consensus.cc:385] T f4203c4941184a66956ec9be8d703bb6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.007022 9426 raft_consensus.cc:740] T f4203c4941184a66956ec9be8d703bb6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.007270 9426 consensus_queue.cc:260] T f4203c4941184a66956ec9be8d703bb6 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.007771 9426 ts_tablet_manager.cc:1434] T f4203c4941184a66956ec9be8d703bb6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20251215 14:55:19.009824 8978 leader_election.cc:343] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.010051 8978 leader_election.cc:304] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:19.010578 10756 raft_consensus.cc:2749] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:19.015154 9435 tablet_bootstrap.cc:492] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:19.015377 9435 ts_tablet_manager.cc:1403] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.009s
I20251215 14:55:19.016486 9435 raft_consensus.cc:359] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.016642 9435 raft_consensus.cc:385] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.016698 9435 raft_consensus.cc:740] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.016889 9435 consensus_queue.cc:260] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.017326 9435 ts_tablet_manager.cc:1434] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:19.017575 9435 tablet_bootstrap.cc:492] T de24f0b914304135bebcdb09e9b2f2f9 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:19.019060 9435 tablet_bootstrap.cc:654] T de24f0b914304135bebcdb09e9b2f2f9 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.019546 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58926ab073974e2c8b725d5061a544d5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:19.020905 9426 tablet_bootstrap.cc:492] T 1cb23f66c1b94751a9557e8b426dd434 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:19.022956 9112 leader_election.cc:304] T fc50995f6d934b58ab5f6f6f370cb7e5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:19.023401 10559 raft_consensus.cc:2749] T fc50995f6d934b58ab5f6f6f370cb7e5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:19.024315 8976 leader_election.cc:304] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:19.024641 10527 raft_consensus.cc:2804] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:19.024739 10527 raft_consensus.cc:493] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:19.024844 10527 raft_consensus.cc:3060] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.026314 9112 leader_election.cc:304] T 58926ab073974e2c8b725d5061a544d5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:19.026503 10756 raft_consensus.cc:493] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.026639 10756 raft_consensus.cc:515] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.026923 10561 raft_consensus.cc:2749] T 58926ab073974e2c8b725d5061a544d5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:19.027266 10756 leader_election.cc:290] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.027642 10527 raft_consensus.cc:515] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.028245 9426 tablet_bootstrap.cc:654] T 1cb23f66c1b94751a9557e8b426dd434 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.028352 10527 leader_election.cc:290] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:19.028718 8976 leader_election.cc:343] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:19.029285 8976 leader_election.cc:343] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.031350 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "307f788967bd48e2b442657806e87fc4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:19.037207 9248 leader_election.cc:304] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.037556 10833 raft_consensus.cc:2804] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:19.037668 10833 raft_consensus.cc:697] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:19.039547 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de24f0b914304135bebcdb09e9b2f2f9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:19.040819 9427 tablet_bootstrap.cc:492] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:19.040990 9427 ts_tablet_manager.cc:1403] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.064s user 0.001s sys 0.009s
I20251215 14:55:19.041831 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f600c59b094e4f96acec978911a8a7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:19.041872 9427 raft_consensus.cc:359] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.042114 9427 raft_consensus.cc:385] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.042059 9174 raft_consensus.cc:3060] T 56f600c59b094e4f96acec978911a8a7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.042207 9427 raft_consensus.cc:740] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.042407 9427 consensus_queue.cc:260] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.042892 9427 ts_tablet_manager.cc:1434] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:19.043207 9427 tablet_bootstrap.cc:492] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:19.045221 9174 raft_consensus.cc:2468] T 56f600c59b094e4f96acec978911a8a7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:19.046923 10832 raft_consensus.cc:493] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.047150 10832 raft_consensus.cc:515] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.047897 10842 consensus_queue.cc:1048] T fc50995f6d934b58ab5f6f6f370cb7e5 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:19.048177 10832 leader_election.cc:290] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.037896 10833 consensus_queue.cc:237] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.048597 10635 consensus_queue.cc:1048] T c8b49b3d98ef4e0988e9019fe82f8727 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:19.050220 9427 tablet_bootstrap.cc:654] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.061568 10528 raft_consensus.cc:515] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.065153 10838 raft_consensus.cc:493] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.065265 10838 raft_consensus.cc:515] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.068411 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "745482d5b350403c97621609e6935340" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:19.068360 10838 leader_election.cc:290] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:19.069288 9249 leader_election.cc:343] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.069612 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bc9c699d00b64239b3190e57f0f42011" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:19.070117 9249 leader_election.cc:343] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.070303 10528 leader_election.cc:290] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:19.070947 10842 raft_consensus.cc:493] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.071071 10842 raft_consensus.cc:515] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.073160 10842 leader_election.cc:290] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:19.074252 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14ac26b3a02449f8a7588151abe7ae10" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:19.075073 9249 leader_election.cc:343] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.083048 9435 tablet_bootstrap.cc:492] T de24f0b914304135bebcdb09e9b2f2f9 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:19.083209 9435 ts_tablet_manager.cc:1403] T de24f0b914304135bebcdb09e9b2f2f9 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.066s user 0.004s sys 0.000s
I20251215 14:55:19.088582 9435 raft_consensus.cc:359] T de24f0b914304135bebcdb09e9b2f2f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.088765 9435 raft_consensus.cc:385] T de24f0b914304135bebcdb09e9b2f2f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.088820 9435 raft_consensus.cc:740] T de24f0b914304135bebcdb09e9b2f2f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.089010 9435 consensus_queue.cc:260] T de24f0b914304135bebcdb09e9b2f2f9 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.089484 9435 ts_tablet_manager.cc:1434] T de24f0b914304135bebcdb09e9b2f2f9 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.006s user 0.000s sys 0.000s
I20251215 14:55:19.089744 9435 tablet_bootstrap.cc:492] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:19.094640 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "396fe2752398427f840998609beba351" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.094831 9312 raft_consensus.cc:2468] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:19.095360 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "307f788967bd48e2b442657806e87fc4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.095507 9314 raft_consensus.cc:2468] T 307f788967bd48e2b442657806e87fc4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:19.096144 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f600c59b094e4f96acec978911a8a7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.096321 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de24f0b914304135bebcdb09e9b2f2f9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.096411 9308 raft_consensus.cc:2468] T 56f600c59b094e4f96acec978911a8a7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:19.096487 9314 raft_consensus.cc:2468] T de24f0b914304135bebcdb09e9b2f2f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:19.096632 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6140a160980d49b09a5fda8475fc144f" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.099531 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c902ad68a5c448828eb3ac419ffaca81" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.101045 9310 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56f600c59b094e4f96acec978911a8a7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:19.101208 9310 raft_consensus.cc:3060] T 56f600c59b094e4f96acec978911a8a7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.103878 9435 tablet_bootstrap.cc:654] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.108515 9310 raft_consensus.cc:2468] T 56f600c59b094e4f96acec978911a8a7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:19.110066 9435 tablet_bootstrap.cc:492] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:19.110239 9435 ts_tablet_manager.cc:1403] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.002s
I20251215 14:55:19.111028 9435 raft_consensus.cc:359] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.111225 9435 raft_consensus.cc:385] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.112639 9426 tablet_bootstrap.cc:492] T 1cb23f66c1b94751a9557e8b426dd434 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:19.113631 9426 ts_tablet_manager.cc:1403] T 1cb23f66c1b94751a9557e8b426dd434 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.093s user 0.002s sys 0.003s
W20251215 14:55:19.116843 8976 leader_election.cc:343] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.118091 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "745482d5b350403c97621609e6935340" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:19.118356 10527 raft_consensus.cc:493] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.118698 8978 leader_election.cc:304] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.119740 9435 raft_consensus.cc:740] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.120031 9435 consensus_queue.cc:260] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.120596 9435 ts_tablet_manager.cc:1434] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20251215 14:55:19.120957 9435 tablet_bootstrap.cc:492] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:19.122769 9435 tablet_bootstrap.cc:654] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.125898 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bc9c699d00b64239b3190e57f0f42011" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:19.127296 8976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 52996.4us
I20251215 14:55:19.127648 9037 raft_consensus.cc:3060] T 745482d5b350403c97621609e6935340 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.130308 10527 raft_consensus.cc:515] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.130999 10527 leader_election.cc:290] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.131353 8978 leader_election.cc:304] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.131933 10832 raft_consensus.cc:2804] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:19.132067 10832 raft_consensus.cc:493] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:19.132170 10832 raft_consensus.cc:3060] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.132301 8978 leader_election.cc:304] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:19.132601 10835 consensus_queue.cc:1048] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20251215 14:55:19.133524 10835 raft_consensus.cc:2804] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:19.133643 10835 raft_consensus.cc:493] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:19.133736 10835 raft_consensus.cc:3060] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.132899 9426 raft_consensus.cc:359] T 1cb23f66c1b94751a9557e8b426dd434 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.134143 9426 raft_consensus.cc:385] T 1cb23f66c1b94751a9557e8b426dd434 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.135241 10832 raft_consensus.cc:515] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.134951 9426 raft_consensus.cc:740] T 1cb23f66c1b94751a9557e8b426dd434 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.135883 10756 raft_consensus.cc:2804] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:19.137037 9426 consensus_queue.cc:260] T 1cb23f66c1b94751a9557e8b426dd434 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.139433 9039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14ac26b3a02449f8a7588151abe7ae10" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:19.139654 9038 raft_consensus.cc:2468] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:19.142241 9426 ts_tablet_manager.cc:1434] T 1cb23f66c1b94751a9557e8b426dd434 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.016s user 0.002s sys 0.002s
I20251215 14:55:19.143141 9427 tablet_bootstrap.cc:492] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:19.144791 9426 tablet_bootstrap.cc:492] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:19.145766 10756 raft_consensus.cc:493] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:19.145946 9435 tablet_bootstrap.cc:492] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:19.146098 9435 ts_tablet_manager.cc:1403] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.000s
I20251215 14:55:19.146864 9039 raft_consensus.cc:2468] T 14ac26b3a02449f8a7588151abe7ae10 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:19.146832 9435 raft_consensus.cc:359] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.147003 9435 raft_consensus.cc:385] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.147097 9435 raft_consensus.cc:740] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.147331 9435 consensus_queue.cc:260] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.147858 9435 ts_tablet_manager.cc:1434] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:19.148593 9248 leader_election.cc:304] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.149171 10635 raft_consensus.cc:2804] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:19.149302 10635 raft_consensus.cc:493] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:19.149394 10635 raft_consensus.cc:3060] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:19.152426 8976 consensus_peers.cc:597] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:19.153105 10635 raft_consensus.cc:515] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.153781 10635 leader_election.cc:290] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:19.154080 10756 raft_consensus.cc:3060] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.156085 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bc9c699d00b64239b3190e57f0f42011" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:19.153962 10832 leader_election.cc:290] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:19.156715 9249 leader_election.cc:343] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.157683 9248 leader_election.cc:304] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.158377 10635 raft_consensus.cc:2804] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:19.158468 10635 raft_consensus.cc:493] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:19.158561 10635 raft_consensus.cc:3060] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.160939 9037 raft_consensus.cc:2468] T 745482d5b350403c97621609e6935340 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:19.162478 10635 raft_consensus.cc:515] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.164036 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14ac26b3a02449f8a7588151abe7ae10" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:19.164566 9249 leader_election.cc:343] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.164762 10635 leader_election.cc:290] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:19.166633 10559 raft_consensus.cc:493] T 1cb23f66c1b94751a9557e8b426dd434 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.166698 9427 ts_tablet_manager.cc:1403] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.100s user 0.016s sys 0.023s
I20251215 14:55:19.166767 10559 raft_consensus.cc:515] T 1cb23f66c1b94751a9557e8b426dd434 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.167399 10559 leader_election.cc:290] T 1cb23f66c1b94751a9557e8b426dd434 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.168277 9310 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1cb23f66c1b94751a9557e8b426dd434" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
W20251215 14:55:19.174199 8976 leader_election.cc:343] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.174521 8976 leader_election.cc:304] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:19.175442 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c902ad68a5c448828eb3ac419ffaca81" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:19.177125 10856 raft_consensus.cc:493] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.177259 10856 raft_consensus.cc:515] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.177793 10635 raft_consensus.cc:493] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.178047 10856 leader_election.cc:290] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:19.178016 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "307f788967bd48e2b442657806e87fc4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:19.178918 10601 raft_consensus.cc:2804] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:19.179105 10601 raft_consensus.cc:697] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:19.178776 9426 tablet_bootstrap.cc:654] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.179432 10601 consensus_queue.cc:237] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.178364 10635 raft_consensus.cc:515] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.178815 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6be5f3269d9147d780f782bb5665b8b6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:19.181951 9249 leader_election.cc:343] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:19.182853 8976 leader_election.cc:343] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.183264 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "437ccec0421f4bdfb8c7e6a2fcb44bca" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:19.185997 10756 raft_consensus.cc:515] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.187068 10756 leader_election.cc:290] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.188934 10635 leader_election.cc:290] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:19.189585 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7cb14a555914e25a50d98d13267c296" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:19.190272 9249 leader_election.cc:343] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:19.190732 8976 leader_election.cc:343] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:19.191469 8976 leader_election.cc:343] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.192313 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "396fe2752398427f840998609beba351" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:19.193485 8976 leader_election.cc:343] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.198271 9427 raft_consensus.cc:359] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.198659 9427 raft_consensus.cc:385] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.198761 9427 raft_consensus.cc:740] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.199048 10835 raft_consensus.cc:515] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.199324 9427 consensus_queue.cc:260] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.200398 10835 leader_election.cc:290] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.203908 9427 ts_tablet_manager.cc:1434] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.037s user 0.000s sys 0.002s
W20251215 14:55:19.205539 8775 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 8e1a8070f9ab448088009e9a22a340f7 (table default.Table_89b4a7a3b7124af3986512c42ff0082e [id=9255b7fca6fe4f77b8e1f84ab57b097a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8e1a8070f9ab448088009e9a22a340f7 has no consensus state
I20251215 14:55:19.206143 9427 tablet_bootstrap.cc:492] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:19.207585 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de24f0b914304135bebcdb09e9b2f2f9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:19.210290 8976 leader_election.cc:343] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.211197 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bc9c699d00b64239b3190e57f0f42011" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:19.212424 9435 tablet_bootstrap.cc:492] T a1c5659fd65f40b0ab72c164afb8d3fe P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:19.213372 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14ac26b3a02449f8a7588151abe7ae10" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:19.214226 9435 tablet_bootstrap.cc:654] T a1c5659fd65f40b0ab72c164afb8d3fe P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.215852 9041 raft_consensus.cc:3060] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.216787 9248 leader_election.cc:304] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.217060 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6be5f3269d9147d780f782bb5665b8b6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:19.218632 10856 raft_consensus.cc:2804] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:19.218761 10856 raft_consensus.cc:697] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:19.218989 10856 consensus_queue.cc:237] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.219789 9427 tablet_bootstrap.cc:654] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.220448 9040 raft_consensus.cc:3060] T 14ac26b3a02449f8a7588151abe7ae10 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.220607 9171 raft_consensus.cc:3060] T 58926ab073974e2c8b725d5061a544d5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.224226 9426 tablet_bootstrap.cc:492] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:19.224629 9426 ts_tablet_manager.cc:1403] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.080s user 0.004s sys 0.004s
I20251215 14:55:19.228304 9036 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7cb14a555914e25a50d98d13267c296" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:19.228835 9175 raft_consensus.cc:3060] T a93d01ea31a64dc2a8d8b03884675024 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:19.229306 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 97049.1us
W20251215 14:55:19.229533 8978 leader_election.cc:343] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.229661 8978 leader_election.cc:304] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:19.230720 10601 raft_consensus.cc:2749] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:19.232590 10835 consensus_queue.cc:1048] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:19.233402 8978 leader_election.cc:343] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.233534 8978 leader_election.cc:304] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:19.234901 9036 raft_consensus.cc:2468] T a7cb14a555914e25a50d98d13267c296 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
W20251215 14:55:19.236829 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:19.243384 9426 raft_consensus.cc:359] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.243990 9426 raft_consensus.cc:385] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.244053 9040 raft_consensus.cc:2468] T 14ac26b3a02449f8a7588151abe7ae10 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:19.244163 9426 raft_consensus.cc:740] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.244987 9426 consensus_queue.cc:260] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.251812 9041 raft_consensus.cc:2468] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
W20251215 14:55:19.260794 9248 leader_election.cc:343] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.261770 10832 raft_consensus.cc:2749] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:19.264344 9248 leader_election.cc:304] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:19.264387 9174 raft_consensus.cc:3060] T f4ec165149a74778aee1fb39c4d96871 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.265424 10635 raft_consensus.cc:2749] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:19.268959 10601 consensus_queue.cc:1048] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:19.273351 9248 leader_election.cc:304] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.276075 10528 raft_consensus.cc:2804] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:19.276177 10528 raft_consensus.cc:493] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:19.276237 10528 raft_consensus.cc:3060] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.280462 10528 raft_consensus.cc:515] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.281607 10528 leader_election.cc:290] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:19.281704 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7cb14a555914e25a50d98d13267c296" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:19.282207 9249 leader_election.cc:343] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.283241 9177 raft_consensus.cc:3060] T 5830296559264b609909486aa15c9e2e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.287493 9248 leader_election.cc:304] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
W20251215 14:55:19.288761 8976 consensus_peers.cc:597] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:19.287202 10863 consensus_queue.cc:1048] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251215 14:55:19.290307 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1cb23f66c1b94751a9557e8b426dd434" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:19.290542 9040 raft_consensus.cc:2393] T 1cb23f66c1b94751a9557e8b426dd434 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:19.291405 9426 ts_tablet_manager.cc:1434] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.022s user 0.003s sys 0.000s
I20251215 14:55:19.292030 9426 tablet_bootstrap.cc:492] T a2a58a13b66641b0bdc710cf5d458689 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:19.292354 10827 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40747def373e4b19abfa5d21ba0a4315)
I20251215 14:55:19.292681 10746 sys_catalog.cc:455] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40747def373e4b19abfa5d21ba0a4315. Latest consensus state: current_term: 2 leader_uuid: "40747def373e4b19abfa5d21ba0a4315" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:55:19.292857 10746 sys_catalog.cc:458] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: This master's current role is: FOLLOWER
I20251215 14:55:19.292620 10827 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:19.294487 10863 raft_consensus.cc:493] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.294574 10528 raft_consensus.cc:493] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.294981 10528 raft_consensus.cc:515] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.294852 10863 raft_consensus.cc:515] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.295884 10528 leader_election.cc:290] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:19.296353 10528 raft_consensus.cc:2804] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:19.296506 10528 raft_consensus.cc:697] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:19.296530 10827 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:19.296877 10528 consensus_queue.cc:237] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.303496 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07fafc0eab704e42a793eeb32ac9a7d6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:19.304950 9248 leader_election.cc:304] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.305261 10635 raft_consensus.cc:2804] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:19.305397 10635 raft_consensus.cc:697] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:19.305678 10635 consensus_queue.cc:237] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.306842 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "798eb606957b4cf7a737ec1636437581" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:19.307303 9249 leader_election.cc:343] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.303992 9112 leader_election.cc:304] T 1cb23f66c1b94751a9557e8b426dd434 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:19.307849 10561 raft_consensus.cc:3060] T 1cb23f66c1b94751a9557e8b426dd434 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.310353 10561 raft_consensus.cc:2749] T 1cb23f66c1b94751a9557e8b426dd434 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:19.312187 8976 leader_election.cc:343] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.319749 10844 consensus_queue.cc:1048] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:19.320405 10559 raft_consensus.cc:493] T f4203c4941184a66956ec9be8d703bb6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.320550 10559 raft_consensus.cc:515] T f4203c4941184a66956ec9be8d703bb6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.322621 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4203c4941184a66956ec9be8d703bb6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:19.323127 10863 leader_election.cc:290] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.328456 10559 leader_election.cc:290] T f4203c4941184a66956ec9be8d703bb6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.329536 9310 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f4203c4941184a66956ec9be8d703bb6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.329831 9310 raft_consensus.cc:2393] T f4203c4941184a66956ec9be8d703bb6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:19.330678 9178 raft_consensus.cc:3060] T 6229b8bc8d3d446c944c819670b10d54 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.330907 9115 leader_election.cc:304] T f4203c4941184a66956ec9be8d703bb6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:19.331339 10559 raft_consensus.cc:3060] T f4203c4941184a66956ec9be8d703bb6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.333379 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a7cb14a555914e25a50d98d13267c296" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:19.333617 9040 raft_consensus.cc:3060] T a7cb14a555914e25a50d98d13267c296 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.333981 9427 tablet_bootstrap.cc:492] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:19.334129 9427 ts_tablet_manager.cc:1403] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.130s user 0.003s sys 0.008s
I20251215 14:55:19.334203 10559 raft_consensus.cc:2749] T f4203c4941184a66956ec9be8d703bb6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:19.334964 9427 raft_consensus.cc:359] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.335152 9427 raft_consensus.cc:385] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.335278 9427 raft_consensus.cc:740] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.335534 9427 consensus_queue.cc:260] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.336102 9427 ts_tablet_manager.cc:1434] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:19.336416 9427 tablet_bootstrap.cc:492] T bee9a28b78184d4893a845120670e302 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:19.336613 9435 tablet_bootstrap.cc:492] T a1c5659fd65f40b0ab72c164afb8d3fe P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:19.336762 9435 ts_tablet_manager.cc:1403] T a1c5659fd65f40b0ab72c164afb8d3fe P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.124s user 0.007s sys 0.026s
I20251215 14:55:19.336226 9040 raft_consensus.cc:2468] T a7cb14a555914e25a50d98d13267c296 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:19.337436 9435 raft_consensus.cc:359] T a1c5659fd65f40b0ab72c164afb8d3fe P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.337690 9435 raft_consensus.cc:385] T a1c5659fd65f40b0ab72c164afb8d3fe P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.337743 9435 raft_consensus.cc:740] T a1c5659fd65f40b0ab72c164afb8d3fe P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.337625 10844 consensus_queue.cc:1048] T 6229b8bc8d3d446c944c819670b10d54 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:19.337963 9435 consensus_queue.cc:260] T a1c5659fd65f40b0ab72c164afb8d3fe P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.338429 9435 ts_tablet_manager.cc:1434] T a1c5659fd65f40b0ab72c164afb8d3fe P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:19.338693 9435 tablet_bootstrap.cc:492] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:19.340687 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "798eb606957b4cf7a737ec1636437581" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:19.341187 9041 raft_consensus.cc:2468] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:19.342337 9435 tablet_bootstrap.cc:654] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.349129 10875 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20251215 14:55:19.350080 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "437ccec0421f4bdfb8c7e6a2fcb44bca" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.358409 10601 raft_consensus.cc:493] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.359635 10601 raft_consensus.cc:515] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.361508 10601 leader_election.cc:290] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.362263 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "307f788967bd48e2b442657806e87fc4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:19.362449 9315 raft_consensus.cc:3060] T 307f788967bd48e2b442657806e87fc4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.364463 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb309f7c439740c89470da5636523a69" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:19.364524 10449 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53594 (request call id 0) took 4088 ms. Trace:
W20251215 14:55:19.364977 8976 leader_election.cc:343] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.365048 9315 raft_consensus.cc:2468] T 307f788967bd48e2b442657806e87fc4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:19.365321 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "396fe2752398427f840998609beba351" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:19.365460 9306 raft_consensus.cc:3060] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.367084 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de24f0b914304135bebcdb09e9b2f2f9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:19.367269 9303 raft_consensus.cc:3060] T de24f0b914304135bebcdb09e9b2f2f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.367905 9306 raft_consensus.cc:2468] T 396fe2752398427f840998609beba351 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:19.368997 9435 tablet_bootstrap.cc:492] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:19.369122 9435 ts_tablet_manager.cc:1403] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.030s user 0.003s sys 0.000s
I20251215 14:55:19.369470 9303 raft_consensus.cc:2468] T de24f0b914304135bebcdb09e9b2f2f9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:19.369506 9427 tablet_bootstrap.cc:654] T bee9a28b78184d4893a845120670e302 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.369794 9435 raft_consensus.cc:359] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.369962 9435 raft_consensus.cc:385] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.370011 9435 raft_consensus.cc:740] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.370184 9435 consensus_queue.cc:260] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.370663 9435 ts_tablet_manager.cc:1434] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:19.370967 9435 tablet_bootstrap.cc:492] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:19.372340 9435 tablet_bootstrap.cc:654] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.378096 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07fafc0eab704e42a793eeb32ac9a7d6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.378312 9303 raft_consensus.cc:2468] T 07fafc0eab704e42a793eeb32ac9a7d6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:19.379300 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb309f7c439740c89470da5636523a69" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.380586 9426 tablet_bootstrap.cc:654] T a2a58a13b66641b0bdc710cf5d458689 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:19.383225 8978 leader_election.cc:343] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.383519 8978 leader_election.cc:304] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:19.383790 10601 raft_consensus.cc:2749] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:19.388026 9426 tablet_bootstrap.cc:492] T a2a58a13b66641b0bdc710cf5d458689 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:19.388305 9426 ts_tablet_manager.cc:1403] T a2a58a13b66641b0bdc710cf5d458689 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.096s user 0.004s sys 0.000s
I20251215 14:55:19.390378 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:55:19.390681 9248 leader_election.cc:304] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.393448 10527 consensus_queue.cc:1048] T 5830296559264b609909486aa15c9e2e P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:19.393929 10527 consensus_queue.cc:1048] T a93d01ea31a64dc2a8d8b03884675024 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:19.397990 9426 raft_consensus.cc:359] T a2a58a13b66641b0bdc710cf5d458689 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.398190 9426 raft_consensus.cc:385] T a2a58a13b66641b0bdc710cf5d458689 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.398254 9426 raft_consensus.cc:740] T a2a58a13b66641b0bdc710cf5d458689 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.398480 9426 consensus_queue.cc:260] T a2a58a13b66641b0bdc710cf5d458689 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.399243 9426 ts_tablet_manager.cc:1434] T a2a58a13b66641b0bdc710cf5d458689 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.011s user 0.002s sys 0.001s
I20251215 14:55:19.399386 8978 leader_election.cc:304] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.399544 9426 tablet_bootstrap.cc:492] T 14ac26b3a02449f8a7588151abe7ae10 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:19.399796 10527 raft_consensus.cc:2804] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:19.400034 10527 raft_consensus.cc:697] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:19.400144 9427 tablet_bootstrap.cc:492] T bee9a28b78184d4893a845120670e302 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:19.400338 9427 ts_tablet_manager.cc:1403] T bee9a28b78184d4893a845120670e302 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.064s user 0.002s sys 0.001s
I20251215 14:55:19.400517 10527 consensus_queue.cc:237] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.401381 9426 tablet_bootstrap.cc:654] T 14ac26b3a02449f8a7588151abe7ae10 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.401486 9427 raft_consensus.cc:359] T bee9a28b78184d4893a845120670e302 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.401681 9427 raft_consensus.cc:385] T bee9a28b78184d4893a845120670e302 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.401754 9427 raft_consensus.cc:740] T bee9a28b78184d4893a845120670e302 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.401970 9427 consensus_queue.cc:260] T bee9a28b78184d4893a845120670e302 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.404332 10635 raft_consensus.cc:2804] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:19.404482 10635 raft_consensus.cc:697] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:19.404709 10635 consensus_queue.cc:237] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.409458 9248 leader_election.cc:304] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.411253 9427 ts_tablet_manager.cc:1434] T bee9a28b78184d4893a845120670e302 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.011s user 0.002s sys 0.001s
I20251215 14:55:19.413566 10856 raft_consensus.cc:2804] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:19.413709 10856 raft_consensus.cc:493] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:19.413849 10856 raft_consensus.cc:3060] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.415084 9427 tablet_bootstrap.cc:492] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:19.415733 8978 leader_election.cc:304] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.416102 10601 raft_consensus.cc:2804] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:19.416287 10601 raft_consensus.cc:697] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:19.416648 10601 consensus_queue.cc:237] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.416888 10856 raft_consensus.cc:515] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.418720 10856 leader_election.cc:290] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:19.419147 9171 raft_consensus.cc:3060] T 804ad50f38314be3bf9e118eee9fe748 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.420374 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "798eb606957b4cf7a737ec1636437581" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:19.420555 9427 tablet_bootstrap.cc:654] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:19.425040 9249 leader_election.cc:343] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.437618 10635 raft_consensus.cc:493] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.437883 10635 raft_consensus.cc:515] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.438890 10635 leader_election.cc:290] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:19.439250 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "032f27e7f6054188a3169a3c10ee4d09" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:19.439827 9249 leader_election.cc:343] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.441136 10856 raft_consensus.cc:493] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.441321 10856 raft_consensus.cc:515] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.442400 10856 leader_election.cc:290] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:19.442756 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30b9f793bf4232ba848f569100a747" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:19.443331 9249 leader_election.cc:343] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.445951 8978 leader_election.cc:304] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.446517 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "798eb606957b4cf7a737ec1636437581" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:19.449254 10756 consensus_queue.cc:1048] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251215 14:55:19.450070 10832 raft_consensus.cc:2804] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:19.456287 10832 raft_consensus.cc:697] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:19.457099 10832 consensus_queue.cc:237] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.458350 9426 tablet_bootstrap.cc:492] T 14ac26b3a02449f8a7588151abe7ae10 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:19.458482 9426 ts_tablet_manager.cc:1403] T 14ac26b3a02449f8a7588151abe7ae10 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.000s
I20251215 14:55:19.459321 9426 raft_consensus.cc:359] T 14ac26b3a02449f8a7588151abe7ae10 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.459486 9426 raft_consensus.cc:385] T 14ac26b3a02449f8a7588151abe7ae10 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.459534 9426 raft_consensus.cc:740] T 14ac26b3a02449f8a7588151abe7ae10 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.460501 9361 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:19.461789 9040 raft_consensus.cc:3060] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.464812 9426 consensus_queue.cc:260] T 14ac26b3a02449f8a7588151abe7ae10 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.465523 9426 ts_tablet_manager.cc:1434] T 14ac26b3a02449f8a7588151abe7ae10 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20251215 14:55:19.466317 9426 tablet_bootstrap.cc:492] T 7f9c173d11f1449b829a54190313bea3 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:19.467140 10756 consensus_queue.cc:1048] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
W20251215 14:55:19.469575 8976 consensus_peers.cc:597] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:19.469606 9036 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30b9f793bf4232ba848f569100a747" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:19.469843 9036 raft_consensus.cc:2468] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:19.472380 9248 leader_election.cc:304] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.473274 10635 raft_consensus.cc:2804] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:19.473407 10635 raft_consensus.cc:493] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:19.473522 10635 raft_consensus.cc:3060] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.475036 10528 raft_consensus.cc:493] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.475240 10528 raft_consensus.cc:515] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.476056 10635 raft_consensus.cc:515] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.477048 10635 leader_election.cc:290] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:19.477124 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30b9f793bf4232ba848f569100a747" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:19.477526 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "032f27e7f6054188a3169a3c10ee4d09" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:19.477674 10528 leader_election.cc:290] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:19.477700 9249 leader_election.cc:343] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.478281 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bee9a28b78184d4893a845120670e302" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:19.478736 9249 leader_election.cc:343] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.492758 9040 raft_consensus.cc:2468] T 798eb606957b4cf7a737ec1636437581 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:19.499965 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bee9a28b78184d4893a845120670e302" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:19.500223 9041 raft_consensus.cc:2468] T bee9a28b78184d4893a845120670e302 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:19.503489 9426 tablet_bootstrap.cc:654] T 7f9c173d11f1449b829a54190313bea3 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.505039 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "df30b9f793bf4232ba848f569100a747" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:19.505335 9040 raft_consensus.cc:3060] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.505781 10420 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" instance_seqno: 1765810500551421) as {username='slave'} at 127.8.121.130:37745; Asking this server to re-register.
I20251215 14:55:19.507385 9427 tablet_bootstrap.cc:492] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:19.507583 9435 tablet_bootstrap.cc:492] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:19.507714 9435 ts_tablet_manager.cc:1403] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.137s user 0.014s sys 0.010s
I20251215 14:55:19.508069 9427 ts_tablet_manager.cc:1403] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.093s user 0.005s sys 0.000s
I20251215 14:55:19.508271 9226 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:19.508344 9435 raft_consensus.cc:359] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.508495 9435 raft_consensus.cc:385] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.508545 9435 raft_consensus.cc:740] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.508725 9435 consensus_queue.cc:260] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.509181 9435 ts_tablet_manager.cc:1434] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20251215 14:55:19.509207 9427 raft_consensus.cc:359] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.509454 9435 tablet_bootstrap.cc:492] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:19.509490 9427 raft_consensus.cc:385] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.509662 9427 raft_consensus.cc:740] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.509948 9427 consensus_queue.cc:260] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.510619 9427 ts_tablet_manager.cc:1434] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:19.510833 9435 tablet_bootstrap.cc:654] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:19.512494 9248 leader_election.cc:343] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.512702 9248 leader_election.cc:304] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:19.512979 10856 raft_consensus.cc:2749] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:19.513398 9248 leader_election.cc:304] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.513706 10856 raft_consensus.cc:2804] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:19.513821 10856 raft_consensus.cc:697] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:19.514060 10856 consensus_queue.cc:237] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.515658 10421 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e89303a500544272b601d7c29be802b4" instance_seqno: 1765810501001456) as {username='slave'} at 127.8.121.131:38671; Asking this server to re-register.
I20251215 14:55:19.516301 10413 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" instance_seqno: 1765810500082532) as {username='slave'} at 127.8.121.129:38033; Asking this server to re-register.
I20251215 14:55:19.522106 9088 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:19.526983 10413 ts_manager.cc:194] Registered new tserver with Master: 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:19.528611 10875 catalog_manager.cc:1269] Loaded cluster ID: ed5da7b2c3a646fcbe8e0bb3a7589268
I20251215 14:55:19.530696 9426 tablet_bootstrap.cc:492] T 7f9c173d11f1449b829a54190313bea3 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:19.530850 9426 ts_tablet_manager.cc:1403] T 7f9c173d11f1449b829a54190313bea3 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.065s user 0.003s sys 0.001s
I20251215 14:55:19.531603 9426 raft_consensus.cc:359] T 7f9c173d11f1449b829a54190313bea3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.531773 9426 raft_consensus.cc:385] T 7f9c173d11f1449b829a54190313bea3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.531834 9426 raft_consensus.cc:740] T 7f9c173d11f1449b829a54190313bea3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.532027 9426 consensus_queue.cc:260] T 7f9c173d11f1449b829a54190313bea3 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.532507 9426 ts_tablet_manager.cc:1434] T 7f9c173d11f1449b829a54190313bea3 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:19.532765 9426 tablet_bootstrap.cc:492] T 46bd8e49fff5473f8787742f6023ddbe P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:19.534963 9426 tablet_bootstrap.cc:654] T 46bd8e49fff5473f8787742f6023ddbe P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.538012 9435 tablet_bootstrap.cc:492] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:19.538089 9248 leader_election.cc:304] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.538147 9435 ts_tablet_manager.cc:1403] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.029s user 0.007s sys 0.003s
I20251215 14:55:19.539094 10528 raft_consensus.cc:2804] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:19.539224 10528 raft_consensus.cc:493] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:19.539296 10528 raft_consensus.cc:3060] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.539542 9435 raft_consensus.cc:359] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.539710 9435 raft_consensus.cc:385] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.539760 9435 raft_consensus.cc:740] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.539970 9435 consensus_queue.cc:260] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.540439 9435 ts_tablet_manager.cc:1434] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:19.540724 9435 tablet_bootstrap.cc:492] T 394844a49d254112883c40df9821c075 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:19.540866 9426 tablet_bootstrap.cc:492] T 46bd8e49fff5473f8787742f6023ddbe P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:19.541016 9426 ts_tablet_manager.cc:1403] T 46bd8e49fff5473f8787742f6023ddbe P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.003s
I20251215 14:55:19.541704 9426 raft_consensus.cc:359] T 46bd8e49fff5473f8787742f6023ddbe P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.541875 9426 raft_consensus.cc:385] T 46bd8e49fff5473f8787742f6023ddbe P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.541945 9426 raft_consensus.cc:740] T 46bd8e49fff5473f8787742f6023ddbe P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.541853 10528 raft_consensus.cc:515] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.542135 9426 consensus_queue.cc:260] T 46bd8e49fff5473f8787742f6023ddbe P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.542608 9426 ts_tablet_manager.cc:1434] T 46bd8e49fff5473f8787742f6023ddbe P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:19.544987 10528 leader_election.cc:290] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:19.545321 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bee9a28b78184d4893a845120670e302" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:19.546175 9249 leader_election.cc:343] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.546453 10601 raft_consensus.cc:493] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.546643 10601 raft_consensus.cc:515] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.547286 10601 leader_election.cc:290] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.547922 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1c5659fd65f40b0ab72c164afb8d3fe" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:19.548462 8976 leader_election.cc:343] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.548816 9426 tablet_bootstrap.cc:492] T e9353aff4c0742c191b37d3a412ed411 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:19.550488 9426 tablet_bootstrap.cc:654] T e9353aff4c0742c191b37d3a412ed411 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.551903 9361 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:19.553378 9036 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bee9a28b78184d4893a845120670e302" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:19.553561 9036 raft_consensus.cc:3060] T bee9a28b78184d4893a845120670e302 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.556164 9036 raft_consensus.cc:2468] T bee9a28b78184d4893a845120670e302 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:19.553015 10421 ts_manager.cc:194] Registered new tserver with Master: 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:19.559909 10875 catalog_manager.cc:1562] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: loading cluster ID for follower catalog manager: success
I20251215 14:55:19.563560 9435 tablet_bootstrap.cc:654] T 394844a49d254112883c40df9821c075 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.566031 9248 leader_election.cc:304] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.566493 10844 raft_consensus.cc:2804] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:19.566638 10844 raft_consensus.cc:697] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:19.566879 10844 consensus_queue.cc:237] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.583873 9426 tablet_bootstrap.cc:492] T e9353aff4c0742c191b37d3a412ed411 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:19.584354 9426 ts_tablet_manager.cc:1403] T e9353aff4c0742c191b37d3a412ed411 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.036s user 0.010s sys 0.015s
I20251215 14:55:19.586262 9426 raft_consensus.cc:359] T e9353aff4c0742c191b37d3a412ed411 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.586882 9426 raft_consensus.cc:385] T e9353aff4c0742c191b37d3a412ed411 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.587100 9426 raft_consensus.cc:740] T e9353aff4c0742c191b37d3a412ed411 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.587595 9435 tablet_bootstrap.cc:492] T 394844a49d254112883c40df9821c075 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:19.587746 9435 ts_tablet_manager.cc:1403] T 394844a49d254112883c40df9821c075 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.047s user 0.000s sys 0.002s
I20251215 14:55:19.587641 9426 consensus_queue.cc:260] T e9353aff4c0742c191b37d3a412ed411 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.588465 9435 raft_consensus.cc:359] T 394844a49d254112883c40df9821c075 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.588649 9435 raft_consensus.cc:385] T 394844a49d254112883c40df9821c075 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.588712 9435 raft_consensus.cc:740] T 394844a49d254112883c40df9821c075 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.588910 9435 consensus_queue.cc:260] T 394844a49d254112883c40df9821c075 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.589404 9435 ts_tablet_manager.cc:1434] T 394844a49d254112883c40df9821c075 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:19.589360 9426 ts_tablet_manager.cc:1434] T e9353aff4c0742c191b37d3a412ed411 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20251215 14:55:19.589687 9435 tablet_bootstrap.cc:492] T ca2bba36b0f54aadb3980aa41dfd0eb0 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:19.590256 9426 tablet_bootstrap.cc:492] T 745482d5b350403c97621609e6935340 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:19.591502 9427 tablet_bootstrap.cc:492] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:19.593393 9427 tablet_bootstrap.cc:654] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.594280 9426 tablet_bootstrap.cc:654] T 745482d5b350403c97621609e6935340 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.594879 9040 raft_consensus.cc:2468] T df30b9f793bf4232ba848f569100a747 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:19.595572 9248 leader_election.cc:304] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.595927 10528 raft_consensus.cc:2804] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:19.596040 10528 raft_consensus.cc:697] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:19.596251 10528 consensus_queue.cc:237] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.598923 10413 ts_manager.cc:194] Registered new tserver with Master: e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.611793 10852 raft_consensus.cc:493] T a2a58a13b66641b0bdc710cf5d458689 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.611989 10852 raft_consensus.cc:515] T a2a58a13b66641b0bdc710cf5d458689 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.612669 10852 leader_election.cc:290] T a2a58a13b66641b0bdc710cf5d458689 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.613626 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2a58a13b66641b0bdc710cf5d458689" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.613849 9303 raft_consensus.cc:2393] T a2a58a13b66641b0bdc710cf5d458689 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
W20251215 14:55:19.613459 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 157531us
I20251215 14:55:19.623451 10616 consensus_queue.cc:1048] T 46bd8e49fff5473f8787742f6023ddbe P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:19.624929 8978 leader_election.cc:304] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.625293 10616 raft_consensus.cc:2804] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:19.625412 10616 raft_consensus.cc:493] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:19.625495 10616 raft_consensus.cc:3060] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.628242 10616 raft_consensus.cc:515] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.629747 10616 leader_election.cc:290] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.630096 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07fafc0eab704e42a793eeb32ac9a7d6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:19.630759 8976 leader_election.cc:343] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:19.631942 8978 leader_election.cc:343] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.632112 8978 leader_election.cc:304] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:19.632417 10616 raft_consensus.cc:2749] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:19.633177 10601 consensus_queue.cc:1048] T f4ec165149a74778aee1fb39c4d96871 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:19.634330 10832 raft_consensus.cc:493] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.634471 10832 raft_consensus.cc:515] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.635056 10832 leader_election.cc:290] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.636034 9174 raft_consensus.cc:3060] T a2a58a13b66641b0bdc710cf5d458689 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.636904 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7fd7f0ff96c54765926c6d45ea6a20a5" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:19.638128 9426 tablet_bootstrap.cc:492] T 745482d5b350403c97621609e6935340 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:19.638408 9426 ts_tablet_manager.cc:1403] T 745482d5b350403c97621609e6935340 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.048s user 0.005s sys 0.001s
W20251215 14:55:19.638422 8976 leader_election.cc:343] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.639434 10600 consensus_queue.cc:1048] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:19.640188 9426 raft_consensus.cc:359] T 745482d5b350403c97621609e6935340 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.640566 9426 raft_consensus.cc:385] T 745482d5b350403c97621609e6935340 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.640730 9426 raft_consensus.cc:740] T 745482d5b350403c97621609e6935340 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.641276 9426 consensus_queue.cc:260] T 745482d5b350403c97621609e6935340 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.650071 9427 tablet_bootstrap.cc:492] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:19.650091 9174 raft_consensus.cc:3060] T 7f9c173d11f1449b829a54190313bea3 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.651463 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1c5659fd65f40b0ab72c164afb8d3fe" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.651639 9308 raft_consensus.cc:2468] T a1c5659fd65f40b0ab72c164afb8d3fe P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:19.663656 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07fafc0eab704e42a793eeb32ac9a7d6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:19.663853 9315 raft_consensus.cc:3060] T 07fafc0eab704e42a793eeb32ac9a7d6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.664937 9427 ts_tablet_manager.cc:1403] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.074s user 0.004s sys 0.000s
I20251215 14:55:19.665467 9426 ts_tablet_manager.cc:1434] T 745482d5b350403c97621609e6935340 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.027s user 0.003s sys 0.000s
I20251215 14:55:19.666303 9315 raft_consensus.cc:2468] T 07fafc0eab704e42a793eeb32ac9a7d6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:19.666700 9427 raft_consensus.cc:359] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.666885 9427 raft_consensus.cc:385] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.666935 9427 raft_consensus.cc:740] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.667124 9427 consensus_queue.cc:260] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.667239 9426 tablet_bootstrap.cc:492] T bc9c699d00b64239b3190e57f0f42011 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:19.668254 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2a58a13b66641b0bdc710cf5d458689" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:19.672900 9435 tablet_bootstrap.cc:654] T ca2bba36b0f54aadb3980aa41dfd0eb0 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.676554 9426 tablet_bootstrap.cc:654] T bc9c699d00b64239b3190e57f0f42011 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.673600 10844 consensus_queue.cc:1048] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:19.684742 8846 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 (table default.Table_0593d9b93de9400ba29718af1b328262 [id=50a94314f5ba46e3a75b5a15e7362299], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 consensus state has no leader
I20251215 14:55:19.686497 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7fd7f0ff96c54765926c6d45ea6a20a5" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.686689 9306 raft_consensus.cc:2468] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:19.687642 9427 ts_tablet_manager.cc:1434] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.022s user 0.001s sys 0.000s
I20251215 14:55:19.687974 9427 tablet_bootstrap.cc:492] T f9a0c31abcf046c9b76bea3f946ba9fc P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:19.689535 10835 raft_consensus.cc:493] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.689671 10835 raft_consensus.cc:515] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.690224 10835 leader_election.cc:290] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.690346 10835 raft_consensus.cc:493] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.690441 10835 raft_consensus.cc:515] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.690887 10835 leader_election.cc:290] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.692617 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ca2bba36b0f54aadb3980aa41dfd0eb0" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:19.692848 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "394844a49d254112883c40df9821c075" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:19.693280 8976 leader_election.cc:343] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:19.693570 8976 leader_election.cc:343] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.695099 10600 consensus_queue.cc:1048] T 3c274c9002544af4947aa4ee76a705ce P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:19.695916 10600 consensus_queue.cc:1048] T a2a58a13b66641b0bdc710cf5d458689 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:19.697013 8978 leader_election.cc:304] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.699008 9435 tablet_bootstrap.cc:492] T ca2bba36b0f54aadb3980aa41dfd0eb0 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:19.699224 9435 ts_tablet_manager.cc:1403] T ca2bba36b0f54aadb3980aa41dfd0eb0 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.110s user 0.001s sys 0.003s
I20251215 14:55:19.700134 9435 raft_consensus.cc:359] T ca2bba36b0f54aadb3980aa41dfd0eb0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.703059 10600 raft_consensus.cc:2804] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:19.703145 10600 raft_consensus.cc:493] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:19.703231 10600 raft_consensus.cc:3060] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.706029 10600 raft_consensus.cc:515] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.706645 10600 leader_election.cc:290] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.707221 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1c5659fd65f40b0ab72c164afb8d3fe" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:19.707702 8976 leader_election.cc:343] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.709400 8978 leader_election.cc:304] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.710153 10600 raft_consensus.cc:2804] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:19.710389 10600 raft_consensus.cc:697] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:19.710672 10600 consensus_queue.cc:237] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.701918 10844 consensus_queue.cc:1048] T 7f9c173d11f1449b829a54190313bea3 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:19.717028 9435 raft_consensus.cc:385] T ca2bba36b0f54aadb3980aa41dfd0eb0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.718590 9435 raft_consensus.cc:740] T ca2bba36b0f54aadb3980aa41dfd0eb0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.719322 8978 leader_election.cc:304] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.725133 9426 tablet_bootstrap.cc:492] T bc9c699d00b64239b3190e57f0f42011 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:19.725746 9426 ts_tablet_manager.cc:1403] T bc9c699d00b64239b3190e57f0f42011 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.059s user 0.013s sys 0.000s
I20251215 14:55:19.728032 9426 raft_consensus.cc:359] T bc9c699d00b64239b3190e57f0f42011 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.728384 9426 raft_consensus.cc:385] T bc9c699d00b64239b3190e57f0f42011 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.728536 9426 raft_consensus.cc:740] T bc9c699d00b64239b3190e57f0f42011 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.729067 9426 consensus_queue.cc:260] T bc9c699d00b64239b3190e57f0f42011 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.730141 9426 ts_tablet_manager.cc:1434] T bc9c699d00b64239b3190e57f0f42011 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20251215 14:55:19.730715 9426 tablet_bootstrap.cc:492] T 307f788967bd48e2b442657806e87fc4 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:19.734103 9426 tablet_bootstrap.cc:654] T 307f788967bd48e2b442657806e87fc4 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:19.740200 9112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 67706.3us
I20251215 14:55:19.741008 9112 leader_election.cc:304] T a2a58a13b66641b0bdc710cf5d458689 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:19.741408 10561 raft_consensus.cc:2749] T a2a58a13b66641b0bdc710cf5d458689 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:19.744932 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:19.747504 9426 tablet_bootstrap.cc:492] T 307f788967bd48e2b442657806e87fc4 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:19.747846 9426 ts_tablet_manager.cc:1403] T 307f788967bd48e2b442657806e87fc4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.006s
I20251215 14:55:19.748555 10561 raft_consensus.cc:493] T e9353aff4c0742c191b37d3a412ed411 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.748699 10561 raft_consensus.cc:515] T e9353aff4c0742c191b37d3a412ed411 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.749310 10561 leader_election.cc:290] T e9353aff4c0742c191b37d3a412ed411 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.750324 9426 raft_consensus.cc:359] T 307f788967bd48e2b442657806e87fc4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.750727 9426 raft_consensus.cc:385] T 307f788967bd48e2b442657806e87fc4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.750891 9426 raft_consensus.cc:740] T 307f788967bd48e2b442657806e87fc4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.751405 9426 consensus_queue.cc:260] T 307f788967bd48e2b442657806e87fc4 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.752485 9426 ts_tablet_manager.cc:1434] T 307f788967bd48e2b442657806e87fc4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:19.753044 9426 tablet_bootstrap.cc:492] T df30b9f793bf4232ba848f569100a747 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:19.757586 9426 tablet_bootstrap.cc:654] T df30b9f793bf4232ba848f569100a747 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.762651 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9353aff4c0742c191b37d3a412ed411" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.762995 9308 raft_consensus.cc:2393] T e9353aff4c0742c191b37d3a412ed411 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:19.768276 10875 catalog_manager.cc:1584] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: acquiring CA information for follower catalog manager: success
I20251215 14:55:19.773294 10863 raft_consensus.cc:2804] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:19.773398 10863 raft_consensus.cc:493] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:19.773463 10863 raft_consensus.cc:3060] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.775942 10863 raft_consensus.cc:515] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.777017 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7fd7f0ff96c54765926c6d45ea6a20a5" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:19.777603 8976 leader_election.cc:343] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.777937 10863 leader_election.cc:290] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.727701 9427 tablet_bootstrap.cc:654] T f9a0c31abcf046c9b76bea3f946ba9fc P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.719756 9435 consensus_queue.cc:260] T ca2bba36b0f54aadb3980aa41dfd0eb0 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:19.779800 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 60532.6us
I20251215 14:55:19.780328 9435 ts_tablet_manager.cc:1434] T ca2bba36b0f54aadb3980aa41dfd0eb0 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.081s user 0.001s sys 0.001s
I20251215 14:55:19.781713 9435 tablet_bootstrap.cc:492] T 6beaf5ae37ce41fd9123d6b3560351b7 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:19.784795 9435 tablet_bootstrap.cc:654] T 6beaf5ae37ce41fd9123d6b3560351b7 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.795862 10900 consensus_queue.cc:1048] T f4203c4941184a66956ec9be8d703bb6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:19.812705 10561 raft_consensus.cc:493] T c8b49b3d98ef4e0988e9019fe82f8727 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.812891 10561 raft_consensus.cc:515] T c8b49b3d98ef4e0988e9019fe82f8727 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.813490 10561 leader_election.cc:290] T c8b49b3d98ef4e0988e9019fe82f8727 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:19.829566 10377 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.8.121.188:43131 for RPC RequestConsensusVote timed out after 0.533s (ON_OUTBOUND_QUEUE)
I20251215 14:55:19.788336 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ca2bba36b0f54aadb3980aa41dfd0eb0" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.834856 9315 raft_consensus.cc:2468] T ca2bba36b0f54aadb3980aa41dfd0eb0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:19.835333 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9353aff4c0742c191b37d3a412ed411" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:19.837090 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b49b3d98ef4e0988e9019fe82f8727" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:19.789474 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "394844a49d254112883c40df9821c075" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.837714 9312 raft_consensus.cc:2468] T 394844a49d254112883c40df9821c075 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:19.790182 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a1c5659fd65f40b0ab72c164afb8d3fe" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:19.837921 9306 raft_consensus.cc:3060] T a1c5659fd65f40b0ab72c164afb8d3fe P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.840641 9306 raft_consensus.cc:2468] T a1c5659fd65f40b0ab72c164afb8d3fe P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:19.790544 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7fd7f0ff96c54765926c6d45ea6a20a5" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:19.840864 9311 raft_consensus.cc:3060] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.818075 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8b49b3d98ef4e0988e9019fe82f8727" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.847388 9311 raft_consensus.cc:2468] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:19.853792 10559 raft_consensus.cc:493] T bc9c699d00b64239b3190e57f0f42011 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.853960 10559 raft_consensus.cc:515] T bc9c699d00b64239b3190e57f0f42011 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.854569 10559 leader_election.cc:290] T bc9c699d00b64239b3190e57f0f42011 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.855460 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bc9c699d00b64239b3190e57f0f42011" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:19.856304 9112 leader_election.cc:304] T e9353aff4c0742c191b37d3a412ed411 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:19.856814 10559 raft_consensus.cc:3060] T e9353aff4c0742c191b37d3a412ed411 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.860167 10559 raft_consensus.cc:2749] T e9353aff4c0742c191b37d3a412ed411 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:19.861143 9174 raft_consensus.cc:3060] T 2ebdaff1fcbe4b27b6da28f010d1af1a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.865917 9427 tablet_bootstrap.cc:492] T f9a0c31abcf046c9b76bea3f946ba9fc P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:19.866150 9427 ts_tablet_manager.cc:1403] T f9a0c31abcf046c9b76bea3f946ba9fc P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.178s user 0.005s sys 0.001s
I20251215 14:55:19.867866 9427 raft_consensus.cc:359] T f9a0c31abcf046c9b76bea3f946ba9fc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.868109 9427 raft_consensus.cc:385] T f9a0c31abcf046c9b76bea3f946ba9fc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.868212 9427 raft_consensus.cc:740] T f9a0c31abcf046c9b76bea3f946ba9fc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.868461 9427 consensus_queue.cc:260] T f9a0c31abcf046c9b76bea3f946ba9fc P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.869127 9427 ts_tablet_manager.cc:1434] T f9a0c31abcf046c9b76bea3f946ba9fc P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:19.869421 9427 tablet_bootstrap.cc:492] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:19.871860 9435 tablet_bootstrap.cc:492] T 6beaf5ae37ce41fd9123d6b3560351b7 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:19.872087 9435 ts_tablet_manager.cc:1403] T 6beaf5ae37ce41fd9123d6b3560351b7 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.090s user 0.002s sys 0.002s
I20251215 14:55:19.872273 9427 tablet_bootstrap.cc:654] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.872900 9435 raft_consensus.cc:359] T 6beaf5ae37ce41fd9123d6b3560351b7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.877697 9435 raft_consensus.cc:385] T 6beaf5ae37ce41fd9123d6b3560351b7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.877826 9435 raft_consensus.cc:740] T 6beaf5ae37ce41fd9123d6b3560351b7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.878101 9435 consensus_queue.cc:260] T 6beaf5ae37ce41fd9123d6b3560351b7 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.881139 9112 leader_election.cc:304] T c8b49b3d98ef4e0988e9019fe82f8727 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:19.881623 10559 raft_consensus.cc:2749] T c8b49b3d98ef4e0988e9019fe82f8727 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:19.882480 10600 consensus_queue.cc:1048] T e9353aff4c0742c191b37d3a412ed411 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 14:55:19.888088 8978 leader_election.cc:304] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.888549 10600 raft_consensus.cc:2804] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:19.888640 10600 raft_consensus.cc:493] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:19.888716 10600 raft_consensus.cc:3060] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.891799 10600 raft_consensus.cc:515] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.892822 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ca2bba36b0f54aadb3980aa41dfd0eb0" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:19.893308 8976 leader_election.cc:343] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.893708 10600 leader_election.cc:290] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.894106 8978 leader_election.cc:304] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.896252 8978 leader_election.cc:304] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.896517 10600 raft_consensus.cc:2804] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:19.897771 10600 raft_consensus.cc:493] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:19.897909 10600 raft_consensus.cc:3060] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.899824 10863 raft_consensus.cc:2804] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:19.899957 10863 raft_consensus.cc:697] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:19.900185 10863 consensus_queue.cc:237] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.905038 9435 ts_tablet_manager.cc:1434] T 6beaf5ae37ce41fd9123d6b3560351b7 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.033s user 0.001s sys 0.001s
I20251215 14:55:19.905360 9435 tablet_bootstrap.cc:492] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:19.907065 9435 tablet_bootstrap.cc:654] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.907298 8978 leader_election.cc:304] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.897564 9427 tablet_bootstrap.cc:492] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:19.907819 9427 ts_tablet_manager.cc:1403] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.000s
I20251215 14:55:19.907720 10844 consensus_queue.cc:1048] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:19.908849 9174 raft_consensus.cc:3060] T c8b49b3d98ef4e0988e9019fe82f8727 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.914546 10600 raft_consensus.cc:515] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.915913 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "394844a49d254112883c40df9821c075" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:19.916529 8976 leader_election.cc:343] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.917268 10900 raft_consensus.cc:2804] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:19.917569 10900 raft_consensus.cc:697] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:19.917865 10900 consensus_queue.cc:237] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.934695 9427 raft_consensus.cc:359] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.934926 9427 raft_consensus.cc:385] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.934983 9427 raft_consensus.cc:740] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.935145 9427 consensus_queue.cc:260] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.936393 10844 consensus_queue.cc:1048] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:19.937021 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bc9c699d00b64239b3190e57f0f42011" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:19.937230 9041 raft_consensus.cc:2393] T bc9c699d00b64239b3190e57f0f42011 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:19.942788 9112 leader_election.cc:304] T bc9c699d00b64239b3190e57f0f42011 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:19.943259 10559 raft_consensus.cc:3060] T bc9c699d00b64239b3190e57f0f42011 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.945796 10559 raft_consensus.cc:2749] T bc9c699d00b64239b3190e57f0f42011 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:19.950493 10600 leader_election.cc:290] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.956940 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ca2bba36b0f54aadb3980aa41dfd0eb0" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:19.957139 9306 raft_consensus.cc:3060] T ca2bba36b0f54aadb3980aa41dfd0eb0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:19.960041 9435 tablet_bootstrap.cc:492] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:19.960175 9435 ts_tablet_manager.cc:1403] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.055s user 0.015s sys 0.003s
I20251215 14:55:19.960898 9435 raft_consensus.cc:359] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.961083 9435 raft_consensus.cc:385] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.961153 9435 raft_consensus.cc:740] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.961285 9306 raft_consensus.cc:2468] T ca2bba36b0f54aadb3980aa41dfd0eb0 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:19.961367 9435 consensus_queue.cc:260] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.962545 9435 ts_tablet_manager.cc:1434] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:19.962854 9435 tablet_bootstrap.cc:492] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:19.965394 9435 tablet_bootstrap.cc:654] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.966156 10832 raft_consensus.cc:493] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:19.966313 10832 raft_consensus.cc:515] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.973002 9427 ts_tablet_manager.cc:1434] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.065s user 0.000s sys 0.002s
I20251215 14:55:19.973654 9427 tablet_bootstrap.cc:492] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:19.978111 10832 leader_election.cc:290] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:19.978426 9435 tablet_bootstrap.cc:492] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:19.978567 9435 ts_tablet_manager.cc:1403] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.002s
I20251215 14:55:19.978700 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e317c8dc24e481abb709e932fa39c29" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:19.982911 9435 raft_consensus.cc:359] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.983250 9435 raft_consensus.cc:385] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:19.983350 9435 raft_consensus.cc:740] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:19.983593 9435 consensus_queue.cc:260] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.984258 9435 ts_tablet_manager.cc:1434] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
W20251215 14:55:19.979121 8976 leader_election.cc:343] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:19.984606 9435 tablet_bootstrap.cc:492] T 9e317c8dc24e481abb709e932fa39c29 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:19.987788 9435 tablet_bootstrap.cc:654] T 9e317c8dc24e481abb709e932fa39c29 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:19.989105 8978 leader_election.cc:304] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:19.989435 10600 raft_consensus.cc:2804] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:19.989670 10600 raft_consensus.cc:697] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:19.989966 10600 consensus_queue.cc:237] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:19.992895 9427 tablet_bootstrap.cc:654] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.000126 10832 raft_consensus.cc:493] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.000277 10832 raft_consensus.cc:515] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.000852 10832 leader_election.cc:290] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.001713 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6947983b19ee4ca59349979c6662bc1c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:20.002195 8976 leader_election.cc:343] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.006016 9435 tablet_bootstrap.cc:492] T 9e317c8dc24e481abb709e932fa39c29 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.006214 9435 ts_tablet_manager.cc:1403] T 9e317c8dc24e481abb709e932fa39c29 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20251215 14:55:20.007073 9435 raft_consensus.cc:359] T 9e317c8dc24e481abb709e932fa39c29 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.007354 9435 raft_consensus.cc:385] T 9e317c8dc24e481abb709e932fa39c29 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.007450 9435 raft_consensus.cc:740] T 9e317c8dc24e481abb709e932fa39c29 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.007738 9435 consensus_queue.cc:260] T 9e317c8dc24e481abb709e932fa39c29 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.008400 9435 ts_tablet_manager.cc:1434] T 9e317c8dc24e481abb709e932fa39c29 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:20.008733 9435 tablet_bootstrap.cc:492] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.010673 9435 tablet_bootstrap.cc:654] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.011541 9427 tablet_bootstrap.cc:492] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:20.012017 9427 ts_tablet_manager.cc:1403] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.004s
I20251215 14:55:20.012671 9427 raft_consensus.cc:359] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.012833 9427 raft_consensus.cc:385] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.012888 9427 raft_consensus.cc:740] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.013586 9427 consensus_queue.cc:260] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.014446 9427 ts_tablet_manager.cc:1434] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:20.015466 9435 tablet_bootstrap.cc:492] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.015653 9435 ts_tablet_manager.cc:1403] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20251215 14:55:20.016445 9435 raft_consensus.cc:359] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.016675 9435 raft_consensus.cc:385] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.016770 9435 raft_consensus.cc:740] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.017056 9435 consensus_queue.cc:260] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.018193 9435 ts_tablet_manager.cc:1434] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:20.018525 9435 tablet_bootstrap.cc:492] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.020164 9435 tablet_bootstrap.cc:654] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.021057 9427 tablet_bootstrap.cc:492] T 6beaf5ae37ce41fd9123d6b3560351b7 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:20.023463 9427 tablet_bootstrap.cc:654] T 6beaf5ae37ce41fd9123d6b3560351b7 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.022913 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "394844a49d254112883c40df9821c075" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:20.023660 9306 raft_consensus.cc:3060] T 394844a49d254112883c40df9821c075 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.026111 9306 raft_consensus.cc:2468] T 394844a49d254112883c40df9821c075 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:20.026849 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e317c8dc24e481abb709e932fa39c29" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.027025 9314 raft_consensus.cc:2468] T 9e317c8dc24e481abb709e932fa39c29 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:20.023093 10635 consensus_queue.cc:1048] T c4660d4e5cb84f3a983922c0b4aef90b P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.028887 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6947983b19ee4ca59349979c6662bc1c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.031661 9426 tablet_bootstrap.cc:492] T df30b9f793bf4232ba848f569100a747 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.031816 9426 ts_tablet_manager.cc:1403] T df30b9f793bf4232ba848f569100a747 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.279s user 0.033s sys 0.062s
I20251215 14:55:20.032543 9426 raft_consensus.cc:359] T df30b9f793bf4232ba848f569100a747 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.032714 9426 raft_consensus.cc:385] T df30b9f793bf4232ba848f569100a747 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.032778 9426 raft_consensus.cc:740] T df30b9f793bf4232ba848f569100a747 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.032963 9426 consensus_queue.cc:260] T df30b9f793bf4232ba848f569100a747 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.033401 9426 ts_tablet_manager.cc:1434] T df30b9f793bf4232ba848f569100a747 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251215 14:55:20.033667 9426 tablet_bootstrap.cc:492] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.037402 9426 tablet_bootstrap.cc:654] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.040915 8978 leader_election.cc:304] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:20.042152 9435 tablet_bootstrap.cc:492] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.042374 9435 ts_tablet_manager.cc:1403] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.000s
I20251215 14:55:20.043079 8978 leader_election.cc:304] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:20.043744 10832 raft_consensus.cc:2804] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:20.043886 10832 raft_consensus.cc:697] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:20.044116 10832 consensus_queue.cc:237] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.046376 10863 raft_consensus.cc:2804] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:20.046487 10863 raft_consensus.cc:493] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:20.046561 10863 raft_consensus.cc:3060] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.050012 10863 raft_consensus.cc:515] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:20.050084 8978 leader_election.cc:343] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.050593 8978 leader_election.cc:304] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:20.050724 10863 leader_election.cc:290] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.051182 10863 raft_consensus.cc:2749] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:20.051373 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e317c8dc24e481abb709e932fa39c29" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:20.051882 8976 leader_election.cc:343] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.056222 9435 raft_consensus.cc:359] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.056707 9435 raft_consensus.cc:385] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.056770 9435 raft_consensus.cc:740] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.056928 9435 consensus_queue.cc:260] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.057860 9435 ts_tablet_manager.cc:1434] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20251215 14:55:20.058128 9435 tablet_bootstrap.cc:492] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.059926 9435 tablet_bootstrap.cc:654] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.073706 10844 consensus_queue.cc:1048] T 1cb23f66c1b94751a9557e8b426dd434 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.074718 10875 catalog_manager.cc:1612] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251215 14:55:20.075284 9435 tablet_bootstrap.cc:492] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.075477 9435 ts_tablet_manager.cc:1403] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.002s
I20251215 14:55:20.076265 9435 raft_consensus.cc:359] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.076444 9435 raft_consensus.cc:385] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.076507 9435 raft_consensus.cc:740] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.076690 9435 consensus_queue.cc:260] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.079870 9435 ts_tablet_manager.cc:1434] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:20.080412 9435 tablet_bootstrap.cc:492] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.081075 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e317c8dc24e481abb709e932fa39c29" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:20.081287 9312 raft_consensus.cc:3060] T 9e317c8dc24e481abb709e932fa39c29 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.084009 9312 raft_consensus.cc:2468] T 9e317c8dc24e481abb709e932fa39c29 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:20.090134 9435 tablet_bootstrap.cc:654] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.093168 8978 leader_election.cc:304] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:20.093618 10600 raft_consensus.cc:2804] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:20.094740 10600 raft_consensus.cc:697] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:20.094983 10600 consensus_queue.cc:237] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.095801 9426 tablet_bootstrap.cc:492] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.095956 9426 ts_tablet_manager.cc:1403] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.062s user 0.006s sys 0.002s
I20251215 14:55:20.096772 9426 raft_consensus.cc:359] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.096961 9426 raft_consensus.cc:385] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.097043 9426 raft_consensus.cc:740] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.097270 9426 consensus_queue.cc:260] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.097747 9426 ts_tablet_manager.cc:1434] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:20.098019 9426 tablet_bootstrap.cc:492] T 798eb606957b4cf7a737ec1636437581 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.098078 9427 tablet_bootstrap.cc:492] T 6beaf5ae37ce41fd9123d6b3560351b7 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:20.098198 9427 ts_tablet_manager.cc:1403] T 6beaf5ae37ce41fd9123d6b3560351b7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.077s user 0.004s sys 0.000s
I20251215 14:55:20.098805 9427 raft_consensus.cc:359] T 6beaf5ae37ce41fd9123d6b3560351b7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.098960 9427 raft_consensus.cc:385] T 6beaf5ae37ce41fd9123d6b3560351b7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.099015 9427 raft_consensus.cc:740] T 6beaf5ae37ce41fd9123d6b3560351b7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.099205 9427 consensus_queue.cc:260] T 6beaf5ae37ce41fd9123d6b3560351b7 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.102366 10559 raft_consensus.cc:493] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.102519 10559 raft_consensus.cc:515] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.103062 10559 leader_election.cc:290] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.103694 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7fd7f0ff96c54765926c6d45ea6a20a5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.103987 9312 raft_consensus.cc:2393] T 7fd7f0ff96c54765926c6d45ea6a20a5 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:20.104355 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7fd7f0ff96c54765926c6d45ea6a20a5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.105016 9427 ts_tablet_manager.cc:1434] T 6beaf5ae37ce41fd9123d6b3560351b7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20251215 14:55:20.105085 9112 leader_election.cc:304] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:20.105295 9427 tablet_bootstrap.cc:492] T e9124dd3d98947b29289e0561976ada4 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:20.105557 10559 raft_consensus.cc:3060] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.105751 9426 tablet_bootstrap.cc:654] T 798eb606957b4cf7a737ec1636437581 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.106797 9427 tablet_bootstrap.cc:654] T e9124dd3d98947b29289e0561976ada4 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.108088 10559 raft_consensus.cc:2749] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:20.110769 9435 tablet_bootstrap.cc:492] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.111423 9435 ts_tablet_manager.cc:1403] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.001s
I20251215 14:55:20.115569 9435 raft_consensus.cc:359] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.116592 10600 raft_consensus.cc:493] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.116529 9435 raft_consensus.cc:385] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.116739 10600 raft_consensus.cc:515] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.116807 9435 raft_consensus.cc:740] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.117762 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d09d7ce93d074bfaa830130b31bcc594" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:20.117565 9435 consensus_queue.cc:260] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:20.118237 8976 leader_election.cc:343] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.118610 10600 leader_election.cc:290] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.119817 9435 ts_tablet_manager.cc:1434] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20251215 14:55:20.121039 9435 tablet_bootstrap.cc:492] T 88edc14acdad47a3907078d08e118ce7 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.125412 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d09d7ce93d074bfaa830130b31bcc594" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.125627 9312 raft_consensus.cc:2468] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:20.128579 9435 tablet_bootstrap.cc:654] T 88edc14acdad47a3907078d08e118ce7 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.131093 10844 consensus_queue.cc:1048] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.133155 8978 leader_election.cc:304] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:20.133539 10600 raft_consensus.cc:2804] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:20.133606 10600 raft_consensus.cc:493] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:20.133661 10600 raft_consensus.cc:3060] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.135028 10863 consensus_queue.cc:1048] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.136657 10600 raft_consensus.cc:515] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.137233 10600 leader_election.cc:290] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.137722 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d09d7ce93d074bfaa830130b31bcc594" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:20.138260 8976 leader_election.cc:343] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.139699 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d09d7ce93d074bfaa830130b31bcc594" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:20.139865 9312 raft_consensus.cc:3060] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.142443 9312 raft_consensus.cc:2468] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:20.142797 9426 tablet_bootstrap.cc:492] T 798eb606957b4cf7a737ec1636437581 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.142946 9426 ts_tablet_manager.cc:1403] T 798eb606957b4cf7a737ec1636437581 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.000s
I20251215 14:55:20.142937 8978 leader_election.cc:304] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:20.143344 10600 raft_consensus.cc:2804] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:20.143481 10600 raft_consensus.cc:697] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:20.143735 9426 raft_consensus.cc:359] T 798eb606957b4cf7a737ec1636437581 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.143911 9426 raft_consensus.cc:385] T 798eb606957b4cf7a737ec1636437581 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.143982 9426 raft_consensus.cc:740] T 798eb606957b4cf7a737ec1636437581 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.144197 9426 consensus_queue.cc:260] T 798eb606957b4cf7a737ec1636437581 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.143700 10600 consensus_queue.cc:237] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.144709 9426 ts_tablet_manager.cc:1434] T 798eb606957b4cf7a737ec1636437581 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:20.144994 9426 tablet_bootstrap.cc:492] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.146713 9426 tablet_bootstrap.cc:654] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.148125 9435 tablet_bootstrap.cc:492] T 88edc14acdad47a3907078d08e118ce7 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.148408 9435 ts_tablet_manager.cc:1403] T 88edc14acdad47a3907078d08e118ce7 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.028s user 0.006s sys 0.002s
I20251215 14:55:20.150204 9435 raft_consensus.cc:359] T 88edc14acdad47a3907078d08e118ce7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.150554 9435 raft_consensus.cc:385] T 88edc14acdad47a3907078d08e118ce7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.150679 9435 raft_consensus.cc:740] T 88edc14acdad47a3907078d08e118ce7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.151042 9435 consensus_queue.cc:260] T 88edc14acdad47a3907078d08e118ce7 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.153194 9435 ts_tablet_manager.cc:1434] T 88edc14acdad47a3907078d08e118ce7 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:20.154286 9435 tablet_bootstrap.cc:492] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.161427 10833 consensus_queue.cc:1048] T bc9c699d00b64239b3190e57f0f42011 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.164587 9435 tablet_bootstrap.cc:654] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.180115 10832 consensus_queue.cc:1048] T 56f600c59b094e4f96acec978911a8a7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.184245 9435 tablet_bootstrap.cc:492] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.184542 9435 ts_tablet_manager.cc:1403] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.031s user 0.007s sys 0.002s
W20251215 14:55:20.185148 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:20.186403 9435 raft_consensus.cc:359] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.186817 9435 raft_consensus.cc:385] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.186954 9435 raft_consensus.cc:740] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.187137 9426 tablet_bootstrap.cc:492] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.187294 9426 ts_tablet_manager.cc:1403] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.001s
I20251215 14:55:20.187436 9435 consensus_queue.cc:260] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.188031 9426 raft_consensus.cc:359] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.188205 9426 raft_consensus.cc:385] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.188278 9426 raft_consensus.cc:740] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.188493 9426 consensus_queue.cc:260] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.188956 9426 ts_tablet_manager.cc:1434] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:20.189231 9426 tablet_bootstrap.cc:492] T bee9a28b78184d4893a845120670e302 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.189646 9435 ts_tablet_manager.cc:1434] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20251215 14:55:20.190016 10559 raft_consensus.cc:493] T 14ac26b3a02449f8a7588151abe7ae10 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.190173 10559 raft_consensus.cc:515] T 14ac26b3a02449f8a7588151abe7ae10 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.190860 10559 leader_election.cc:290] T 14ac26b3a02449f8a7588151abe7ae10 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.190900 9426 tablet_bootstrap.cc:654] T bee9a28b78184d4893a845120670e302 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.190775 9435 tablet_bootstrap.cc:492] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.191347 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14ac26b3a02449f8a7588151abe7ae10" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.191589 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14ac26b3a02449f8a7588151abe7ae10" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.191809 9040 raft_consensus.cc:2393] T 14ac26b3a02449f8a7588151abe7ae10 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:20.192175 9112 leader_election.cc:304] T 14ac26b3a02449f8a7588151abe7ae10 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:20.192654 10559 raft_consensus.cc:3060] T 14ac26b3a02449f8a7588151abe7ae10 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.195473 10921 raft_consensus.cc:493] T 745482d5b350403c97621609e6935340 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.195607 10921 raft_consensus.cc:515] T 745482d5b350403c97621609e6935340 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.196125 10921 leader_election.cc:290] T 745482d5b350403c97621609e6935340 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.196702 10559 raft_consensus.cc:2749] T 14ac26b3a02449f8a7588151abe7ae10 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:20.196815 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "745482d5b350403c97621609e6935340" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.197204 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "745482d5b350403c97621609e6935340" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.197409 9040 raft_consensus.cc:2393] T 745482d5b350403c97621609e6935340 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:20.198007 9112 leader_election.cc:304] T 745482d5b350403c97621609e6935340 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:20.198218 9435 tablet_bootstrap.cc:654] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.198437 10559 raft_consensus.cc:3060] T 745482d5b350403c97621609e6935340 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.201653 10559 raft_consensus.cc:2749] T 745482d5b350403c97621609e6935340 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:20.219764 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet cd025ffa766d45f8bc6c42c6eaa3418c (table default.Table_681e95321cd9408b86d9b8dc14ab4448 [id=5ef3a8ef2a24423d89c8a77dffd849c6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cd025ffa766d45f8bc6c42c6eaa3418c consensus state has no leader
I20251215 14:55:20.226419 10559 raft_consensus.cc:493] T 46bd8e49fff5473f8787742f6023ddbe P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.226788 10559 raft_consensus.cc:515] T 46bd8e49fff5473f8787742f6023ddbe P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.227664 10559 leader_election.cc:290] T 46bd8e49fff5473f8787742f6023ddbe P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.228057 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46bd8e49fff5473f8787742f6023ddbe" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.228057 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "46bd8e49fff5473f8787742f6023ddbe" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.228823 9115 leader_election.cc:304] T 46bd8e49fff5473f8787742f6023ddbe P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:20.237855 10921 raft_consensus.cc:2749] T 46bd8e49fff5473f8787742f6023ddbe P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:20.255146 10921 raft_consensus.cc:493] T 307f788967bd48e2b442657806e87fc4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.255343 10921 raft_consensus.cc:515] T 307f788967bd48e2b442657806e87fc4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.255957 10921 leader_election.cc:290] T 307f788967bd48e2b442657806e87fc4 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.263840 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "307f788967bd48e2b442657806e87fc4" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.264106 9312 raft_consensus.cc:2393] T 307f788967bd48e2b442657806e87fc4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:20.266583 10832 raft_consensus.cc:493] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:20.266770 9249 consensus_peers.cc:597] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:20.266744 10832 raft_consensus.cc:515] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.267400 10832 leader_election.cc:290] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.268574 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "032f27e7f6054188a3169a3c10ee4d09" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:20.269291 8976 leader_election.cc:343] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.270217 10528 raft_consensus.cc:493] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.270376 10528 raft_consensus.cc:515] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.271001 10528 leader_election.cc:290] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.271942 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb309f7c439740c89470da5636523a69" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:20.272475 9249 leader_election.cc:343] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.275962 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "307f788967bd48e2b442657806e87fc4" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.276690 9112 leader_election.cc:304] T 307f788967bd48e2b442657806e87fc4 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:20.276770 9427 tablet_bootstrap.cc:492] T e9124dd3d98947b29289e0561976ada4 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:20.276897 9427 ts_tablet_manager.cc:1403] T e9124dd3d98947b29289e0561976ada4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.172s user 0.016s sys 0.006s
I20251215 14:55:20.277271 10921 raft_consensus.cc:3060] T 307f788967bd48e2b442657806e87fc4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.277632 9427 raft_consensus.cc:359] T e9124dd3d98947b29289e0561976ada4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.277789 9427 raft_consensus.cc:385] T e9124dd3d98947b29289e0561976ada4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.277837 9427 raft_consensus.cc:740] T e9124dd3d98947b29289e0561976ada4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.278036 9427 consensus_queue.cc:260] T e9124dd3d98947b29289e0561976ada4 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.278548 9427 ts_tablet_manager.cc:1434] T e9124dd3d98947b29289e0561976ada4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:20.278865 9427 tablet_bootstrap.cc:492] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:20.281092 9427 tablet_bootstrap.cc:654] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.281644 10921 raft_consensus.cc:2749] T 307f788967bd48e2b442657806e87fc4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:20.284840 10528 raft_consensus.cc:493] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.285006 10528 raft_consensus.cc:515] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.285809 10528 leader_election.cc:290] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.286823 9426 tablet_bootstrap.cc:492] T bee9a28b78184d4893a845120670e302 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.286964 9426 ts_tablet_manager.cc:1403] T bee9a28b78184d4893a845120670e302 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.098s user 0.012s sys 0.004s
I20251215 14:55:20.287462 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06cb17538a7541358548f25303e91d37" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:20.287626 9426 raft_consensus.cc:359] T bee9a28b78184d4893a845120670e302 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.287781 9426 raft_consensus.cc:385] T bee9a28b78184d4893a845120670e302 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.287825 9426 raft_consensus.cc:740] T bee9a28b78184d4893a845120670e302 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.288002 9426 consensus_queue.cc:260] T bee9a28b78184d4893a845120670e302 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:20.288157 9249 leader_election.cc:343] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.288448 9426 ts_tablet_manager.cc:1434] T bee9a28b78184d4893a845120670e302 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:20.288738 9426 tablet_bootstrap.cc:492] T 07fafc0eab704e42a793eeb32ac9a7d6 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.290056 9426 tablet_bootstrap.cc:654] T 07fafc0eab704e42a793eeb32ac9a7d6 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.291399 9427 tablet_bootstrap.cc:492] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:20.291546 9427 ts_tablet_manager.cc:1403] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.000s
I20251215 14:55:20.295477 9427 raft_consensus.cc:359] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.295682 9427 raft_consensus.cc:385] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.295732 9427 raft_consensus.cc:740] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.295920 9427 consensus_queue.cc:260] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.296430 9427 ts_tablet_manager.cc:1434] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:20.296365 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb309f7c439740c89470da5636523a69" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.296723 9427 tablet_bootstrap.cc:492] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:20.296761 9040 raft_consensus.cc:2468] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:20.298427 9427 tablet_bootstrap.cc:654] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.301203 9427 tablet_bootstrap.cc:492] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:20.301452 9427 ts_tablet_manager.cc:1403] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20251215 14:55:20.303730 9435 tablet_bootstrap.cc:492] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.303957 9435 ts_tablet_manager.cc:1403] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.113s user 0.010s sys 0.028s
I20251215 14:55:20.305140 9435 raft_consensus.cc:359] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.305405 9435 raft_consensus.cc:385] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.305513 9435 raft_consensus.cc:740] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.305830 9435 consensus_queue.cc:260] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.307022 9435 ts_tablet_manager.cc:1434] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20251215 14:55:20.307483 9427 raft_consensus.cc:359] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.308422 9435 tablet_bootstrap.cc:492] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.308290 9427 raft_consensus.cc:385] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.308676 9427 raft_consensus.cc:740] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.309932 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "032f27e7f6054188a3169a3c10ee4d09" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.310096 9312 raft_consensus.cc:2468] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:20.309686 9427 consensus_queue.cc:260] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.311519 9248 leader_election.cc:304] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:20.313051 9427 ts_tablet_manager.cc:1434] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20251215 14:55:20.314591 9427 tablet_bootstrap.cc:492] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:20.316654 9426 tablet_bootstrap.cc:492] T 07fafc0eab704e42a793eeb32ac9a7d6 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.316779 9435 tablet_bootstrap.cc:654] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.316787 9426 ts_tablet_manager.cc:1403] T 07fafc0eab704e42a793eeb32ac9a7d6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20251215 14:55:20.317371 9426 raft_consensus.cc:359] T 07fafc0eab704e42a793eeb32ac9a7d6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.317526 9426 raft_consensus.cc:385] T 07fafc0eab704e42a793eeb32ac9a7d6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.317572 9426 raft_consensus.cc:740] T 07fafc0eab704e42a793eeb32ac9a7d6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.317752 9426 consensus_queue.cc:260] T 07fafc0eab704e42a793eeb32ac9a7d6 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.318171 9426 ts_tablet_manager.cc:1434] T 07fafc0eab704e42a793eeb32ac9a7d6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:20.318440 9426 tablet_bootstrap.cc:492] T de24f0b914304135bebcdb09e9b2f2f9 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.319664 9426 tablet_bootstrap.cc:654] T de24f0b914304135bebcdb09e9b2f2f9 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.320459 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06cb17538a7541358548f25303e91d37" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.322781 9427 tablet_bootstrap.cc:654] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.336493 9426 tablet_bootstrap.cc:492] T de24f0b914304135bebcdb09e9b2f2f9 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.336671 9426 ts_tablet_manager.cc:1403] T de24f0b914304135bebcdb09e9b2f2f9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20251215 14:55:20.337365 9426 raft_consensus.cc:359] T de24f0b914304135bebcdb09e9b2f2f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.337538 9426 raft_consensus.cc:385] T de24f0b914304135bebcdb09e9b2f2f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.337599 9426 raft_consensus.cc:740] T de24f0b914304135bebcdb09e9b2f2f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.337781 9426 consensus_queue.cc:260] T de24f0b914304135bebcdb09e9b2f2f9 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.338269 10528 raft_consensus.cc:2804] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:20.338414 10528 raft_consensus.cc:493] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:20.338527 10528 raft_consensus.cc:3060] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.340009 10559 raft_consensus.cc:493] T 07fafc0eab704e42a793eeb32ac9a7d6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.340128 10559 raft_consensus.cc:515] T 07fafc0eab704e42a793eeb32ac9a7d6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.340694 10559 leader_election.cc:290] T 07fafc0eab704e42a793eeb32ac9a7d6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.341787 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07fafc0eab704e42a793eeb32ac9a7d6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.341998 9312 raft_consensus.cc:2393] T 07fafc0eab704e42a793eeb32ac9a7d6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:20.344884 10528 raft_consensus.cc:515] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.346374 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb309f7c439740c89470da5636523a69" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:20.346889 9249 leader_election.cc:343] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.347111 10528 leader_election.cc:290] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.348706 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07fafc0eab704e42a793eeb32ac9a7d6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.349232 9112 leader_election.cc:304] T 07fafc0eab704e42a793eeb32ac9a7d6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:20.349677 10559 raft_consensus.cc:3060] T 07fafc0eab704e42a793eeb32ac9a7d6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.352308 10559 raft_consensus.cc:2749] T 07fafc0eab704e42a793eeb32ac9a7d6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:20.352380 9426 ts_tablet_manager.cc:1434] T de24f0b914304135bebcdb09e9b2f2f9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s
I20251215 14:55:20.352459 9435 tablet_bootstrap.cc:492] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.352617 9435 ts_tablet_manager.cc:1403] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.008s
I20251215 14:55:20.352667 9426 tablet_bootstrap.cc:492] T a1c5659fd65f40b0ab72c164afb8d3fe P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.353785 9435 raft_consensus.cc:359] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.354043 9435 raft_consensus.cc:385] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.354136 9435 raft_consensus.cc:740] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.354447 9435 consensus_queue.cc:260] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.356098 9435 ts_tablet_manager.cc:1434] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
W20251215 14:55:20.356412 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 44786.9us
I20251215 14:55:20.356892 9426 tablet_bootstrap.cc:654] T a1c5659fd65f40b0ab72c164afb8d3fe P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.357132 9435 tablet_bootstrap.cc:492] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.357141 10600 consensus_queue.cc:1048] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.358645 8978 leader_election.cc:304] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:20.359208 10600 raft_consensus.cc:2804] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:20.359279 10600 raft_consensus.cc:493] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:20.359334 10600 raft_consensus.cc:3060] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.361831 10600 raft_consensus.cc:515] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.362381 9435 tablet_bootstrap.cc:654] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.363344 10600 leader_election.cc:290] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.363644 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "032f27e7f6054188a3169a3c10ee4d09" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:20.363605 9427 tablet_bootstrap.cc:492] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
W20251215 14:55:20.364301 8976 leader_election.cc:343] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.364795 9427 ts_tablet_manager.cc:1403] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.051s user 0.012s sys 0.000s
I20251215 14:55:20.366005 9427 raft_consensus.cc:359] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.366289 9427 raft_consensus.cc:385] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.366410 9427 raft_consensus.cc:740] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.366734 9427 consensus_queue.cc:260] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.368016 9427 ts_tablet_manager.cc:1434] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:20.369273 10833 raft_consensus.cc:493] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.369406 10833 raft_consensus.cc:515] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.369920 10833 leader_election.cc:290] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.370021 10833 raft_consensus.cc:493] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.369907 9427 tablet_bootstrap.cc:492] T ee44c7244b68469183a4e45baeaf5df4 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:20.370105 10833 raft_consensus.cc:515] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.370523 10833 leader_election.cc:290] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.371246 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9124dd3d98947b29289e0561976ada4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:20.371632 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9a0c31abcf046c9b76bea3f946ba9fc" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:20.372913 9249 leader_election.cc:343] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:20.373124 9249 leader_election.cc:343] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.372967 10559 raft_consensus.cc:493] T de24f0b914304135bebcdb09e9b2f2f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.373409 10559 raft_consensus.cc:515] T de24f0b914304135bebcdb09e9b2f2f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.373966 10559 leader_election.cc:290] T de24f0b914304135bebcdb09e9b2f2f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.373405 9178 raft_consensus.cc:3060] T 46bd8e49fff5473f8787742f6023ddbe P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.374367 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de24f0b914304135bebcdb09e9b2f2f9" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.374536 9311 raft_consensus.cc:2393] T de24f0b914304135bebcdb09e9b2f2f9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:20.379068 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de24f0b914304135bebcdb09e9b2f2f9" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.379730 9112 leader_election.cc:304] T de24f0b914304135bebcdb09e9b2f2f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:20.380656 10991 raft_consensus.cc:3060] T de24f0b914304135bebcdb09e9b2f2f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.383826 9427 tablet_bootstrap.cc:654] T ee44c7244b68469183a4e45baeaf5df4 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.387734 9435 tablet_bootstrap.cc:492] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.387954 9435 ts_tablet_manager.cc:1403] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.031s user 0.004s sys 0.002s
I20251215 14:55:20.389191 9435 raft_consensus.cc:359] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.389518 9435 raft_consensus.cc:385] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.389604 9435 raft_consensus.cc:740] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.389918 9435 consensus_queue.cc:260] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.390779 9435 ts_tablet_manager.cc:1434] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20251215 14:55:20.392140 9435 tablet_bootstrap.cc:492] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.394958 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb309f7c439740c89470da5636523a69" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:20.395325 9040 raft_consensus.cc:3060] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.397575 10844 raft_consensus.cc:493] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.397707 10844 raft_consensus.cc:515] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.398232 10844 leader_election.cc:290] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.399655 9435 tablet_bootstrap.cc:654] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:20.401083 9248 leader_election.cc:343] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.400352 10991 raft_consensus.cc:2749] T de24f0b914304135bebcdb09e9b2f2f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:20.402549 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "437ccec0421f4bdfb8c7e6a2fcb44bca" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:20.403676 10832 consensus_queue.cc:1048] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:20.405509 10377 leader_election.cc:336] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1f310d741d8247488792985606a1c19e (127.8.121.188:43131): Timed out: connection negotiation to 127.8.121.188:43131 for RPC RequestConsensusVote timed out after 0.533s (ON_OUTBOUND_QUEUE)
I20251215 14:55:20.405710 10377 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:55:20.406087 9427 tablet_bootstrap.cc:492] T ee44c7244b68469183a4e45baeaf5df4 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:20.406203 9427 ts_tablet_manager.cc:1403] T ee44c7244b68469183a4e45baeaf5df4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.037s user 0.005s sys 0.001s
I20251215 14:55:20.406838 9427 raft_consensus.cc:359] T ee44c7244b68469183a4e45baeaf5df4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.406991 9427 raft_consensus.cc:385] T ee44c7244b68469183a4e45baeaf5df4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.407035 9427 raft_consensus.cc:740] T ee44c7244b68469183a4e45baeaf5df4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.407227 9427 consensus_queue.cc:260] T ee44c7244b68469183a4e45baeaf5df4 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.407677 9427 ts_tablet_manager.cc:1434] T ee44c7244b68469183a4e45baeaf5df4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251215 14:55:20.407919 9427 tablet_bootstrap.cc:492] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:20.409487 9427 tablet_bootstrap.cc:654] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.411902 9426 tablet_bootstrap.cc:492] T a1c5659fd65f40b0ab72c164afb8d3fe P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.412037 9426 ts_tablet_manager.cc:1403] T a1c5659fd65f40b0ab72c164afb8d3fe P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.002s
I20251215 14:55:20.412947 9426 raft_consensus.cc:359] T a1c5659fd65f40b0ab72c164afb8d3fe P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.413108 9426 raft_consensus.cc:385] T a1c5659fd65f40b0ab72c164afb8d3fe P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.413161 9426 raft_consensus.cc:740] T a1c5659fd65f40b0ab72c164afb8d3fe P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.413339 9426 consensus_queue.cc:260] T a1c5659fd65f40b0ab72c164afb8d3fe P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.413805 9426 ts_tablet_manager.cc:1434] T a1c5659fd65f40b0ab72c164afb8d3fe P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:20.414052 9426 tablet_bootstrap.cc:492] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.414505 10998 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:55:20.403201 9249 leader_election.cc:343] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.415337 9426 tablet_bootstrap.cc:654] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.415069 9435 tablet_bootstrap.cc:492] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.415531 9435 ts_tablet_manager.cc:1403] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.000s
I20251215 14:55:20.416749 9435 raft_consensus.cc:359] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.417004 9435 raft_consensus.cc:385] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.417097 9435 raft_consensus.cc:740] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.417412 9435 consensus_queue.cc:260] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.418416 9435 ts_tablet_manager.cc:1434] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:20.418846 9435 tablet_bootstrap.cc:492] T f0e8dad82b3e4eff971b7b6845970c4f P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.419590 9427 tablet_bootstrap.cc:492] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:20.419745 9427 ts_tablet_manager.cc:1403] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20251215 14:55:20.402223 9248 leader_election.cc:304] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:20.421228 9427 raft_consensus.cc:359] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.421387 9427 raft_consensus.cc:385] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.421453 9427 raft_consensus.cc:740] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.421641 9427 consensus_queue.cc:260] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.422406 9427 ts_tablet_manager.cc:1434] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:20.422683 9427 tablet_bootstrap.cc:492] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:20.423410 9435 tablet_bootstrap.cc:654] T f0e8dad82b3e4eff971b7b6845970c4f P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.425344 9427 tablet_bootstrap.cc:654] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.427309 10528 raft_consensus.cc:2749] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:20.434741 9426 tablet_bootstrap.cc:492] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.434890 9426 ts_tablet_manager.cc:1403] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20251215 14:55:20.435555 9426 raft_consensus.cc:359] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.435729 9426 raft_consensus.cc:385] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.435779 9426 raft_consensus.cc:740] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.435990 9426 consensus_queue.cc:260] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.436478 9426 ts_tablet_manager.cc:1434] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:20.436751 9426 tablet_bootstrap.cc:492] T 396fe2752398427f840998609beba351 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.438261 9426 tablet_bootstrap.cc:654] T 396fe2752398427f840998609beba351 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.439348 9435 tablet_bootstrap.cc:492] T f0e8dad82b3e4eff971b7b6845970c4f P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.439929 9435 ts_tablet_manager.cc:1403] T f0e8dad82b3e4eff971b7b6845970c4f P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.004s
I20251215 14:55:20.441581 9036 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9a0c31abcf046c9b76bea3f946ba9fc" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.441496 9435 raft_consensus.cc:359] T f0e8dad82b3e4eff971b7b6845970c4f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.441756 9435 raft_consensus.cc:385] T f0e8dad82b3e4eff971b7b6845970c4f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.441771 9036 raft_consensus.cc:2468] T f9a0c31abcf046c9b76bea3f946ba9fc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:20.441843 9435 raft_consensus.cc:740] T f0e8dad82b3e4eff971b7b6845970c4f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.442157 9435 consensus_queue.cc:260] T f0e8dad82b3e4eff971b7b6845970c4f P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.442590 9036 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9124dd3d98947b29289e0561976ada4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.442736 9036 raft_consensus.cc:2468] T e9124dd3d98947b29289e0561976ada4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:20.442951 9435 ts_tablet_manager.cc:1434] T f0e8dad82b3e4eff971b7b6845970c4f P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20251215 14:55:20.443733 9435 tablet_bootstrap.cc:492] T ce147d1fcda2480daa557276c33a6096 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.445531 9036 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "437ccec0421f4bdfb8c7e6a2fcb44bca" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.445674 9036 raft_consensus.cc:2468] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:20.448451 9435 tablet_bootstrap.cc:654] T ce147d1fcda2480daa557276c33a6096 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.452625 9040 raft_consensus.cc:2468] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:20.454208 10528 raft_consensus.cc:493] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.454334 10528 raft_consensus.cc:515] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.454893 10528 leader_election.cc:290] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.455523 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c902ad68a5c448828eb3ac419ffaca81" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:20.456001 9249 leader_election.cc:343] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.459429 9426 tablet_bootstrap.cc:492] T 396fe2752398427f840998609beba351 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.459578 9426 ts_tablet_manager.cc:1403] T 396fe2752398427f840998609beba351 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s
I20251215 14:55:20.459946 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "032f27e7f6054188a3169a3c10ee4d09" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:20.460106 9312 raft_consensus.cc:3060] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.460204 9426 raft_consensus.cc:359] T 396fe2752398427f840998609beba351 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.460348 9426 raft_consensus.cc:385] T 396fe2752398427f840998609beba351 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.460397 9426 raft_consensus.cc:740] T 396fe2752398427f840998609beba351 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.460584 9426 consensus_queue.cc:260] T 396fe2752398427f840998609beba351 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.461045 9426 ts_tablet_manager.cc:1434] T 396fe2752398427f840998609beba351 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:20.461489 9435 tablet_bootstrap.cc:492] T ce147d1fcda2480daa557276c33a6096 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.461671 9435 ts_tablet_manager.cc:1403] T ce147d1fcda2480daa557276c33a6096 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.003s
I20251215 14:55:20.462719 9312 raft_consensus.cc:2468] T 032f27e7f6054188a3169a3c10ee4d09 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:20.462741 9435 raft_consensus.cc:359] T ce147d1fcda2480daa557276c33a6096 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.462991 9435 raft_consensus.cc:385] T ce147d1fcda2480daa557276c33a6096 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.463068 9426 tablet_bootstrap.cc:492] T 6947983b19ee4ca59349979c6662bc1c P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.463083 9435 raft_consensus.cc:740] T ce147d1fcda2480daa557276c33a6096 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.463308 10993 raft_consensus.cc:493] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.463429 10993 raft_consensus.cc:515] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.463430 9435 consensus_queue.cc:260] T ce147d1fcda2480daa557276c33a6096 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.464018 10993 leader_election.cc:290] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.464231 9435 ts_tablet_manager.cc:1434] T ce147d1fcda2480daa557276c33a6096 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:20.464385 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6beaf5ae37ce41fd9123d6b3560351b7" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.464609 9037 raft_consensus.cc:2468] T 6beaf5ae37ce41fd9123d6b3560351b7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:20.464663 9435 tablet_bootstrap.cc:492] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.464882 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6beaf5ae37ce41fd9123d6b3560351b7" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.464972 9112 leader_election.cc:304] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:20.465143 9312 raft_consensus.cc:2468] T 6beaf5ae37ce41fd9123d6b3560351b7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:20.465309 10993 raft_consensus.cc:2804] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:20.465399 10993 raft_consensus.cc:493] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:20.465454 10993 raft_consensus.cc:3060] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.467936 10993 raft_consensus.cc:515] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.468956 10993 leader_election.cc:290] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.468904 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6beaf5ae37ce41fd9123d6b3560351b7" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:20.469444 9435 tablet_bootstrap.cc:654] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.469472 9314 raft_consensus.cc:3060] T 6beaf5ae37ce41fd9123d6b3560351b7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.472066 9314 raft_consensus.cc:2468] T 6beaf5ae37ce41fd9123d6b3560351b7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:20.472728 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6beaf5ae37ce41fd9123d6b3560351b7" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:20.472884 9037 raft_consensus.cc:3060] T 6beaf5ae37ce41fd9123d6b3560351b7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.473531 9115 leader_election.cc:304] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:20.473722 9426 tablet_bootstrap.cc:654] T 6947983b19ee4ca59349979c6662bc1c P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.473868 10993 raft_consensus.cc:2804] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:20.474033 10993 raft_consensus.cc:697] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:20.474313 10993 consensus_queue.cc:237] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.475660 9037 raft_consensus.cc:2468] T 6beaf5ae37ce41fd9123d6b3560351b7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:20.482002 10844 consensus_queue.cc:1048] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.489081 9175 raft_consensus.cc:3060] T 798eb606957b4cf7a737ec1636437581 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.489336 9179 raft_consensus.cc:3060] T 396fe2752398427f840998609beba351 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.492393 10600 consensus_queue.cc:1048] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.492506 10844 consensus_queue.cc:1048] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.493849 9427 tablet_bootstrap.cc:492] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:20.493991 9427 ts_tablet_manager.cc:1403] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.071s user 0.004s sys 0.002s
I20251215 14:55:20.494853 9427 raft_consensus.cc:359] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.495023 9427 raft_consensus.cc:385] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.495069 9427 raft_consensus.cc:740] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.495318 9427 consensus_queue.cc:260] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.496387 9427 ts_tablet_manager.cc:1434] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:20.496680 9427 tablet_bootstrap.cc:492] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:20.497341 9426 tablet_bootstrap.cc:492] T 6947983b19ee4ca59349979c6662bc1c P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.497474 9426 ts_tablet_manager.cc:1403] T 6947983b19ee4ca59349979c6662bc1c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.002s
I20251215 14:55:20.498121 9426 raft_consensus.cc:359] T 6947983b19ee4ca59349979c6662bc1c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.498275 9426 raft_consensus.cc:385] T 6947983b19ee4ca59349979c6662bc1c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.498330 9426 raft_consensus.cc:740] T 6947983b19ee4ca59349979c6662bc1c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.498381 10600 raft_consensus.cc:493] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.498495 10600 raft_consensus.cc:515] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.498502 9426 consensus_queue.cc:260] T 6947983b19ee4ca59349979c6662bc1c P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.498874 9435 tablet_bootstrap.cc:492] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.498950 9426 ts_tablet_manager.cc:1434] T 6947983b19ee4ca59349979c6662bc1c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:20.499044 9435 ts_tablet_manager.cc:1403] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.006s
I20251215 14:55:20.499058 10600 leader_election.cc:290] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.499205 9426 tablet_bootstrap.cc:492] T 394844a49d254112883c40df9821c075 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.499780 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88edc14acdad47a3907078d08e118ce7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:20.500500 8976 leader_election.cc:343] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.500559 9435 raft_consensus.cc:359] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.500787 9426 tablet_bootstrap.cc:654] T 394844a49d254112883c40df9821c075 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.500864 9435 raft_consensus.cc:385] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.500952 9435 raft_consensus.cc:740] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.501015 9427 tablet_bootstrap.cc:654] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.501264 9435 consensus_queue.cc:260] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.502249 9435 ts_tablet_manager.cc:1434] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:20.506704 9435 tablet_bootstrap.cc:492] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.511472 10991 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.511631 10991 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.512028 9435 tablet_bootstrap.cc:654] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.512281 10991 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:20.513266 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:55:20.514124 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:55:20.514241 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:20.514837 10993 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:20.516153 9427 tablet_bootstrap.cc:492] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:20.516373 9427 ts_tablet_manager.cc:1403] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.003s
I20251215 14:55:20.517316 9427 raft_consensus.cc:359] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.517653 9427 raft_consensus.cc:385] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.518087 9427 raft_consensus.cc:740] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.518369 9427 consensus_queue.cc:260] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.519095 9427 ts_tablet_manager.cc:1434] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:20.519471 9427 tablet_bootstrap.cc:492] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:20.523182 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88edc14acdad47a3907078d08e118ce7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.523391 9311 raft_consensus.cc:2468] T 88edc14acdad47a3907078d08e118ce7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:19.364643 10449 rpcz_store.cc:276] 1215 14:55:15.275780 (+ 0us) service_pool.cc:168] Inserting onto call queue
1215 14:55:15.275833 (+ 53us) service_pool.cc:225] Handling call
1215 14:55:18.217871 (+2942038us) raft_consensus.cc:1471] Updating replica for 443 ops
1215 14:55:18.261070 (+ 43199us) raft_consensus.cc:1534] Early marking committed up to index 454
1215 14:55:18.271077 (+ 10007us) raft_consensus.cc:1539] Triggering prepare for 443 ops
1215 14:55:18.271994 (+ 917us) write_op.cc:270] Start()
1215 14:55:18.272115 (+ 121us) write_op.cc:276] Timestamp: P: 1765810508483332 usec, L: 0
1215 14:55:18.272714 (+ 599us) write_op.cc:270] Start()
1215 14:55:18.272773 (+ 59us) write_op.cc:276] Timestamp: P: 1765810508485520 usec, L: 0
1215 14:55:18.273111 (+ 338us) write_op.cc:270] Start()
1215 14:55:18.273138 (+ 27us) write_op.cc:276] Timestamp: P: 1765810508488730 usec, L: 0
1215 14:55:18.273402 (+ 264us) write_op.cc:270] Start()
1215 14:55:18.273537 (+ 135us) write_op.cc:276] Timestamp: P: 1765810508489959 usec, L: 0
1215 14:55:18.273812 (+ 275us) write_op.cc:270] Start()
1215 14:55:18.273859 (+ 47us) write_op.cc:276] Timestamp: P: 1765810508490862 usec, L: 0
1215 14:55:18.274085 (+ 226us) write_op.cc:270] Start()
1215 14:55:18.274130 (+ 45us) write_op.cc:276] Timestamp: P: 1765810508508124 usec, L: 0
1215 14:55:18.274341 (+ 211us) write_op.cc:270] Start()
1215 14:55:18.274414 (+ 73us) write_op.cc:276] Timestamp: P: 1765810508516413 usec, L: 0
1215 14:55:18.274673 (+ 259us) write_op.cc:270] Start()
1215 14:55:18.274721 (+ 48us) write_op.cc:276] Timestamp: P: 1765810508523554 usec, L: 0
1215 14:55:18.274943 (+ 222us) write_op.cc:270] Start()
1215 14:55:18.274995 (+ 52us) write_op.cc:276] Timestamp: P: 1765810508585742 usec, L: 0
1215 14:55:18.275228 (+ 233us) write_op.cc:270] Start()
1215 14:55:18.275276 (+ 48us) write_op.cc:276] Timestamp: P: 1765810508602620 usec, L: 0
1215 14:55:18.275492 (+ 216us) write_op.cc:270] Start()
1215 14:55:18.275542 (+ 50us) write_op.cc:276] Timestamp: P: 1765810508609700 usec, L: 0
1215 14:55:18.275860 (+ 318us) write_op.cc:270] Start()
1215 14:55:18.275884 (+ 24us) write_op.cc:276] Timestamp: P: 1765810508618362 usec, L: 0
1215 14:55:18.276129 (+ 245us) write_op.cc:270] Start()
1215 14:55:18.276151 (+ 22us) write_op.cc:276] Timestamp: P: 1765810508624453 usec, L: 0
1215 14:55:18.283455 (+ 7304us) write_op.cc:270] Start()
1215 14:55:18.283529 (+ 74us) write_op.cc:276] Timestamp: P: 1765810508630245 usec, L: 0
1215 14:55:18.283934 (+ 405us) write_op.cc:270] Start()
1215 14:55:18.283993 (+ 59us) write_op.cc:276] Timestamp: P: 1765810508636125 usec, L: 0
1215 14:55:18.284279 (+ 286us) write_op.cc:270] Start()
1215 14:55:18.284330 (+ 51us) write_op.cc:276] Timestamp: P: 1765810508639754 usec, L: 0
1215 14:55:18.284650 (+ 320us) write_op.cc:270] Start()
1215 14:55:18.284677 (+ 27us) write_op.cc:276] Timestamp: P: 1765810508727750 usec, L: 0
1215 14:55:18.284975 (+ 298us) write_op.cc:270] Start()
1215 14:55:18.284997 (+ 22us) write_op.cc:276] Timestamp: P: 1765810508768921 usec, L: 0
1215 14:55:18.285240 (+ 243us) write_op.cc:270] Start()
1215 14:55:18.285264 (+ 24us) write_op.cc:276] Timestamp: P: 1765810508774312 usec, L: 0
1215 14:55:18.285564 (+ 300us) write_op.cc:270] Start()
1215 14:55:18.285588 (+ 24us) write_op.cc:276] Timestamp: P: 1765810508775536 usec, L: 0
1215 14:55:18.285892 (+ 304us) write_op.cc:270] Start()
1215 14:55:18.285924 (+ 32us) write_op.cc:276] Timestamp: P: 1765810508808395 usec, L: 0
1215 14:55:18.286249 (+ 325us) write_op.cc:270] Start()
1215 14:55:18.286296 (+ 47us) write_op.cc:276] Timestamp: P: 1765810508862052 usec, L: 0
1215 14:55:18.286530 (+ 234us) write_op.cc:270] Start()
1215 14:55:18.286578 (+ 48us) write_op.cc:276] Timestamp: P: 1765810508863188 usec, L: 0
1215 14:55:18.286861 (+ 283us) write_op.cc:270] Start()
1215 14:55:18.286907 (+ 46us) write_op.cc:276] Timestamp: P: 1765810508873219 usec, L: 0
1215 14:55:18.287322 (+ 415us) write_op.cc:270] Start()
1215 14:55:18.287349 (+ 27us) write_op.cc:276] Timestamp: P: 1765810508911584 usec, L: 0
1215 14:55:18.287622 (+ 273us) write_op.cc:270] Start()
1215 14:55:18.287672 (+ 50us) write_op.cc:276] Timestamp: P: 1765810508912394 usec, L: 0
1215 14:55:18.287941 (+ 269us) write_op.cc:270] Start()
1215 14:55:18.287990 (+ 49us) write_op.cc:276] Timestamp: P: 1765810508913021 usec, L: 0
1215 14:55:18.288256 (+ 266us) write_op.cc:270] Start()
1215 14:55:18.288281 (+ 25us) write_op.cc:276] Timestamp: P: 1765810508917029 usec, L: 0
1215 14:55:18.288575 (+ 294us) write_op.cc:270] Start()
1215 14:55:18.288600 (+ 25us) write_op.cc:276] Timestamp: P: 1765810508917886 usec, L: 0
1215 14:55:18.288880 (+ 280us) write_op.cc:270] Start()
1215 14:55:18.288932 (+ 52us) write_op.cc:276] Timestamp: P: 1765810508940962 usec, L: 0
1215 14:55:18.289195 (+ 263us) write_op.cc:270] Start()
1215 14:55:18.289242 (+ 47us) write_op.cc:276] Timestamp: P: 1765810508941567 usec, L: 0
1215 14:55:18.289475 (+ 233us) write_op.cc:270] Start()
1215 14:55:18.289525 (+ 50us) write_op.cc:276] Timestamp: P: 1765810508977033 usec, L: 0
1215 14:55:18.289877 (+ 352us) write_op.cc:270] Start()
1215 14:55:18.289939 (+ 62us) write_op.cc:276] Timestamp: P: 1765810508977738 usec, L: 0
1215 14:55:18.290253 (+ 314us) write_op.cc:270] Start()
1215 14:55:18.290302 (+ 49us) write_op.cc:276] Timestamp: P: 1765810508978337 usec, L: 0
1215 14:55:18.290579 (+ 277us) write_op.cc:270] Start()
1215 14:55:18.290922 (+ 343us) write_op.cc:276] Timestamp: P: 1765810508978836 usec, L: 0
1215 14:55:18.291209 (+ 287us) write_op.cc:270] Start()
1215 14:55:18.291260 (+ 51us) write_op.cc:276] Timestamp: P: 1765810508985484 usec, L: 0
1215 14:55:18.291523 (+ 263us) write_op.cc:270] Start()
1215 14:55:18.291546 (+ 23us) write_op.cc:276] Timestamp: P: 1765810509008562 usec, L: 0
1215 14:55:18.346932 (+ 55386us) write_op.cc:270] Start()
1215 14:55:18.346961 (+ 29us) write_op.cc:276] Timestamp: P: 1765810509023418 usec, L: 0
1215 14:55:18.347125 (+ 164us) write_op.cc:270] Start()
1215 14:55:18.347147 (+ 22us) write_op.cc:276] Timestamp: P: 1765810509037279 usec, L: 0
1215 14:55:18.359563 (+ 12416us) write_op.cc:270] Start()
1215 14:55:18.359593 (+ 30us) write_op.cc:276] Timestamp: P: 1765810509047851 usec, L: 0
1215 14:55:18.359753 (+ 160us) write_op.cc:270] Start()
1215 14:55:18.359772 (+ 19us) write_op.cc:276] Timestamp: P: 1765810509083674 usec, L: 0
1215 14:55:18.359883 (+ 111us) write_op.cc:270] Start()
1215 14:55:18.359903 (+ 20us) write_op.cc:276] Timestamp: P: 1765810509102024 usec, L: 0
1215 14:55:18.360038 (+ 135us) write_op.cc:270] Start()
1215 14:55:18.360054 (+ 16us) write_op.cc:276] Timestamp: P: 1765810509115483 usec, L: 0
1215 14:55:18.360165 (+ 111us) write_op.cc:270] Start()
1215 14:55:18.360182 (+ 17us) write_op.cc:276] Timestamp: P: 1765810509119320 usec, L: 0
1215 14:55:18.360287 (+ 105us) write_op.cc:270] Start()
1215 14:55:18.360308 (+ 21us) write_op.cc:276] Timestamp: P: 1765810509142158 usec, L: 0
1215 14:55:18.360420 (+ 112us) write_op.cc:270] Start()
1215 14:55:18.360436 (+ 16us) write_op.cc:276] Timestamp: P: 1765810509309001 usec, L: 0
1215 14:55:18.360584 (+ 148us) write_op.cc:270] Start()
1215 14:55:18.360602 (+ 18us) write_op.cc:276] Timestamp: P: 1765810509313192 usec, L: 0
1215 14:55:18.360746 (+ 144us) write_op.cc:270] Start()
1215 14:55:18.360764 (+ 18us) write_op.cc:276] Timestamp: P: 1765810509314687 usec, L: 0
1215 14:55:18.360884 (+ 120us) write_op.cc:270] Start()
1215 14:55:18.360900 (+ 16us) write_op.cc:276] Timestamp: P: 1765810509326432 usec, L: 0
1215 14:55:18.361011 (+ 111us) write_op.cc:270] Start()
1215 14:55:18.361029 (+ 18us) write_op.cc:276] Timestamp: P: 1765810509377979 usec, L: 0
1215 14:55:18.361140 (+ 111us) write_op.cc:270] Start()
1215 14:55:18.361157 (+ 17us) write_op.cc:276] Timestamp: P: 1765810509402352 usec, L: 0
1215 14:55:18.361300 (+ 143us) write_op.cc:270] Start()
1215 14:55:18.361320 (+ 20us) write_op.cc:276] Timestamp: P: 1765810509403066 usec, L: 0
1215 14:55:18.361453 (+ 133us) write_op.cc:270] Start()
1215 14:55:18.361472 (+ 19us) write_op.cc:276] Timestamp: P: 1765810509403668 usec, L: 0
1215 14:55:18.361591 (+ 119us) write_op.cc:270] Start()
1215 14:55:18.361617 (+ 26us) write_op.cc:276] Timestamp: P: 1765810509406793 usec, L: 0
1215 14:55:18.361759 (+ 142us) write_op.cc:270] Start()
1215 14:55:18.361783 (+ 24us) write_op.cc:276] Timestamp: P: 1765810509408746 usec, L: 0
1215 14:55:18.361929 (+ 146us) write_op.cc:270] Start()
1215 14:55:18.361948 (+ 19us) write_op.cc:276] Timestamp: P: 1765810509417730 usec, L: 0
1215 14:55:18.362095 (+ 147us) write_op.cc:270] Start()
1215 14:55:18.362114 (+ 19us) write_op.cc:276] Timestamp: P: 1765810509424368 usec, L: 0
1215 14:55:18.362249 (+ 135us) write_op.cc:270] Start()
1215 14:55:18.362268 (+ 19us) write_op.cc:276] Timestamp: P: 1765810509438445 usec, L: 0
1215 14:55:18.362408 (+ 140us) write_op.cc:270] Start()
1215 14:55:18.362427 (+ 19us) write_op.cc:276] Timestamp: P: 1765810509442438 usec, L: 0
1215 14:55:18.362558 (+ 131us) write_op.cc:270] Start()
1215 14:55:18.362602 (+ 44us) write_op.cc:276] Timestamp: P: 1765810509443036 usec, L: 0
1215 14:55:18.362734 (+ 132us) write_op.cc:270] Start()
1215 14:55:18.362751 (+ 17us) write_op.cc:276] Timestamp: P: 1765810509445475 usec, L: 0
1215 14:55:18.362876 (+ 125us) write_op.cc:270] Start()
1215 14:55:18.362894 (+ 18us) write_op.cc:276] Timestamp: P: 1765810509452346 usec, L: 0
1215 14:55:18.363031 (+ 137us) write_op.cc:270] Start()
1215 14:55:18.363058 (+ 27us) write_op.cc:276] Timestamp: P: 1765810509457669 usec, L: 0
1215 14:55:18.380151 (+ 17093us) write_op.cc:270] Start()
1215 14:55:18.380188 (+ 37us) write_op.cc:276] Timestamp: P: 1765810509481619 usec, L: 0
1215 14:55:18.386532 (+ 6344us) write_op.cc:270] Start()
1215 14:55:18.386573 (+ 41us) write_op.cc:276] Timestamp: P: 1765810509668261 usec, L: 0
1215 14:55:18.386791 (+ 218us) write_op.cc:270] Start()
1215 14:55:18.386815 (+ 24us) write_op.cc:276] Timestamp: P: 1765810509691796 usec, L: 0
1215 14:55:18.388363 (+ 1548us) write_op.cc:270] Start()
1215 14:55:18.388392 (+ 29us) write_op.cc:276] Timestamp: P: 1765810509692494 usec, L: 0
1215 14:55:18.388556 (+ 164us) write_op.cc:270] Start()
1215 14:55:18.388575 (+ 19us) write_op.cc:276] Timestamp: P: 1765810509693179 usec, L: 0
1215 14:55:18.388719 (+ 144us) write_op.cc:270] Start()
1215 14:55:18.388738 (+ 19us) write_op.cc:276] Timestamp: P: 1765810509693821 usec, L: 0
1215 14:55:18.388901 (+ 163us) write_op.cc:270] Start()
1215 14:55:18.388921 (+ 20us) write_op.cc:276] Timestamp: P: 1765810509715800 usec, L: 0
1215 14:55:18.389073 (+ 152us) write_op.cc:270] Start()
1215 14:55:18.389091 (+ 18us) write_op.cc:276] Timestamp: P: 1765810509733176 usec, L: 0
1215 14:55:18.389221 (+ 130us) write_op.cc:270] Start()
1215 14:55:18.389239 (+ 18us) write_op.cc:276] Timestamp: P: 1765810509733852 usec, L: 0
1215 14:55:18.389419 (+ 180us) write_op.cc:270] Start()
1215 14:55:18.389439 (+ 20us) write_op.cc:276] Timestamp: P: 1765810509735057 usec, L: 0
1215 14:55:18.389564 (+ 125us) write_op.cc:270] Start()
1215 14:55:18.404646 (+ 15082us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x616000030e30. stack: 00007fb08f348ee6 00007fb08f348ca0 00007fb08e3243ad 0000000000984f94 0000000000984f5d 000000000098492a 00007fb0a4537a29 00007fb09c61701e 00007fb09c5e4ce7 00007fb09c590ccf 00007fb09c58fd8e 00007fb09b1f6681 00007fb09b215dd7 00007fb09b2136c7 00007fb09f08d21d 00007fb099226b46
1215 14:55:18.404688 (+ 42us) write_op.cc:276] Timestamp: P: 1765810509737571 usec, L: 0
1215 14:55:18.404969 (+ 281us) write_op.cc:270] Start()
1215 14:55:18.404995 (+ 26us) write_op.cc:276] Timestamp: P: 1765810509763863 usec, L: 0
1215 14:55:18.405236 (+ 241us) write_op.cc:270] Start()
1215 14:55:18.405262 (+ 26us) write_op.cc:276] Timestamp: P: 1765810509764684 usec, L: 0
1215 14:55:18.405436 (+ 174us) write_op.cc:270] Start()
1215 14:55:18.405456 (+ 20us) write_op.cc:276] Timestamp: P: 1765810509765400 usec, L: 0
1215 14:55:18.405591 (+ 135us) write_op.cc:270] Start()
1215 14:55:18.405610 (+ 19us) write_op.cc:276] Timestamp: P: 1765810509765982 usec, L: 0
1215 14:55:18.405727 (+ 117us) write_op.cc:270] Start()
1215 14:55:18.405744 (+ 17us) write_op.cc:276] Timestamp: P: 1765810509766511 usec, L: 0
1215 14:55:18.409570 (+ 3826us) write_op.cc:270] Start()
1215 14:55:18.409607 (+ 37us) write_op.cc:276] Timestamp: P: 1765810509800144 usec, L: 0
1215 14:55:18.409768 (+ 161us) write_op.cc:270] Start()
1215 14:55:18.409789 (+ 21us) write_op.cc:276] Timestamp: P: 1765810509800771 usec, L: 0
1215 14:55:18.409944 (+ 155us) write_op.cc:270] Start()
1215 14:55:18.409966 (+ 22us) write_op.cc:276] Timestamp: P: 1765810509875271 usec, L: 0
1215 14:55:18.410093 (+ 127us) write_op.cc:270] Start()
1215 14:55:18.410112 (+ 19us) write_op.cc:276] Timestamp: P: 1765810509877812 usec, L: 0
1215 14:55:18.410237 (+ 125us) write_op.cc:270] Start()
1215 14:55:18.410256 (+ 19us) write_op.cc:276] Timestamp: P: 1765810509907734 usec, L: 0
1215 14:55:18.410390 (+ 134us) write_op.cc:270] Start()
1215 14:55:18.410411 (+ 21us) write_op.cc:276] Timestamp: P: 1765810509908372 usec, L: 0
1215 14:55:18.410556 (+ 145us) write_op.cc:270] Start()
1215 14:55:18.410577 (+ 21us) write_op.cc:276] Timestamp: P: 1765810509912399 usec, L: 0
1215 14:55:18.410737 (+ 160us) write_op.cc:270] Start()
1215 14:55:18.410756 (+ 19us) write_op.cc:276] Timestamp: P: 1765810509913026 usec, L: 0
1215 14:55:18.413969 (+ 3213us) write_op.cc:270] Start()
1215 14:55:18.413995 (+ 26us) write_op.cc:276] Timestamp: P: 1765810509913606 usec, L: 0
1215 14:55:18.414122 (+ 127us) write_op.cc:270] Start()
1215 14:55:18.414151 (+ 29us) write_op.cc:276] Timestamp: P: 1765810509920491 usec, L: 0
1215 14:55:18.414363 (+ 212us) write_op.cc:270] Start()
1215 14:55:18.414395 (+ 32us) write_op.cc:276] Timestamp: P: 1765810509930370 usec, L: 0
1215 14:55:18.414583 (+ 188us) write_op.cc:270] Start()
1215 14:55:18.414633 (+ 50us) write_op.cc:276] Timestamp: P: 1765810509936123 usec, L: 0
1215 14:55:18.414768 (+ 135us) write_op.cc:270] Start()
1215 14:55:18.414785 (+ 17us) write_op.cc:276] Timestamp: P: 1765810509963367 usec, L: 0
1215 14:55:18.414917 (+ 132us) write_op.cc:270] Start()
1215 14:55:18.414934 (+ 17us) write_op.cc:276] Timestamp: P: 1765810509966878 usec, L: 0
1215 14:55:18.415046 (+ 112us) write_op.cc:270] Start()
1215 14:55:18.415061 (+ 15us) write_op.cc:276] Timestamp: P: 1765810509969019 usec, L: 0
1215 14:55:18.415181 (+ 120us) write_op.cc:270] Start()
1215 14:55:18.415198 (+ 17us) write_op.cc:276] Timestamp: P: 1765810510026052 usec, L: 0
1215 14:55:18.415342 (+ 144us) write_op.cc:270] Start()
1215 14:55:18.415361 (+ 19us) write_op.cc:276] Timestamp: P: 1765810510026747 usec, L: 0
1215 14:55:18.415507 (+ 146us) write_op.cc:270] Start()
1215 14:55:18.415535 (+ 28us) write_op.cc:276] Timestamp: P: 1765810510027408 usec, L: 0
1215 14:55:18.415701 (+ 166us) write_op.cc:270] Start()
1215 14:55:18.415722 (+ 21us) write_op.cc:276] Timestamp: P: 1765810510027946 usec, L: 0
1215 14:55:18.415859 (+ 137us) write_op.cc:270] Start()
1215 14:55:18.415879 (+ 20us) write_op.cc:276] Timestamp: P: 1765810510028468 usec, L: 0
1215 14:55:18.416013 (+ 134us) write_op.cc:270] Start()
1215 14:55:18.416030 (+ 17us) write_op.cc:276] Timestamp: P: 1765810510039096 usec, L: 0
1215 14:55:18.416168 (+ 138us) write_op.cc:270] Start()
1215 14:55:18.416185 (+ 17us) write_op.cc:276] Timestamp: P: 1765810510041396 usec, L: 0
1215 14:55:18.416329 (+ 144us) write_op.cc:270] Start()
1215 14:55:18.416346 (+ 17us) write_op.cc:276] Timestamp: P: 1765810510106156 usec, L: 0
1215 14:55:18.416464 (+ 118us) write_op.cc:270] Start()
1215 14:55:18.416479 (+ 15us) write_op.cc:276] Timestamp: P: 1765810510133097 usec, L: 0
1215 14:55:18.416599 (+ 120us) write_op.cc:270] Start()
1215 14:55:18.416616 (+ 17us) write_op.cc:276] Timestamp: P: 1765810510133853 usec, L: 0
1215 14:55:18.423436 (+ 6820us) write_op.cc:270] Start()
1215 14:55:18.423468 (+ 32us) write_op.cc:276] Timestamp: P: 1765810510134509 usec, L: 0
1215 14:55:18.423657 (+ 189us) write_op.cc:270] Start()
1215 14:55:18.423696 (+ 39us) write_op.cc:276] Timestamp: P: 1765810510161595 usec, L: 0
1215 14:55:18.425317 (+ 1621us) write_op.cc:270] Start()
1215 14:55:18.425349 (+ 32us) write_op.cc:276] Timestamp: P: 1765810510162315 usec, L: 0
1215 14:55:18.425541 (+ 192us) write_op.cc:270] Start()
1215 14:55:18.425561 (+ 20us) write_op.cc:276] Timestamp: P: 1765810510163529 usec, L: 0
1215 14:55:18.425692 (+ 131us) write_op.cc:270] Start()
1215 14:55:18.425711 (+ 19us) write_op.cc:276] Timestamp: P: 1765810510164465 usec, L: 0
1215 14:55:18.425830 (+ 119us) write_op.cc:270] Start()
1215 14:55:18.425850 (+ 20us) write_op.cc:276] Timestamp: P: 1765810510165421 usec, L: 0
1215 14:55:18.425965 (+ 115us) write_op.cc:270] Start()
1215 14:55:18.425982 (+ 17us) write_op.cc:276] Timestamp: P: 1765810510168220 usec, L: 0
1215 14:55:18.426096 (+ 114us) write_op.cc:270] Start()
1215 14:55:18.426130 (+ 34us) write_op.cc:276] Timestamp: P: 1765810510235226 usec, L: 0
1215 14:55:18.426257 (+ 127us) write_op.cc:270] Start()
1215 14:55:18.426283 (+ 26us) write_op.cc:276] Timestamp: P: 1765810510303459 usec, L: 0
1215 14:55:18.426409 (+ 126us) write_op.cc:270] Start()
1215 14:55:18.426426 (+ 17us) write_op.cc:276] Timestamp: P: 1765810510320934 usec, L: 0
1215 14:55:18.426562 (+ 136us) write_op.cc:270] Start()
1215 14:55:18.426581 (+ 19us) write_op.cc:276] Timestamp: P: 1765810510357939 usec, L: 0
1215 14:55:18.426702 (+ 121us) write_op.cc:270] Start()
1215 14:55:18.426786 (+ 84us) write_op.cc:276] Timestamp: P: 1765810510360575 usec, L: 0
1215 14:55:18.426976 (+ 190us) write_op.cc:270] Start()
1215 14:55:18.426995 (+ 19us) write_op.cc:276] Timestamp: P: 1765810510367661 usec, L: 0
1215 14:55:18.427124 (+ 129us) write_op.cc:270] Start()
1215 14:55:18.427141 (+ 17us) write_op.cc:276] Timestamp: P: 1765810510445274 usec, L: 0
1215 14:55:18.427390 (+ 249us) write_op.cc:270] Start()
1215 14:55:18.427417 (+ 27us) write_op.cc:276] Timestamp: P: 1765810510457762 usec, L: 0
1215 14:55:18.427612 (+ 195us) write_op.cc:270] Start()
1215 14:55:18.427633 (+ 21us) write_op.cc:276] Timestamp: P: 1765810510474558 usec, L: 0
1215 14:55:18.452930 (+ 25297us) write_op.cc:270] Start()
1215 14:55:18.452965 (+ 35us) write_op.cc:276] Timestamp: P: 1765810510477764 usec, L: 0
1215 14:55:18.453196 (+ 231us) write_op.cc:270] Start()
1215 14:55:18.453221 (+ 25us) write_op.cc:276] Timestamp: P: 1765810510509642 usec, L: 0
1215 14:55:18.453423 (+ 202us) write_op.cc:270] Start()
1215 14:55:18.453445 (+ 22us) write_op.cc:276] Timestamp: P: 1765810510523268 usec, L: 0
1215 14:55:18.453611 (+ 166us) write_op.cc:270] Start()
1215 14:55:18.453647 (+ 36us) write_op.cc:276] Timestamp: P: 1765810510656084 usec, L: 0
1215 14:55:18.453792 (+ 145us) write_op.cc:270] Start()
1215 14:55:18.458800 (+ 5008us) write_op.cc:276] Timestamp: P: 1765810510673401 usec, L: 0
1215 14:55:18.459008 (+ 208us) write_op.cc:270] Start()
1215 14:55:18.459030 (+ 22us) write_op.cc:276] Timestamp: P: 1765810510674343 usec, L: 0
1215 14:55:18.459326 (+ 296us) write_op.cc:270] Start()
1215 14:55:18.459356 (+ 30us) write_op.cc:276] Timestamp: P: 1765810510677370 usec, L: 0
1215 14:55:18.459561 (+ 205us) write_op.cc:270] Start()
1215 14:55:18.459615 (+ 54us) write_op.cc:276] Timestamp: P: 1765810510678349 usec, L: 0
1215 14:55:18.459823 (+ 208us) write_op.cc:270] Start()
1215 14:55:18.459846 (+ 23us) write_op.cc:276] Timestamp: P: 1765810510681663 usec, L: 0
1215 14:55:18.459995 (+ 149us) write_op.cc:270] Start()
1215 14:55:18.460015 (+ 20us) write_op.cc:276] Timestamp: P: 1765810510687102 usec, L: 0
1215 14:55:18.460143 (+ 128us) write_op.cc:270] Start()
1215 14:55:18.460163 (+ 20us) write_op.cc:276] Timestamp: P: 1765810510688338 usec, L: 0
1215 14:55:18.460312 (+ 149us) write_op.cc:270] Start()
1215 14:55:18.460333 (+ 21us) write_op.cc:276] Timestamp: P: 1765810510693519 usec, L: 0
1215 14:55:18.460480 (+ 147us) write_op.cc:270] Start()
1215 14:55:18.460500 (+ 20us) write_op.cc:276] Timestamp: P: 1765810510695414 usec, L: 0
1215 14:55:18.460640 (+ 140us) write_op.cc:270] Start()
1215 14:55:18.460660 (+ 20us) write_op.cc:276] Timestamp: P: 1765810510695971 usec, L: 0
1215 14:55:18.460795 (+ 135us) write_op.cc:270] Start()
1215 14:55:18.460814 (+ 19us) write_op.cc:276] Timestamp: P: 1765810510798848 usec, L: 0
1215 14:55:18.460951 (+ 137us) write_op.cc:270] Start()
1215 14:55:18.460970 (+ 19us) write_op.cc:276] Timestamp: P: 1765810510821729 usec, L: 0
1215 14:55:18.461093 (+ 123us) write_op.cc:270] Start()
1215 14:55:18.461113 (+ 20us) write_op.cc:276] Timestamp: P: 1765810510822375 usec, L: 0
1215 14:55:18.461290 (+ 177us) write_op.cc:270] Start()
1215 14:55:18.461311 (+ 21us) write_op.cc:276] Timestamp: P: 1765810510822919 usec, L: 0
1215 14:55:18.461455 (+ 144us) write_op.cc:270] Start()
1215 14:55:18.461474 (+ 19us) write_op.cc:276] Timestamp: P: 1765810510891645 usec, L: 0
1215 14:55:18.461601 (+ 127us) write_op.cc:270] Start()
1215 14:55:18.461619 (+ 18us) write_op.cc:276] Timestamp: P: 1765810510910842 usec, L: 0
1215 14:55:18.461750 (+ 131us) write_op.cc:270] Start()
1215 14:55:18.461768 (+ 18us) write_op.cc:276] Timestamp: P: 1765810510911952 usec, L: 0
1215 14:55:18.461900 (+ 132us) write_op.cc:270] Start()
1215 14:55:18.461920 (+ 20us) write_op.cc:276] Timestamp: P: 1765810510912932 usec, L: 0
1215 14:55:18.462062 (+ 142us) write_op.cc:270] Start()
1215 14:55:18.462081 (+ 19us) write_op.cc:276] Timestamp: P: 1765810510913884 usec, L: 0
1215 14:55:18.462217 (+ 136us) write_op.cc:270] Start()
1215 14:55:18.462236 (+ 19us) write_op.cc:276] Timestamp: P: 1765810510915271 usec, L: 0
1215 14:55:18.462374 (+ 138us) write_op.cc:270] Start()
1215 14:55:18.462394 (+ 20us) write_op.cc:276] Timestamp: P: 1765810510916549 usec, L: 0
1215 14:55:18.485928 (+ 23534us) write_op.cc:270] Start()
1215 14:55:18.485959 (+ 31us) write_op.cc:276] Timestamp: P: 1765810510921849 usec, L: 0
1215 14:55:18.486143 (+ 184us) write_op.cc:270] Start()
1215 14:55:18.486165 (+ 22us) write_op.cc:276] Timestamp: P: 1765810510932214 usec, L: 0
1215 14:55:18.489472 (+ 3307us) write_op.cc:270] Start()
1215 14:55:18.489499 (+ 27us) write_op.cc:276] Timestamp: P: 1765810510956579 usec, L: 0
1215 14:55:18.489697 (+ 198us) write_op.cc:270] Start()
1215 14:55:18.489718 (+ 21us) write_op.cc:276] Timestamp: P: 1765810510968524 usec, L: 0
1215 14:55:18.489847 (+ 129us) write_op.cc:270] Start()
1215 14:55:18.489865 (+ 18us) write_op.cc:276] Timestamp: P: 1765810510972124 usec, L: 0
1215 14:55:18.490001 (+ 136us) write_op.cc:270] Start()
1215 14:55:18.490019 (+ 18us) write_op.cc:276] Timestamp: P: 1765810510979712 usec, L: 0
1215 14:55:18.490165 (+ 146us) write_op.cc:270] Start()
1215 14:55:18.490183 (+ 18us) write_op.cc:276] Timestamp: P: 1765810510981503 usec, L: 0
1215 14:55:18.490291 (+ 108us) write_op.cc:270] Start()
1215 14:55:18.490318 (+ 27us) write_op.cc:276] Timestamp: P: 1765810511001402 usec, L: 0
1215 14:55:18.490434 (+ 116us) write_op.cc:270] Start()
1215 14:55:18.490451 (+ 17us) write_op.cc:276] Timestamp: P: 1765810511008648 usec, L: 0
1215 14:55:18.490572 (+ 121us) write_op.cc:270] Start()
1215 14:55:18.490590 (+ 18us) write_op.cc:276] Timestamp: P: 1765810511009565 usec, L: 0
1215 14:55:18.490712 (+ 122us) write_op.cc:270] Start()
1215 14:55:18.490731 (+ 19us) write_op.cc:276] Timestamp: P: 1765810511011560 usec, L: 0
1215 14:55:18.490854 (+ 123us) write_op.cc:270] Start()
1215 14:55:18.490872 (+ 18us) write_op.cc:276] Timestamp: P: 1765810511046516 usec, L: 0
1215 14:55:18.490986 (+ 114us) write_op.cc:270] Start()
1215 14:55:18.491005 (+ 19us) write_op.cc:276] Timestamp: P: 1765810511047829 usec, L: 0
1215 14:55:18.491121 (+ 116us) write_op.cc:270] Start()
1215 14:55:18.491138 (+ 17us) write_op.cc:276] Timestamp: P: 1765810511048663 usec, L: 0
1215 14:55:18.491318 (+ 180us) write_op.cc:270] Start()
1215 14:55:18.491339 (+ 21us) write_op.cc:276] Timestamp: P: 1765810511052299 usec, L: 0
1215 14:55:18.491467 (+ 128us) write_op.cc:270] Start()
1215 14:55:18.491484 (+ 17us) write_op.cc:276] Timestamp: P: 1765810511064419 usec, L: 0
1215 14:55:18.491615 (+ 131us) write_op.cc:270] Start()
1215 14:55:18.491632 (+ 17us) write_op.cc:276] Timestamp: P: 1765810511065743 usec, L: 0
1215 14:55:18.491741 (+ 109us) write_op.cc:270] Start()
1215 14:55:18.491757 (+ 16us) write_op.cc:276] Timestamp: P: 1765810511066724 usec, L: 0
1215 14:55:18.491898 (+ 141us) write_op.cc:270] Start()
1215 14:55:18.491919 (+ 21us) write_op.cc:276] Timestamp: P: 1765810511067770 usec, L: 0
1215 14:55:18.492040 (+ 121us) write_op.cc:270] Start()
1215 14:55:18.492058 (+ 18us) write_op.cc:276] Timestamp: P: 1765810511068573 usec, L: 0
1215 14:55:18.492183 (+ 125us) write_op.cc:270] Start()
1215 14:55:18.492200 (+ 17us) write_op.cc:276] Timestamp: P: 1765810511070526 usec, L: 0
1215 14:55:18.492337 (+ 137us) write_op.cc:270] Start()
1215 14:55:18.492356 (+ 19us) write_op.cc:276] Timestamp: P: 1765810511082208 usec, L: 0
1215 14:55:18.492489 (+ 133us) write_op.cc:270] Start()
1215 14:55:18.492509 (+ 20us) write_op.cc:276] Timestamp: P: 1765810511086583 usec, L: 0
1215 14:55:18.492633 (+ 124us) write_op.cc:270] Start()
1215 14:55:18.492652 (+ 19us) write_op.cc:276] Timestamp: P: 1765810511090531 usec, L: 0
1215 14:55:18.492805 (+ 153us) write_op.cc:270] Start()
1215 14:55:18.492826 (+ 21us) write_op.cc:276] Timestamp: P: 1765810511094572 usec, L: 0
1215 14:55:18.492960 (+ 134us) write_op.cc:270] Start()
1215 14:55:18.492980 (+ 20us) write_op.cc:276] Timestamp: P: 1765810511102206 usec, L: 0
1215 14:55:18.493110 (+ 130us) write_op.cc:270] Start()
1215 14:55:18.493129 (+ 19us) write_op.cc:276] Timestamp: P: 1765810511109981 usec, L: 0
1215 14:55:18.493260 (+ 131us) write_op.cc:270] Start()
1215 14:55:18.493278 (+ 18us) write_op.cc:276] Timestamp: P: 1765810511117065 usec, L: 0
1215 14:55:18.493421 (+ 143us) write_op.cc:270] Start()
1215 14:55:18.493441 (+ 20us) write_op.cc:276] Timestamp: P: 1765810511129841 usec, L: 0
1215 14:55:18.493597 (+ 156us) write_op.cc:270] Start()
1215 14:55:18.493617 (+ 20us) write_op.cc:276] Timestamp: P: 1765810511136199 usec, L: 0
1215 14:55:18.493743 (+ 126us) write_op.cc:270] Start()
1215 14:55:18.493762 (+ 19us) write_op.cc:276] Timestamp: P: 1765810511142360 usec, L: 0
1215 14:55:18.493887 (+ 125us) write_op.cc:270] Start()
1215 14:55:18.493906 (+ 19us) write_op.cc:276] Timestamp: P: 1765810511144484 usec, L: 0
1215 14:55:18.494066 (+ 160us) write_op.cc:270] Start()
1215 14:55:18.494085 (+ 19us) write_op.cc:276] Timestamp: P: 1765810511149560 usec, L: 0
1215 14:55:18.494217 (+ 132us) write_op.cc:270] Start()
1215 14:55:18.494237 (+ 20us) write_op.cc:276] Timestamp: P: 1765810511150690 usec, L: 0
1215 14:55:18.494390 (+ 153us) write_op.cc:270] Start()
1215 14:55:18.494410 (+ 20us) write_op.cc:276] Timestamp: P: 1765810511154669 usec, L: 0
1215 14:55:18.494544 (+ 134us) write_op.cc:270] Start()
1215 14:55:18.494565 (+ 21us) write_op.cc:276] Timestamp: P: 1765810511155235 usec, L: 0
1215 14:55:18.494709 (+ 144us) write_op.cc:270] Start()
1215 14:55:18.494731 (+ 22us) write_op.cc:276] Timestamp: P: 1765810511167083 usec, L: 0
1215 14:55:18.494860 (+ 129us) write_op.cc:270] Start()
1215 14:55:18.494880 (+ 20us) write_op.cc:276] Timestamp: P: 1765810511172139 usec, L: 0
1215 14:55:18.494996 (+ 116us) write_op.cc:270] Start()
1215 14:55:18.495013 (+ 17us) write_op.cc:276] Timestamp: P: 1765810511178734 usec, L: 0
1215 14:55:18.495135 (+ 122us) write_op.cc:270] Start()
1215 14:55:18.525012 (+ 29877us) write_op.cc:276] Timestamp: P: 1765810511185601 usec, L: 0
1215 14:55:18.525310 (+ 298us) write_op.cc:270] Start()
1215 14:55:18.525347 (+ 37us) write_op.cc:276] Timestamp: P: 1765810511194554 usec, L: 0
1215 14:55:18.525512 (+ 165us) write_op.cc:270] Start()
1215 14:55:18.525535 (+ 23us) write_op.cc:276] Timestamp: P: 1765810511223392 usec, L: 0
1215 14:55:18.525681 (+ 146us) write_op.cc:270] Start()
1215 14:55:18.525703 (+ 22us) write_op.cc:276] Timestamp: P: 1765810511230187 usec, L: 0
1215 14:55:18.525833 (+ 130us) write_op.cc:270] Start()
1215 14:55:18.525853 (+ 20us) write_op.cc:276] Timestamp: P: 1765810511234984 usec, L: 0
1215 14:55:18.525990 (+ 137us) write_op.cc:270] Start()
1215 14:55:18.526011 (+ 21us) write_op.cc:276] Timestamp: P: 1765810511241390 usec, L: 0
1215 14:55:18.526145 (+ 134us) write_op.cc:270] Start()
1215 14:55:18.526164 (+ 19us) write_op.cc:276] Timestamp: P: 1765810511242594 usec, L: 0
1215 14:55:18.526477 (+ 313us) write_op.cc:270] Start()
1215 14:55:18.526506 (+ 29us) write_op.cc:276] Timestamp: P: 1765810511246308 usec, L: 0
1215 14:55:18.526662 (+ 156us) write_op.cc:270] Start()
1215 14:55:18.526685 (+ 23us) write_op.cc:276] Timestamp: P: 1765810511256087 usec, L: 0
1215 14:55:18.526825 (+ 140us) write_op.cc:270] Start()
1215 14:55:18.526846 (+ 21us) write_op.cc:276] Timestamp: P: 1765810511263585 usec, L: 0
1215 14:55:18.526982 (+ 136us) write_op.cc:270]
I20251215 14:55:20.527560 9427 tablet_bootstrap.cc:654] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.528275 10528 raft_consensus.cc:493] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.528421 10528 raft_consensus.cc:515] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.528782 9435 tablet_bootstrap.cc:492] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.529022 9435 ts_tablet_manager.cc:1403] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.001s
I20251215 14:55:20.529065 10528 leader_election.cc:290] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.530128 9435 raft_consensus.cc:359] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.530408 9435 raft_consensus.cc:385] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.530490 9435 raft_consensus.cc:740] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.530822 9435 consensus_queue.cc:260] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.531800 9435 ts_tablet_manager.cc:1434] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:20.532228 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49bba2b78f65470182e1d361eb1272a4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:20.532786 9435 tablet_bootstrap.cc:492] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:20.532743 9249 leader_election.cc:343] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.537935 9435 tablet_bootstrap.cc:654] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.538442 9426 tablet_bootstrap.cc:492] T 394844a49d254112883c40df9821c075 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.538650 9426 ts_tablet_manager.cc:1403] T 394844a49d254112883c40df9821c075 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.008s
I20251215 14:55:20.539440 9426 raft_consensus.cc:359] T 394844a49d254112883c40df9821c075 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.539619 9426 raft_consensus.cc:385] T 394844a49d254112883c40df9821c075 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.539739 9426 raft_consensus.cc:740] T 394844a49d254112883c40df9821c075 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.539974 9426 consensus_queue.cc:260] T 394844a49d254112883c40df9821c075 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.540480 9426 ts_tablet_manager.cc:1434] T 394844a49d254112883c40df9821c075 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:20.540779 9426 tablet_bootstrap.cc:492] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.545248 8978 leader_election.cc:304] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:20.545580 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c902ad68a5c448828eb3ac419ffaca81" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.545662 9426 tablet_bootstrap.cc:654] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.545738 9040 raft_consensus.cc:2468] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:20.545794 10600 raft_consensus.cc:2804] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:20.545887 10600 raft_consensus.cc:697] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:20.546114 10600 consensus_queue.cc:237] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.546782 9427 tablet_bootstrap.cc:492] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:20.546986 9427 ts_tablet_manager.cc:1403] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.007s
I20251215 14:55:20.553181 9435 tablet_bootstrap.cc:492] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.553454 9435 ts_tablet_manager.cc:1403] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.004s
I20251215 14:55:20.554706 9435 raft_consensus.cc:359] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.555033 9435 raft_consensus.cc:385] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.555140 9435 raft_consensus.cc:740] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.555550 9435 consensus_queue.cc:260] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.557286 9435 ts_tablet_manager.cc:1434] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:20.558355 9435 tablet_bootstrap.cc:492] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.561106 9435 tablet_bootstrap.cc:654] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.561089 9426 tablet_bootstrap.cc:492] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.561298 9426 ts_tablet_manager.cc:1403] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.011s
I20251215 14:55:20.562404 9426 raft_consensus.cc:359] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.562655 9426 raft_consensus.cc:385] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.562738 9426 raft_consensus.cc:740] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.563154 9426 consensus_queue.cc:260] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.564460 9426 ts_tablet_manager.cc:1434] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:20.564904 9426 tablet_bootstrap.cc:492] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.567257 9426 tablet_bootstrap.cc:654] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.575922 9435 tablet_bootstrap.cc:492] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.576092 9435 ts_tablet_manager.cc:1403] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.001s
I20251215 14:55:20.576756 9435 raft_consensus.cc:359] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.576910 9435 raft_consensus.cc:385] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.576960 9435 raft_consensus.cc:740] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.577145 9435 consensus_queue.cc:260] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.577572 9435 ts_tablet_manager.cc:1434] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:20.577809 9435 tablet_bootstrap.cc:492] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.579527 9435 tablet_bootstrap.cc:654] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.593786 9426 tablet_bootstrap.cc:492] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.593945 9426 ts_tablet_manager.cc:1403] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.006s
I20251215 14:55:20.596247 9426 raft_consensus.cc:359] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.596436 9426 raft_consensus.cc:385] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.598227 9426 raft_consensus.cc:740] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.598469 9426 consensus_queue.cc:260] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.599001 9426 ts_tablet_manager.cc:1434] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
W20251215 14:55:20.604250 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:20.605913 9426 tablet_bootstrap.cc:492] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.606011 10833 raft_consensus.cc:493] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.606139 10833 raft_consensus.cc:515] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.606689 10833 leader_election.cc:290] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.607594 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "809257b3929a4c2f91132f9315752130" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:20.608116 9249 leader_election.cc:343] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.608952 9426 tablet_bootstrap.cc:654] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.610170 10756 consensus_queue.cc:1048] T de24f0b914304135bebcdb09e9b2f2f9 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.615689 9426 tablet_bootstrap.cc:492] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.615825 9426 ts_tablet_manager.cc:1403] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.001s
I20251215 14:55:20.616554 9426 raft_consensus.cc:359] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.616704 9426 raft_consensus.cc:385] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.616746 9426 raft_consensus.cc:740] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.616914 9426 consensus_queue.cc:260] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.617288 9174 raft_consensus.cc:3060] T df30b9f793bf4232ba848f569100a747 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.617355 9426 ts_tablet_manager.cc:1434] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:20.619741 9426 tablet_bootstrap.cc:492] T 6140a160980d49b09a5fda8475fc144f P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.621889 10833 raft_consensus.cc:493] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.622037 10833 raft_consensus.cc:515] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.622635 10833 leader_election.cc:290] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.623248 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1c989af5bc624699b4cce2b5c95fc90e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:20.623780 10992 raft_consensus.cc:493] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:20.623888 9249 leader_election.cc:343] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.623915 10992 raft_consensus.cc:515] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.624459 10992 leader_election.cc:290] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.624737 9426 tablet_bootstrap.cc:654] T 6140a160980d49b09a5fda8475fc144f P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.625149 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9a0c31abcf046c9b76bea3f946ba9fc" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.625303 9311 raft_consensus.cc:2468] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:20.626211 9115 leader_election.cc:304] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:20.626638 10559 raft_consensus.cc:2804] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:20.626705 10559 raft_consensus.cc:493] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:20.626758 10559 raft_consensus.cc:3060] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.628438 10833 consensus_queue.cc:1048] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.644982 10756 consensus_queue.cc:1048] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.645367 9248 leader_election.cc:304] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:20.648130 10833 raft_consensus.cc:493] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.648496 10833 raft_consensus.cc:515] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.650076 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a856793e8b46cfb42110de5d383ff7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:20.651105 9249 leader_election.cc:343] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.654207 10833 leader_election.cc:290] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.664029 10833 raft_consensus.cc:2804] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:20.664243 10833 raft_consensus.cc:493] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:20.664420 10833 raft_consensus.cc:3060] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.672284 10833 raft_consensus.cc:515] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.674137 9171 raft_consensus.cc:3060] T bee9a28b78184d4893a845120670e302 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.677826 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9a0c31abcf046c9b76bea3f946ba9fc" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:20.689131 10616 consensus_queue.cc:1048] T 307f788967bd48e2b442657806e87fc4 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.107s
I20251215 14:55:20.690546 10863 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.692157 10863 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.692764 10863 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.681339 9426 tablet_bootstrap.cc:492] T 6140a160980d49b09a5fda8475fc144f P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.693411 9426 ts_tablet_manager.cc:1403] T 6140a160980d49b09a5fda8475fc144f P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.074s user 0.016s sys 0.010s
W20251215 14:55:20.693461 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:55:20.691962 9427 raft_consensus.cc:359] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.693830 10833 leader_election.cc:290] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.693884 9427 raft_consensus.cc:385] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.694108 9426 raft_consensus.cc:359] T 6140a160980d49b09a5fda8475fc144f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.694272 9426 raft_consensus.cc:385] T 6140a160980d49b09a5fda8475fc144f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.693941 9427 raft_consensus.cc:740] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.694325 9426 raft_consensus.cc:740] T 6140a160980d49b09a5fda8475fc144f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.694504 9426 consensus_queue.cc:260] T 6140a160980d49b09a5fda8475fc144f P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.694504 9427 consensus_queue.cc:260] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.694922 9427 ts_tablet_manager.cc:1434] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.142s user 0.001s sys 0.001s
I20251215 14:55:20.694936 9426 ts_tablet_manager.cc:1434] T 6140a160980d49b09a5fda8475fc144f P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:20.695186 9426 tablet_bootstrap.cc:492] T eb309f7c439740c89470da5636523a69 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.695727 9427 tablet_bootstrap.cc:492] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:20.696767 9426 tablet_bootstrap.cc:654] T eb309f7c439740c89470da5636523a69 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.697494 9427 tablet_bootstrap.cc:654] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:20.705658 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 60337.1us
I20251215 14:55:20.706804 9248 leader_election.cc:304] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:20.713106 10844 raft_consensus.cc:2804] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:20.713238 10844 raft_consensus.cc:493] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:20.713301 10844 raft_consensus.cc:3060] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.713752 10635 consensus_queue.cc:1048] T a7cb14a555914e25a50d98d13267c296 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.716173 10844 raft_consensus.cc:515] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.716843 10844 leader_election.cc:290] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.718897 9248 leader_election.cc:304] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:20.721858 10635 raft_consensus.cc:2804] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:20.721947 10635 raft_consensus.cc:493] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:20.722019 10635 raft_consensus.cc:3060] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.724654 10635 raft_consensus.cc:515] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.725317 10635 leader_election.cc:290] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.727190 9435 tablet_bootstrap.cc:492] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.729621 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "437ccec0421f4bdfb8c7e6a2fcb44bca" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:20.729800 9178 raft_consensus.cc:3060] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.730494 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9124dd3d98947b29289e0561976ada4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:20.734282 10600 raft_consensus.cc:493] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.734491 10600 raft_consensus.cc:515] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.737346 10600 leader_election.cc:290] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.743964 9427 tablet_bootstrap.cc:492] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:20.744211 9427 ts_tablet_manager.cc:1403] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.049s user 0.007s sys 0.003s
I20251215 14:55:20.745024 9427 raft_consensus.cc:359] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.745289 9427 raft_consensus.cc:385] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.745386 9427 raft_consensus.cc:740] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.744506 10635 consensus_queue.cc:1048] T 798eb606957b4cf7a737ec1636437581 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.745752 9427 consensus_queue.cc:260] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:20.744856 9249 leader_election.cc:343] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.745249 10844 consensus_queue.cc:1048] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.746798 9427 ts_tablet_manager.cc:1434] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:20.747058 9435 ts_tablet_manager.cc:1403] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.169s user 0.025s sys 0.041s
I20251215 14:55:20.747413 9427 tablet_bootstrap.cc:492] T 4167c404f73e484abcb2e5b30431b28c P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:20.747795 10559 raft_consensus.cc:515] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.749361 9435 raft_consensus.cc:359] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.749722 9435 raft_consensus.cc:385] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.749799 9435 raft_consensus.cc:740] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.750427 9178 raft_consensus.cc:2468] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:20.752178 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49bba2b78f65470182e1d361eb1272a4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:20.752717 9427 tablet_bootstrap.cc:654] T 4167c404f73e484abcb2e5b30431b28c P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.752867 9249 leader_election.cc:304] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:20.753137 10528 consensus_queue.cc:1048] T bee9a28b78184d4893a845120670e302 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.753517 10528 raft_consensus.cc:2804] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:20.753613 10528 raft_consensus.cc:697] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
W20251215 14:55:20.753777 8976 leader_election.cc:343] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.753829 10528 consensus_queue.cc:237] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.750064 9435 consensus_queue.cc:260] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.754259 9426 tablet_bootstrap.cc:492] T eb309f7c439740c89470da5636523a69 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.754374 9426 ts_tablet_manager.cc:1403] T eb309f7c439740c89470da5636523a69 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.059s user 0.008s sys 0.011s
I20251215 14:55:20.755036 9426 raft_consensus.cc:359] T eb309f7c439740c89470da5636523a69 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.755196 9426 raft_consensus.cc:385] T eb309f7c439740c89470da5636523a69 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.755249 9426 raft_consensus.cc:740] T eb309f7c439740c89470da5636523a69 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.755626 9435 ts_tablet_manager.cc:1434] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20251215 14:55:20.755709 9426 consensus_queue.cc:260] T eb309f7c439740c89470da5636523a69 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.755618 10559 leader_election.cc:290] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.756314 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9a0c31abcf046c9b76bea3f946ba9fc" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:20.756511 9311 raft_consensus.cc:2393] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:20.756174 9426 ts_tablet_manager.cc:1434] T eb309f7c439740c89470da5636523a69 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:20.759641 10844 consensus_queue.cc:1048] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.759878 10835 raft_consensus.cc:493] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.759920 9435 tablet_bootstrap.cc:492] T e79295168c8b456ba4fdc2379fbd0961 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.760008 10835 raft_consensus.cc:515] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.760740 10835 leader_election.cc:290] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.761049 9426 tablet_bootstrap.cc:492] T 032f27e7f6054188a3169a3c10ee4d09 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:20.762570 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 112612us
I20251215 14:55:20.762890 9426 tablet_bootstrap.cc:654] T 032f27e7f6054188a3169a3c10ee4d09 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.763609 9177 raft_consensus.cc:2393] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:20.764526 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06cb17538a7541358548f25303e91d37" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:20.765053 8976 leader_election.cc:343] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.766403 8978 leader_election.cc:304] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:20.766484 9427 tablet_bootstrap.cc:492] T 4167c404f73e484abcb2e5b30431b28c P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:20.767326 9427 ts_tablet_manager.cc:1403] T 4167c404f73e484abcb2e5b30431b28c P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.001s
I20251215 14:55:20.768151 9427 raft_consensus.cc:359] T 4167c404f73e484abcb2e5b30431b28c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.774717 9435 tablet_bootstrap.cc:654] T e79295168c8b456ba4fdc2379fbd0961 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.768603 10756 raft_consensus.cc:2804] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:20.775501 10756 raft_consensus.cc:493] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:20.775586 10756 raft_consensus.cc:3060] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.778273 10756 raft_consensus.cc:515] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.775055 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9a0c31abcf046c9b76bea3f946ba9fc" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.779023 9040 raft_consensus.cc:2468] T f9a0c31abcf046c9b76bea3f946ba9fc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:20.783535 10756 leader_election.cc:290] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:20.784544 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88edc14acdad47a3907078d08e118ce7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:20.785812 8976 leader_election.cc:343] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.786486 9427 raft_consensus.cc:385] T 4167c404f73e484abcb2e5b30431b28c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.786641 9427 raft_consensus.cc:740] T 4167c404f73e484abcb2e5b30431b28c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.786877 9427 consensus_queue.cc:260] T 4167c404f73e484abcb2e5b30431b28c P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.787464 9427 ts_tablet_manager.cc:1434] T 4167c404f73e484abcb2e5b30431b28c P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.020s user 0.001s sys 0.000s
I20251215 14:55:20.788586 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9a0c31abcf046c9b76bea3f946ba9fc" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:20.788727 9037 raft_consensus.cc:3060] T f9a0c31abcf046c9b76bea3f946ba9fc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.791043 9427 tablet_bootstrap.cc:492] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:20.792109 9037 raft_consensus.cc:2468] T f9a0c31abcf046c9b76bea3f946ba9fc P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:20.793008 10835 raft_consensus.cc:493] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.793529 10835 raft_consensus.cc:515] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.794101 10835 leader_election.cc:290] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.794313 9427 tablet_bootstrap.cc:654] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.801401 9435 tablet_bootstrap.cc:492] T e79295168c8b456ba4fdc2379fbd0961 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:20.806098 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "809257b3929a4c2f91132f9315752130" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:20.806878 8976 leader_election.cc:343] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.802563 9435 ts_tablet_manager.cc:1403] T e79295168c8b456ba4fdc2379fbd0961 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.043s user 0.007s sys 0.000s
I20251215 14:55:20.808313 9426 tablet_bootstrap.cc:492] T 032f27e7f6054188a3169a3c10ee4d09 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.808449 9426 ts_tablet_manager.cc:1403] T 032f27e7f6054188a3169a3c10ee4d09 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.047s user 0.004s sys 0.006s
W20251215 14:55:20.808925 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 63419.9us
I20251215 14:55:20.809183 9248 leader_election.cc:304] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:20.809196 9426 raft_consensus.cc:359] T 032f27e7f6054188a3169a3c10ee4d09 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.809343 9426 raft_consensus.cc:385] T 032f27e7f6054188a3169a3c10ee4d09 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.809391 9426 raft_consensus.cc:740] T 032f27e7f6054188a3169a3c10ee4d09 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.809463 10635 raft_consensus.cc:2804] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:20.809574 10635 raft_consensus.cc:697] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:20.809566 9426 consensus_queue.cc:260] T 032f27e7f6054188a3169a3c10ee4d09 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.809784 10635 consensus_queue.cc:237] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.810050 9426 ts_tablet_manager.cc:1434] T 032f27e7f6054188a3169a3c10ee4d09 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:20.811724 9112 leader_election.cc:304] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters: e89303a500544272b601d7c29be802b4
I20251215 14:55:20.812316 10992 raft_consensus.cc:2804] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:20.812501 10992 raft_consensus.cc:697] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:20.812743 10992 consensus_queue.cc:237] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.817380 10833 consensus_queue.cc:1048] T 14ac26b3a02449f8a7588151abe7ae10 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.818326 9248 leader_election.cc:304] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:20.819947 10833 raft_consensus.cc:2804] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:20.820058 10833 raft_consensus.cc:493] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:20.820129 10833 raft_consensus.cc:3060] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.822726 10833 raft_consensus.cc:515] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.825138 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c902ad68a5c448828eb3ac419ffaca81" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:20.825860 9249 leader_election.cc:343] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.826148 10833 leader_election.cc:290] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.828337 9033 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9124dd3d98947b29289e0561976ada4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:20.828544 9033 raft_consensus.cc:3060] T e9124dd3d98947b29289e0561976ada4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.828716 9032 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "437ccec0421f4bdfb8c7e6a2fcb44bca" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:20.828874 9032 raft_consensus.cc:3060] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.830210 9041 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "809257b3929a4c2f91132f9315752130" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.830399 9041 raft_consensus.cc:2468] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:20.830677 9039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1c989af5bc624699b4cce2b5c95fc90e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.831481 9031 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a856793e8b46cfb42110de5d383ff7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.831578 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9a0c31abcf046c9b76bea3f946ba9fc" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:20.831758 9042 raft_consensus.cc:2393] T f9a0c31abcf046c9b76bea3f946ba9fc P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:20.832638 9032 raft_consensus.cc:2468] T 437ccec0421f4bdfb8c7e6a2fcb44bca P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:20.832963 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c902ad68a5c448828eb3ac419ffaca81" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:20.833122 9024 raft_consensus.cc:3060] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.836138 9024 raft_consensus.cc:2468] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:20.837643 10833 raft_consensus.cc:493] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.837793 10833 raft_consensus.cc:515] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.838323 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49bba2b78f65470182e1d361eb1272a4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.838419 10833 leader_election.cc:290] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.838487 9037 raft_consensus.cc:2468] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:20.838884 10528 raft_consensus.cc:493] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.839020 10528 raft_consensus.cc:515] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.839658 10528 leader_election.cc:290] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.840675 9033 raft_consensus.cc:2468] T e9124dd3d98947b29289e0561976ada4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:20.840961 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6947983b19ee4ca59349979c6662bc1c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:20.841140 9171 raft_consensus.cc:2468] T 6947983b19ee4ca59349979c6662bc1c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:20.841738 9249 leader_election.cc:304] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:20.841981 10635 raft_consensus.cc:2804] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:20.842141 10635 raft_consensus.cc:493] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:20.842331 10635 raft_consensus.cc:3060] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.842443 9426 tablet_bootstrap.cc:492] T a7cb14a555914e25a50d98d13267c296 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.844170 9426 tablet_bootstrap.cc:654] T a7cb14a555914e25a50d98d13267c296 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.845204 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4cff0ed3782446397dbae8a2da52ed7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:20.845386 9178 raft_consensus.cc:2468] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:20.845877 9249 leader_election.cc:304] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:20.846135 11039 raft_consensus.cc:2804] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 14:55:20.846216 11039 raft_consensus.cc:493] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:20.846289 11039 raft_consensus.cc:3060] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:20.850890 10635 raft_consensus.cc:515] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.853140 10635 leader_election.cc:290] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.854209 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6947983b19ee4ca59349979c6662bc1c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:20.854439 9179 raft_consensus.cc:3060] T 6947983b19ee4ca59349979c6662bc1c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.856879 9426 tablet_bootstrap.cc:492] T a7cb14a555914e25a50d98d13267c296 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.857030 9426 ts_tablet_manager.cc:1403] T a7cb14a555914e25a50d98d13267c296 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.003s
I20251215 14:55:20.857749 9426 raft_consensus.cc:359] T a7cb14a555914e25a50d98d13267c296 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.857897 9426 raft_consensus.cc:385] T a7cb14a555914e25a50d98d13267c296 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.857944 9426 raft_consensus.cc:740] T a7cb14a555914e25a50d98d13267c296 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.859001 9179 raft_consensus.cc:2468] T 6947983b19ee4ca59349979c6662bc1c P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:20.859591 9249 leader_election.cc:304] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:20.859966 10635 raft_consensus.cc:2804] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:20.860155 10635 raft_consensus.cc:697] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:20.860417 10635 consensus_queue.cc:237] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.861491 10528 raft_consensus.cc:493] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.861608 10528 raft_consensus.cc:515] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.862082 10528 leader_election.cc:290] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.862598 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee44c7244b68469183a4e45baeaf5df4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:20.863391 9249 leader_election.cc:343] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.868827 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49bba2b78f65470182e1d361eb1272a4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.869028 9314 raft_consensus.cc:2468] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:20.869715 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06cb17538a7541358548f25303e91d37" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.869891 9314 raft_consensus.cc:2468] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:20.870421 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88edc14acdad47a3907078d08e118ce7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:20.870564 9314 raft_consensus.cc:3060] T 88edc14acdad47a3907078d08e118ce7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.858146 9426 consensus_queue.cc:260] T a7cb14a555914e25a50d98d13267c296 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.873247 9426 ts_tablet_manager.cc:1434] T a7cb14a555914e25a50d98d13267c296 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.016s user 0.001s sys 0.002s
I20251215 14:55:20.873924 9314 raft_consensus.cc:2468] T 88edc14acdad47a3907078d08e118ce7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:20.890518 9427 tablet_bootstrap.cc:492] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:20.890676 9427 ts_tablet_manager.cc:1403] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.100s user 0.006s sys 0.007s
I20251215 14:55:20.891294 9435 raft_consensus.cc:359] T e79295168c8b456ba4fdc2379fbd0961 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.891574 9435 raft_consensus.cc:385] T e79295168c8b456ba4fdc2379fbd0961 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.891681 9435 raft_consensus.cc:740] T e79295168c8b456ba4fdc2379fbd0961 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.891713 9427 raft_consensus.cc:359] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.891870 9427 raft_consensus.cc:385] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.891920 9427 raft_consensus.cc:740] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.892097 9435 consensus_queue.cc:260] T e79295168c8b456ba4fdc2379fbd0961 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.892134 9427 consensus_queue.cc:260] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.892730 9435 ts_tablet_manager.cc:1434] T e79295168c8b456ba4fdc2379fbd0961 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.084s user 0.002s sys 0.000s
I20251215 14:55:20.893078 9435 tablet_bootstrap.cc:492] T 18054b180c77403387d15fc6ee42f58f P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:20.900447 11030 consensus_queue.cc:1048] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.905421 11039 raft_consensus.cc:515] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.905838 11037 raft_consensus.cc:493] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.905982 11037 raft_consensus.cc:515] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.906548 11037 leader_election.cc:290] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.906667 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4cff0ed3782446397dbae8a2da52ed7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:20.906863 9178 raft_consensus.cc:3060] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:20.907153 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0e8dad82b3e4eff971b7b6845970c4f" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:20.907639 8976 leader_election.cc:343] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:20.908568 9427 ts_tablet_manager.cc:1434] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.018s user 0.001s sys 0.001s
I20251215 14:55:20.908871 9427 tablet_bootstrap.cc:492] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:20.909523 9178 raft_consensus.cc:2468] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 2.
I20251215 14:55:20.911513 9249 leader_election.cc:304] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:20.912463 10528 raft_consensus.cc:2804] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 14:55:20.912591 10528 raft_consensus.cc:697] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [term 2 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:20.912814 10528 consensus_queue.cc:237] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.916371 9427 tablet_bootstrap.cc:654] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.919415 9426 tablet_bootstrap.cc:492] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.921720 9426 tablet_bootstrap.cc:654] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:20.923005 8976 consensus_peers.cc:597] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:20.927531 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "809257b3929a4c2f91132f9315752130" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.927742 9314 raft_consensus.cc:2468] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:20.931773 11039 leader_election.cc:290] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:20.932422 9179 raft_consensus.cc:3060] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.934317 9435 tablet_bootstrap.cc:654] T 18054b180c77403387d15fc6ee42f58f P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:20.934964 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 3cdfcddd91fe47de8fd14dc718f421a6 (table default.Table_aba7a90daaf544eb972bd7349f27ae63 [id=2bd880b71b174f528054fbc22143c01f], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3cdfcddd91fe47de8fd14dc718f421a6 consensus state has no leader
I20251215 14:55:20.936884 11030 consensus_queue.cc:1048] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:20.940275 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0e8dad82b3e4eff971b7b6845970c4f" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:20.940510 9314 raft_consensus.cc:2468] T f0e8dad82b3e4eff971b7b6845970c4f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:20.941816 9426 tablet_bootstrap.cc:492] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.941954 9426 ts_tablet_manager.cc:1403] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.003s
I20251215 14:55:20.942684 9426 raft_consensus.cc:359] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.942858 9426 raft_consensus.cc:385] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.942914 9426 raft_consensus.cc:740] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.943140 9426 consensus_queue.cc:260] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:20.943651 9426 ts_tablet_manager.cc:1434] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:20.943938 9426 tablet_bootstrap.cc:492] T c902ad68a5c448828eb3ac419ffaca81 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:20.945889 9426 tablet_bootstrap.cc:654] T c902ad68a5c448828eb3ac419ffaca81 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.949586 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6947983b19ee4ca59349979c6662bc1c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.950565 9025 raft_consensus.cc:2468] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:20.949946 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4cff0ed3782446397dbae8a2da52ed7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.950883 9029 raft_consensus.cc:2468] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:20.951328 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6947983b19ee4ca59349979c6662bc1c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:20.951731 9029 raft_consensus.cc:3060] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:20.953291 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee44c7244b68469183a4e45baeaf5df4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:20.953608 9025 raft_consensus.cc:2468] T ee44c7244b68469183a4e45baeaf5df4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:20.953806 9427 tablet_bootstrap.cc:492] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:20.953956 9427 ts_tablet_manager.cc:1403] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.045s user 0.001s sys 0.009s
I20251215 14:55:20.967067 9029 raft_consensus.cc:2468] T 6947983b19ee4ca59349979c6662bc1c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:20.967044 9427 raft_consensus.cc:359] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.967326 9427 raft_consensus.cc:385] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.967417 9427 raft_consensus.cc:740] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:20.967640 9427 consensus_queue.cc:260] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.968106 9427 ts_tablet_manager.cc:1434] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.014s user 0.003s sys 0.000s
I20251215 14:55:20.968447 9427 tablet_bootstrap.cc:492] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:20.970391 9427 tablet_bootstrap.cc:654] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:20.971803 11030 consensus_queue.cc:1048] T 07fafc0eab704e42a793eeb32ac9a7d6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20251215 14:55:20.983973 9427 tablet_bootstrap.cc:492] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:20.984408 9427 ts_tablet_manager.cc:1403] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.000s
I20251215 14:55:20.986807 9427 raft_consensus.cc:359] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.988270 9427 raft_consensus.cc:385] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:20.988837 9427 raft_consensus.cc:740] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
W20251215 14:55:20.990131 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:55:20.990317 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:20.990103 9427 consensus_queue.cc:260] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:20.990692 10756 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:20.991701 9427 ts_tablet_manager.cc:1434] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20251215 14:55:20.994172 9426 tablet_bootstrap.cc:492] T c902ad68a5c448828eb3ac419ffaca81 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:20.994259 10992 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:20.997525 9426 ts_tablet_manager.cc:1403] T c902ad68a5c448828eb3ac419ffaca81 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.001s
I20251215 14:55:20.997541 10992 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.001006 9435 tablet_bootstrap.cc:492] T 18054b180c77403387d15fc6ee42f58f P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:21.001261 9435 ts_tablet_manager.cc:1403] T 18054b180c77403387d15fc6ee42f58f P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.108s user 0.004s sys 0.000s
I20251215 14:55:21.004854 9426 raft_consensus.cc:359] T c902ad68a5c448828eb3ac419ffaca81 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.005030 9426 raft_consensus.cc:385] T c902ad68a5c448828eb3ac419ffaca81 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.005081 9426 raft_consensus.cc:740] T c902ad68a5c448828eb3ac419ffaca81 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.005292 9426 consensus_queue.cc:260] T c902ad68a5c448828eb3ac419ffaca81 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.005439 10992 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.007228 10832 raft_consensus.cc:493] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.008805 10833 consensus_queue.cc:1048] T df30b9f793bf4232ba848f569100a747 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:21.009691 10992 raft_consensus.cc:493] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.009820 10992 raft_consensus.cc:515] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.010368 10992 leader_election.cc:290] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.010471 10992 raft_consensus.cc:493] T eb309f7c439740c89470da5636523a69 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.010557 10992 raft_consensus.cc:515] T eb309f7c439740c89470da5636523a69 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.010723 11039 raft_consensus.cc:493] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.010831 11039 raft_consensus.cc:515] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.010988 10992 leader_election.cc:290] T eb309f7c439740c89470da5636523a69 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.011340 11039 leader_election.cc:290] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.011525 9248 leader_election.cc:304] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.011785 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6be5f3269d9147d780f782bb5665b8b6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.011942 9314 raft_consensus.cc:2468] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:21.011942 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb309f7c439740c89470da5636523a69" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.012339 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4167c404f73e484abcb2e5b30431b28c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:21.012434 9426 ts_tablet_manager.cc:1434] T c902ad68a5c448828eb3ac419ffaca81 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s
I20251215 14:55:21.012714 9426 tablet_bootstrap.cc:492] T 9e317c8dc24e481abb709e932fa39c29 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:21.012764 9115 leader_election.cc:304] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:21.012975 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4cff0ed3782446397dbae8a2da52ed7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:21.013103 10559 raft_consensus.cc:2804] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:21.013170 10559 raft_consensus.cc:493] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.013231 10559 raft_consensus.cc:3060] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:21.013509 9248 leader_election.cc:343] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.013597 9248 leader_election.cc:304] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:21.014317 10756 consensus_queue.cc:1048] T 396fe2752398427f840998609beba351 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20251215 14:55:21.014848 8978 leader_election.cc:304] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.015309 8978 leader_election.cc:304] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.015666 8978 leader_election.cc:304] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.015928 11039 raft_consensus.cc:2804] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:21.016055 11039 raft_consensus.cc:493] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.015904 10832 raft_consensus.cc:515] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.016002 10559 raft_consensus.cc:515] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.016122 11039 raft_consensus.cc:3060] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.016160 10835 raft_consensus.cc:2804] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:21.016682 9029 raft_consensus.cc:3060] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:21.016844 10559 leader_election.cc:290] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.016877 10833 raft_consensus.cc:2749] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:21.017046 10833 consensus_queue.cc:1048] T 745482d5b350403c97621609e6935340 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:21.017733 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6be5f3269d9147d780f782bb5665b8b6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:21.017887 9314 raft_consensus.cc:3060] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.019208 11037 raft_consensus.cc:2804] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20251215 14:55:21.019620 9249 leader_election.cc:343] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.020509 9314 raft_consensus.cc:2468] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:21.020750 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6be5f3269d9147d780f782bb5665b8b6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:21.020943 9179 raft_consensus.cc:2393] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:21.020963 9115 leader_election.cc:304] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:21.021493 11037 raft_consensus.cc:493] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.021611 11037 raft_consensus.cc:3060] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.021586 10559 raft_consensus.cc:2804] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:21.021718 10559 raft_consensus.cc:697] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:21.022006 10835 raft_consensus.cc:493] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.021970 10559 consensus_queue.cc:237] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.022122 10835 raft_consensus.cc:3060] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.023077 11039 raft_consensus.cc:515] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.024329 11039 leader_election.cc:290] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:21.024451 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:21.025059 10832 leader_election.cc:290] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:21.025367 9248 leader_election.cc:343] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.025447 10756 raft_consensus.cc:2804] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:21.025481 9248 leader_election.cc:304] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:21.025904 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "809257b3929a4c2f91132f9315752130" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:21.026415 9249 leader_election.cc:343] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.026683 10835 raft_consensus.cc:515] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.027099 10833 raft_consensus.cc:2749] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:21.027535 9248 leader_election.cc:304] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:21.027772 10833 raft_consensus.cc:2749] T f9a0c31abcf046c9b76bea3f946ba9fc P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:21.029011 9426 tablet_bootstrap.cc:654] T 9e317c8dc24e481abb709e932fa39c29 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.028970 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06cb17538a7541358548f25303e91d37" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:21.029711 9029 raft_consensus.cc:2468] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 2.
W20251215 14:55:21.030597 8976 leader_election.cc:343] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.030829 9248 leader_election.cc:304] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.031379 10756 raft_consensus.cc:697] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:21.031680 10756 consensus_queue.cc:237] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.034729 11037 raft_consensus.cc:515] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.035917 11037 leader_election.cc:290] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.036981 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49bba2b78f65470182e1d361eb1272a4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:21.037662 8976 leader_election.cc:343] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.038127 8978 leader_election.cc:304] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.038734 10832 raft_consensus.cc:2804] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:21.038832 10832 raft_consensus.cc:493] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.038928 10832 raft_consensus.cc:3060] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.041577 10832 raft_consensus.cc:515] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.042369 10832 leader_election.cc:290] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.043254 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "809257b3929a4c2f91132f9315752130" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:21.043830 8976 leader_election.cc:343] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.044039 10835 leader_election.cc:290] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.044759 11030 consensus_queue.cc:1048] T 7fd7f0ff96c54765926c6d45ea6a20a5 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:21.046998 11030 consensus_queue.cc:1048] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:21.047371 10833 raft_consensus.cc:2804] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:21.047535 10833 raft_consensus.cc:697] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:21.047796 10833 consensus_queue.cc:237] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.048295 8978 leader_election.cc:304] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.049186 10832 raft_consensus.cc:2804] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:21.049371 10832 raft_consensus.cc:493] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.049595 10832 raft_consensus.cc:3060] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.051415 9427 tablet_bootstrap.cc:492] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:21.052819 9248 leader_election.cc:304] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.053695 9427 tablet_bootstrap.cc:654] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.056198 11039 raft_consensus.cc:2804] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:21.056299 11039 raft_consensus.cc:493] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.056360 11039 raft_consensus.cc:3060] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.059445 11039 raft_consensus.cc:515] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.060570 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49bba2b78f65470182e1d361eb1272a4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:21.061153 9249 leader_election.cc:343] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.061357 11039 leader_election.cc:290] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.061774 9248 leader_election.cc:304] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.062685 9179 raft_consensus.cc:3060] T 394844a49d254112883c40df9821c075 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.064586 9426 tablet_bootstrap.cc:492] T 9e317c8dc24e481abb709e932fa39c29 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:21.064709 9426 ts_tablet_manager.cc:1403] T 9e317c8dc24e481abb709e932fa39c29 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.001s
I20251215 14:55:21.065629 9426 raft_consensus.cc:359] T 9e317c8dc24e481abb709e932fa39c29 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.066381 9426 raft_consensus.cc:385] T 9e317c8dc24e481abb709e932fa39c29 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.066481 9426 raft_consensus.cc:740] T 9e317c8dc24e481abb709e932fa39c29 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.066660 9426 consensus_queue.cc:260] T 9e317c8dc24e481abb709e932fa39c29 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.066373 11037 consensus_queue.cc:1048] T 394844a49d254112883c40df9821c075 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:21.067097 9426 ts_tablet_manager.cc:1434] T 9e317c8dc24e481abb709e932fa39c29 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:21.067382 9426 tablet_bootstrap.cc:492] T e9124dd3d98947b29289e0561976ada4 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:21.068985 9426 tablet_bootstrap.cc:654] T e9124dd3d98947b29289e0561976ada4 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.070228 11071 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40747def373e4b19abfa5d21ba0a4315)
I20251215 14:55:21.070657 11071 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:21.071979 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:55:21.074259 11071 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:21.077704 9179 raft_consensus.cc:3060] T a1c5659fd65f40b0ab72c164afb8d3fe P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.083904 9435 raft_consensus.cc:359] T 18054b180c77403387d15fc6ee42f58f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.084306 10833 raft_consensus.cc:2804] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:21.091092 10833 raft_consensus.cc:697] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:21.091383 10833 consensus_queue.cc:237] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.095382 11079 raft_consensus.cc:493] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.095574 11079 raft_consensus.cc:515] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.096321 11079 leader_election.cc:290] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.096840 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c4be1c01418432492268598f97289a0" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:21.097432 9249 leader_election.cc:343] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.099433 9178 raft_consensus.cc:3060] T a7cb14a555914e25a50d98d13267c296 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.100602 9435 raft_consensus.cc:385] T 18054b180c77403387d15fc6ee42f58f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.100694 9435 raft_consensus.cc:740] T 18054b180c77403387d15fc6ee42f58f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.100878 9435 consensus_queue.cc:260] T 18054b180c77403387d15fc6ee42f58f P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.101367 9435 ts_tablet_manager.cc:1434] T 18054b180c77403387d15fc6ee42f58f P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.100s user 0.001s sys 0.000s
I20251215 14:55:21.101649 9435 tablet_bootstrap.cc:492] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:21.106523 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6be5f3269d9147d780f782bb5665b8b6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.106863 9029 raft_consensus.cc:2468] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:21.108614 9427 tablet_bootstrap.cc:492] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:21.109290 9427 ts_tablet_manager.cc:1403] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.058s user 0.013s sys 0.008s
I20251215 14:55:21.110282 10832 raft_consensus.cc:515] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:21.114691 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:21.114818 9112 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:21.115034 10991 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:21.111258 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb309f7c439740c89470da5636523a69" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.111784 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6be5f3269d9147d780f782bb5665b8b6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:21.113397 9427 raft_consensus.cc:359] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.123965 9025 raft_consensus.cc:3060] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.124024 9427 raft_consensus.cc:385] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.124418 9427 raft_consensus.cc:740] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.124955 9427 consensus_queue.cc:260] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.126235 9427 ts_tablet_manager.cc:1434] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.017s user 0.002s sys 0.001s
I20251215 14:55:21.126847 9025 raft_consensus.cc:2468] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:21.126926 9427 tablet_bootstrap.cc:492] T 26e8a00c0065406d826271d103f892ba P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:21.127418 9029 raft_consensus.cc:2393] T eb309f7c439740c89470da5636523a69 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:21.131599 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0e8dad82b3e4eff971b7b6845970c4f" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:21.132293 8976 leader_election.cc:343] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.135352 9427 tablet_bootstrap.cc:654] T 26e8a00c0065406d826271d103f892ba P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.135862 11037 consensus_queue.cc:1048] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:21.147791 10832 leader_election.cc:290] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.148797 9112 leader_election.cc:304] T eb309f7c439740c89470da5636523a69 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:21.149204 10992 raft_consensus.cc:3060] T eb309f7c439740c89470da5636523a69 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.151870 10992 raft_consensus.cc:2749] T eb309f7c439740c89470da5636523a69 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:21.156666 10835 raft_consensus.cc:493] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.156929 10835 raft_consensus.cc:515] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.163971 10835 leader_election.cc:290] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.164610 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce147d1fcda2480daa557276c33a6096" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:21.165071 8976 leader_election.cc:343] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.166204 9435 tablet_bootstrap.cc:654] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.192082 9427 tablet_bootstrap.cc:492] T 26e8a00c0065406d826271d103f892ba P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:21.192503 10832 raft_consensus.cc:493] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.192689 10832 raft_consensus.cc:515] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.193145 9427 ts_tablet_manager.cc:1403] T 26e8a00c0065406d826271d103f892ba P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.066s user 0.007s sys 0.010s
I20251215 14:55:21.193814 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e79295168c8b456ba4fdc2379fbd0961" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:21.194844 8976 leader_election.cc:343] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:21.195241 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 111175us
I20251215 14:55:21.198195 9427 raft_consensus.cc:359] T 26e8a00c0065406d826271d103f892ba P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.199296 9427 raft_consensus.cc:385] T 26e8a00c0065406d826271d103f892ba P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.199836 9427 raft_consensus.cc:740] T 26e8a00c0065406d826271d103f892ba P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.201062 9248 leader_election.cc:304] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.201555 10528 raft_consensus.cc:2804] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:21.201635 10528 raft_consensus.cc:493] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.201707 10528 raft_consensus.cc:3060] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.201447 9427 consensus_queue.cc:260] T 26e8a00c0065406d826271d103f892ba P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.204401 10528 raft_consensus.cc:515] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.205133 10832 leader_election.cc:290] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.205747 10528 leader_election.cc:290] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:21.205835 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:21.206012 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee44c7244b68469183a4e45baeaf5df4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:21.210619 9435 tablet_bootstrap.cc:492] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:21.210758 9435 ts_tablet_manager.cc:1403] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.109s user 0.004s sys 0.000s
I20251215 14:55:21.211288 10528 raft_consensus.cc:493] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.211400 10528 raft_consensus.cc:515] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.211954 10528 leader_election.cc:290] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.212852 10528 raft_consensus.cc:493] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.212957 10528 raft_consensus.cc:515] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.213423 10528 leader_election.cc:290] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.214550 9435 raft_consensus.cc:359] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.214694 9435 raft_consensus.cc:385] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.214748 9435 raft_consensus.cc:740] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.214967 9435 consensus_queue.cc:260] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.215911 9435 ts_tablet_manager.cc:1434] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:21.216184 9435 tablet_bootstrap.cc:492] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:21.218202 9435 tablet_bootstrap.cc:654] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.214381 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dc9405b80e84ae7a67a595c3596cc92" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:21.227324 9426 tablet_bootstrap.cc:492] T e9124dd3d98947b29289e0561976ada4 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:21.228145 9426 ts_tablet_manager.cc:1403] T e9124dd3d98947b29289e0561976ada4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.161s user 0.027s sys 0.019s
W20251215 14:55:21.228530 9249 leader_election.cc:343] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.228895 9426 raft_consensus.cc:359] T e9124dd3d98947b29289e0561976ada4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.229048 9426 raft_consensus.cc:385] T e9124dd3d98947b29289e0561976ada4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.229099 9426 raft_consensus.cc:740] T e9124dd3d98947b29289e0561976ada4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.229395 9426 consensus_queue.cc:260] T e9124dd3d98947b29289e0561976ada4 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.229857 9426 ts_tablet_manager.cc:1434] T e9124dd3d98947b29289e0561976ada4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20251215 14:55:21.229938 9249 leader_election.cc:343] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.204898 9427 ts_tablet_manager.cc:1434] T 26e8a00c0065406d826271d103f892ba P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.011s user 0.000s sys 0.003s
I20251215 14:55:21.209159 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4167c404f73e484abcb2e5b30431b28c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.215767 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "809257b3929a4c2f91132f9315752130" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:21.216806 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49bba2b78f65470182e1d361eb1272a4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:21.234604 9426 tablet_bootstrap.cc:492] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:21.234907 9033 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c4be1c01418432492268598f97289a0" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.237094 9426 tablet_bootstrap.cc:654] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.238435 9179 raft_consensus.cc:3060] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.238962 9037 raft_consensus.cc:2393] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:21.246047 9024 raft_consensus.cc:2393] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:21.246949 9427 tablet_bootstrap.cc:492] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:21.248250 10992 raft_consensus.cc:493] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.248394 10992 raft_consensus.cc:515] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.248605 9427 tablet_bootstrap.cc:654] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.249174 10992 leader_election.cc:290] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.249402 9030 raft_consensus.cc:2468] T 4167c404f73e484abcb2e5b30431b28c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:21.250058 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d09d7ce93d074bfaa830130b31bcc594" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.250244 9312 raft_consensus.cc:2468] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:21.251425 9115 leader_election.cc:304] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:21.251739 10992 raft_consensus.cc:2804] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 14:55:21.251827 10992 raft_consensus.cc:493] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.251884 10992 raft_consensus.cc:3060] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:21.257076 10992 raft_consensus.cc:515] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.257622 10992 leader_election.cc:290] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 2 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.258595 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d09d7ce93d074bfaa830130b31bcc594" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:21.258749 9312 raft_consensus.cc:3060] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:21.259914 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6140a160980d49b09a5fda8475fc144f" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:21.260164 9174 raft_consensus.cc:2468] T 6140a160980d49b09a5fda8475fc144f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:21.260542 9249 leader_election.cc:304] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:21.260982 10833 raft_consensus.cc:2804] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:21.261090 10833 raft_consensus.cc:493] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.261195 10833 raft_consensus.cc:3060] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.261498 9312 raft_consensus.cc:2468] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 2.
I20251215 14:55:21.264021 9115 leader_election.cc:304] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:21.264369 10992 raft_consensus.cc:2804] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 14:55:21.264494 10992 raft_consensus.cc:697] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:21.264755 10992 consensus_queue.cc:237] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.274775 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06cb17538a7541358548f25303e91d37" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:21.274626 10833 raft_consensus.cc:515] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.274992 9306 raft_consensus.cc:3060] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.275315 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6be5f3269d9147d780f782bb5665b8b6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.275507 9311 raft_consensus.cc:2393] T 6be5f3269d9147d780f782bb5665b8b6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:21.275756 10833 leader_election.cc:290] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.276544 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6140a160980d49b09a5fda8475fc144f" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:21.276980 9179 raft_consensus.cc:3060] T 6140a160980d49b09a5fda8475fc144f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.278358 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "809257b3929a4c2f91132f9315752130" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:21.284299 9308 raft_consensus.cc:2393] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:21.276414 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49bba2b78f65470182e1d361eb1272a4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:21.284649 9315 raft_consensus.cc:2393] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:21.279924 9306 raft_consensus.cc:2468] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:21.285135 9426 tablet_bootstrap.cc:492] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:21.285375 9426 ts_tablet_manager.cc:1403] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.051s user 0.007s sys 0.026s
I20251215 14:55:21.286072 9179 raft_consensus.cc:2468] T 6140a160980d49b09a5fda8475fc144f P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:21.286739 9249 leader_election.cc:304] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:21.286885 9426 raft_consensus.cc:359] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.287145 9426 raft_consensus.cc:385] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.287307 9426 raft_consensus.cc:740] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.287664 10528 raft_consensus.cc:2804] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:21.287772 10528 raft_consensus.cc:697] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:21.287648 9426 consensus_queue.cc:260] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.288014 10528 consensus_queue.cc:237] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.288511 9426 ts_tablet_manager.cc:1434] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20251215 14:55:21.288967 9426 tablet_bootstrap.cc:492] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:21.289155 8775 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 8e1a8070f9ab448088009e9a22a340f7 (table default.Table_89b4a7a3b7124af3986512c42ff0082e [id=9255b7fca6fe4f77b8e1f84ab57b097a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8e1a8070f9ab448088009e9a22a340f7 has no consensus state
I20251215 14:55:21.293555 9426 tablet_bootstrap.cc:654] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.295853 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0e8dad82b3e4eff971b7b6845970c4f" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:21.296031 9315 raft_consensus.cc:3060] T f0e8dad82b3e4eff971b7b6845970c4f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.299224 9315 raft_consensus.cc:2468] T f0e8dad82b3e4eff971b7b6845970c4f P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:21.300486 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce147d1fcda2480daa557276c33a6096" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.300761 9306 raft_consensus.cc:2468] T ce147d1fcda2480daa557276c33a6096 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:21.302598 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e79295168c8b456ba4fdc2379fbd0961" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.302779 9315 raft_consensus.cc:2468] T e79295168c8b456ba4fdc2379fbd0961 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:21.310256 11030 consensus_queue.cc:1048] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20251215 14:55:21.311305 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d09d7ce93d074bfaa830130b31bcc594" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.312147 9179 raft_consensus.cc:1240] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 LEADER]: Rejecting Update request from peer 67978ac4539d4b289e53f4eedd9a8156 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20251215 14:55:21.318181 10992 raft_consensus.cc:493] T e9124dd3d98947b29289e0561976ada4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.318351 10992 raft_consensus.cc:515] T e9124dd3d98947b29289e0561976ada4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.318966 10992 leader_election.cc:290] T e9124dd3d98947b29289e0561976ada4 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.319751 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9124dd3d98947b29289e0561976ada4" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.309347 9435 tablet_bootstrap.cc:492] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:21.320719 9303 raft_consensus.cc:1240] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4 [term 2 FOLLOWER]: Rejecting Update request from peer 67978ac4539d4b289e53f4eedd9a8156 for earlier term 1. Current term is 2. Ops: []
I20251215 14:55:21.324781 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee44c7244b68469183a4e45baeaf5df4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:21.324806 11030 consensus_queue.cc:1048] T ca2bba36b0f54aadb3980aa41dfd0eb0 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20251215 14:55:21.324994 9028 raft_consensus.cc:3060] T ee44c7244b68469183a4e45baeaf5df4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.325073 9435 ts_tablet_manager.cc:1403] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.109s user 0.004s sys 0.001s
I20251215 14:55:21.326225 9426 tablet_bootstrap.cc:492] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:21.326691 9426 ts_tablet_manager.cc:1403] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.014s
I20251215 14:55:21.329267 10832 consensus_queue.cc:1059] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20251215 14:55:21.332384 10832 consensus_queue.cc:1243] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Peer 3ea5306c36594ef4a62211f2bd6669a3 log is divergent from this leader: its last log entry 2.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20251215 14:55:21.333187 11030 raft_consensus.cc:3055] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Stepping down as leader of term 1
I20251215 14:55:21.334477 11030 raft_consensus.cc:740] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:21.334524 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6140a160980d49b09a5fda8475fc144f" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.334489 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dc9405b80e84ae7a67a595c3596cc92" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.335650 9426 raft_consensus.cc:359] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.337121 9426 raft_consensus.cc:385] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.337437 9426 raft_consensus.cc:740] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.338922 9426 consensus_queue.cc:260] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.340565 9024 raft_consensus.cc:2468] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:21.340636 11030 consensus_queue.cc:260] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.341017 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d09d7ce93d074bfaa830130b31bcc594" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:21.341940 11030 raft_consensus.cc:3060] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:21.342186 8978 leader_election.cc:304] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:21.342756 9435 raft_consensus.cc:359] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.342936 9435 raft_consensus.cc:385] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.342988 9435 raft_consensus.cc:740] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.343205 9435 consensus_queue.cc:260] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.343684 9435 ts_tablet_manager.cc:1434] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.018s user 0.002s sys 0.000s
I20251215 14:55:21.343866 9028 raft_consensus.cc:2468] T ee44c7244b68469183a4e45baeaf5df4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:21.344033 10832 raft_consensus.cc:2749] T 6be5f3269d9147d780f782bb5665b8b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:21.345178 9426 ts_tablet_manager.cc:1434] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.018s user 0.002s sys 0.001s
I20251215 14:55:21.351522 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6140a160980d49b09a5fda8475fc144f" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:21.351701 9029 raft_consensus.cc:3060] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.355191 9029 raft_consensus.cc:2468] T 6140a160980d49b09a5fda8475fc144f P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:21.355554 9030 raft_consensus.cc:2410] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20251215 14:55:21.359400 9248 leader_election.cc:343] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.359549 9248 leader_election.cc:304] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:21.360960 10528 raft_consensus.cc:2749] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:21.361161 9435 tablet_bootstrap.cc:492] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:21.370334 10756 raft_consensus.cc:493] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.370492 10756 raft_consensus.cc:515] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.371088 10756 leader_election.cc:290] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.372733 10756 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.372892 10756 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.373421 10756 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.375871 9435 tablet_bootstrap.cc:654] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.376291 9248 leader_election.cc:304] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:21.376773 10528 raft_consensus.cc:2749] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:21.376895 8978 leader_election.cc:304] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:21.377250 11030 raft_consensus.cc:2749] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:21.377413 8978 leader_election.cc:304] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:21.377580 9427 tablet_bootstrap.cc:492] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:21.377686 11030 raft_consensus.cc:2749] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:21.377792 8978 leader_election.cc:304] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.377728 9427 ts_tablet_manager.cc:1403] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.145s user 0.009s sys 0.002s
I20251215 14:55:21.378760 9427 raft_consensus.cc:359] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.378949 9427 raft_consensus.cc:385] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.379041 9427 raft_consensus.cc:740] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.379276 9427 consensus_queue.cc:260] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.380393 9427 ts_tablet_manager.cc:1434] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:21.381294 11030 raft_consensus.cc:2804] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:21.383342 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "548e6d35016746e2b8f5184ee44071cb" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:21.385048 9248 leader_election.cc:304] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:21.386628 11030 raft_consensus.cc:697] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
W20251215 14:55:21.387257 8976 leader_election.cc:343] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:21.388396 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:55:21.386961 11030 consensus_queue.cc:237] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.390161 9426 tablet_bootstrap.cc:492] T a51cf25aab09432f92bbd3235c2ada56 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:21.391398 10832 consensus_queue.cc:1048] T a1c5659fd65f40b0ab72c164afb8d3fe P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20251215 14:55:21.393034 9426 tablet_bootstrap.cc:654] T a51cf25aab09432f92bbd3235c2ada56 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.393632 10528 raft_consensus.cc:2749] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:21.395419 9248 leader_election.cc:304] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.396422 10528 raft_consensus.cc:2804] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:21.396500 10528 raft_consensus.cc:493] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.396566 10528 raft_consensus.cc:3060] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.399459 10528 raft_consensus.cc:515] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.401160 9427 tablet_bootstrap.cc:492] T 9c4be1c01418432492268598f97289a0 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:21.411396 8978 leader_election.cc:304] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.415716 10832 raft_consensus.cc:2804] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:21.415906 10832 raft_consensus.cc:697] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
W20251215 14:55:21.415964 9248 leader_election.cc:343] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.416170 10832 consensus_queue.cc:237] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.416486 9248 leader_election.cc:304] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:21.417140 11098 raft_consensus.cc:2749] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:21.419956 9248 leader_election.cc:304] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.421463 11079 raft_consensus.cc:2804] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:21.421582 11079 raft_consensus.cc:697] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:21.421803 11079 consensus_queue.cc:237] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.426896 11038 raft_consensus.cc:493] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.427042 11038 raft_consensus.cc:515] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.427623 11038 leader_election.cc:290] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.428746 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "548e6d35016746e2b8f5184ee44071cb" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:21.429312 9249 leader_election.cc:343] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.429688 10756 raft_consensus.cc:493] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.429841 10756 raft_consensus.cc:515] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.430447 10756 leader_election.cc:290] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.431095 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18054b180c77403387d15fc6ee42f58f" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:21.431643 8976 leader_election.cc:343] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:21.436684 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 55008.2us
I20251215 14:55:21.437613 8978 leader_election.cc:304] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.438213 10756 raft_consensus.cc:2804] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:21.438319 10756 raft_consensus.cc:493] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.438395 10756 raft_consensus.cc:3060] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.441759 10756 raft_consensus.cc:515] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.442742 10756 leader_election.cc:290] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.443302 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce147d1fcda2480daa557276c33a6096" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:21.445210 9435 tablet_bootstrap.cc:492] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:21.445359 9435 ts_tablet_manager.cc:1403] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.084s user 0.007s sys 0.000s
I20251215 14:55:21.446105 9435 raft_consensus.cc:359] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.446267 9435 raft_consensus.cc:385] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.446313 9435 raft_consensus.cc:740] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.446480 9435 consensus_queue.cc:260] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:21.446635 8976 leader_election.cc:343] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.446986 9435 ts_tablet_manager.cc:1434] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:21.447494 9435 tablet_bootstrap.cc:492] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:21.448261 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "548e6d35016746e2b8f5184ee44071cb" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.448480 9029 raft_consensus.cc:2468] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:21.464542 9427 tablet_bootstrap.cc:654] T 9c4be1c01418432492268598f97289a0 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.465435 10756 raft_consensus.cc:493] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.465667 10756 raft_consensus.cc:515] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.466499 10756 leader_election.cc:290] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.466787 8978 leader_election.cc:304] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.467573 10756 raft_consensus.cc:2804] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:21.467726 10756 raft_consensus.cc:493] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.467867 10756 raft_consensus.cc:3060] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.471083 10756 raft_consensus.cc:515] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.472299 9248 leader_election.cc:304] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.473798 11079 raft_consensus.cc:2804] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:21.473927 11079 raft_consensus.cc:493] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.474038 11079 raft_consensus.cc:3060] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.476637 11079 raft_consensus.cc:515] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.477710 11079 leader_election.cc:290] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.478371 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "548e6d35016746e2b8f5184ee44071cb" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:21.478957 9249 leader_election.cc:343] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.482506 9435 tablet_bootstrap.cc:654] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.485409 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "548e6d35016746e2b8f5184ee44071cb" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:21.488150 9029 raft_consensus.cc:3060] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.495786 11098 raft_consensus.cc:493] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.496186 11098 raft_consensus.cc:515] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.501662 11098 leader_election.cc:290] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.502156 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26e8a00c0065406d826271d103f892ba" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:21.502717 9435 tablet_bootstrap.cc:492] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
W20251215 14:55:21.502749 9249 leader_election.cc:343] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.502843 9435 ts_tablet_manager.cc:1403] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.000s
I20251215 14:55:21.503571 9435 raft_consensus.cc:359] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.503727 9435 raft_consensus.cc:385] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.503786 9435 raft_consensus.cc:740] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.503610 10756 leader_election.cc:290] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.503975 9435 consensus_queue.cc:260] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.504122 10528 leader_election.cc:290] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.504194 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26e8a00c0065406d826271d103f892ba" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:21.504475 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 6: this message will repeat every 5th retry.
I20251215 14:55:21.504731 9435 ts_tablet_manager.cc:1434] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:21.504765 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4167c404f73e484abcb2e5b30431b28c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:21.505192 9435 tablet_bootstrap.cc:492] T a51cf25aab09432f92bbd3235c2ada56 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:21.505479 9249 leader_election.cc:343] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.506588 9435 tablet_bootstrap.cc:654] T a51cf25aab09432f92bbd3235c2ada56 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.508715 9025 raft_consensus.cc:2468] T 26e8a00c0065406d826271d103f892ba P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:21.508975 10835 consensus_queue.cc:1048] T 9e317c8dc24e481abb709e932fa39c29 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20251215 14:55:21.511966 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4167c404f73e484abcb2e5b30431b28c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:21.513325 9248 leader_election.cc:304] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.515121 9030 raft_consensus.cc:3060] T 4167c404f73e484abcb2e5b30431b28c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.515209 11079 raft_consensus.cc:2804] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:21.515297 11079 raft_consensus.cc:493] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.515357 11079 raft_consensus.cc:3060] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.517971 9030 raft_consensus.cc:2468] T 4167c404f73e484abcb2e5b30431b28c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:21.518182 11079 raft_consensus.cc:515] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.514271 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9124dd3d98947b29289e0561976ada4" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.521675 9025 raft_consensus.cc:2393] T e9124dd3d98947b29289e0561976ada4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:21.522058 9029 raft_consensus.cc:2468] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:21.522701 9427 tablet_bootstrap.cc:492] T 9c4be1c01418432492268598f97289a0 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:21.523023 9427 ts_tablet_manager.cc:1403] T 9c4be1c01418432492268598f97289a0 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.140s user 0.000s sys 0.006s
I20251215 14:55:21.524278 9427 raft_consensus.cc:359] T 9c4be1c01418432492268598f97289a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.524791 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26e8a00c0065406d826271d103f892ba" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:21.525575 9249 leader_election.cc:343] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.525983 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "548e6d35016746e2b8f5184ee44071cb" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.526176 9308 raft_consensus.cc:2393] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:21.527281 9427 raft_consensus.cc:385] T 9c4be1c01418432492268598f97289a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.527383 9427 raft_consensus.cc:740] T 9c4be1c01418432492268598f97289a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.526402 11079 leader_election.cc:290] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.527956 9426 tablet_bootstrap.cc:492] T a51cf25aab09432f92bbd3235c2ada56 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:21.528107 9426 ts_tablet_manager.cc:1403] T a51cf25aab09432f92bbd3235c2ada56 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.182s user 0.017s sys 0.017s
I20251215 14:55:21.528833 9426 raft_consensus.cc:359] T a51cf25aab09432f92bbd3235c2ada56 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.528997 9426 raft_consensus.cc:385] T a51cf25aab09432f92bbd3235c2ada56 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.529048 9426 raft_consensus.cc:740] T a51cf25aab09432f92bbd3235c2ada56 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.529246 9112 leader_election.cc:304] T e9124dd3d98947b29289e0561976ada4 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:21.529644 10992 raft_consensus.cc:3060] T e9124dd3d98947b29289e0561976ada4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.530159 9435 tablet_bootstrap.cc:492] T a51cf25aab09432f92bbd3235c2ada56 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:21.530262 9435 ts_tablet_manager.cc:1403] T a51cf25aab09432f92bbd3235c2ada56 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.005s
I20251215 14:55:21.531226 9435 raft_consensus.cc:359] T a51cf25aab09432f92bbd3235c2ada56 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.531368 9435 raft_consensus.cc:385] T a51cf25aab09432f92bbd3235c2ada56 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.531407 9435 raft_consensus.cc:740] T a51cf25aab09432f92bbd3235c2ada56 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.531450 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18054b180c77403387d15fc6ee42f58f" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.531597 9314 raft_consensus.cc:2468] T 18054b180c77403387d15fc6ee42f58f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:21.531574 9435 consensus_queue.cc:260] T a51cf25aab09432f92bbd3235c2ada56 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.531998 9435 ts_tablet_manager.cc:1434] T a51cf25aab09432f92bbd3235c2ada56 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:21.529246 9426 consensus_queue.cc:260] T a51cf25aab09432f92bbd3235c2ada56 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.532052 10992 raft_consensus.cc:2749] T e9124dd3d98947b29289e0561976ada4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:21.532408 9426 ts_tablet_manager.cc:1434] T a51cf25aab09432f92bbd3235c2ada56 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:21.532749 10559 raft_consensus.cc:493] T c902ad68a5c448828eb3ac419ffaca81 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.532805 9426 tablet_bootstrap.cc:492] T ee44c7244b68469183a4e45baeaf5df4 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:21.532857 10559 raft_consensus.cc:515] T c902ad68a5c448828eb3ac419ffaca81 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.533368 10559 leader_election.cc:290] T c902ad68a5c448828eb3ac419ffaca81 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.534119 9426 tablet_bootstrap.cc:654] T ee44c7244b68469183a4e45baeaf5df4 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.537388 8678 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu pid 10152
I20251215 14:55:21.537611 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c902ad68a5c448828eb3ac419ffaca81" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.537869 9029 raft_consensus.cc:2393] T c902ad68a5c448828eb3ac419ffaca81 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:21.543061 10559 raft_consensus.cc:493] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.543202 10559 raft_consensus.cc:515] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.543717 10559 leader_election.cc:290] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.544232 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "809257b3929a4c2f91132f9315752130" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.544447 9029 raft_consensus.cc:2393] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:21.545616 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e79295168c8b456ba4fdc2379fbd0961" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:21.545780 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a51cf25aab09432f92bbd3235c2ada56" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:21.545930 9177 raft_consensus.cc:2468] T a51cf25aab09432f92bbd3235c2ada56 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:21.546514 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c902ad68a5c448828eb3ac419ffaca81" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.551302 9427 consensus_queue.cc:260] T 9c4be1c01418432492268598f97289a0 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.552331 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "809257b3929a4c2f91132f9315752130" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.552553 9303 raft_consensus.cc:2393] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:21.553202 10992 consensus_queue.cc:1048] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:21.554320 9427 ts_tablet_manager.cc:1434] T 9c4be1c01418432492268598f97289a0 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.031s user 0.000s sys 0.003s
I20251215 14:55:21.556996 9427 tablet_bootstrap.cc:492] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:21.563069 10992 raft_consensus.cc:493] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.563241 10992 raft_consensus.cc:515] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.563676 9426 tablet_bootstrap.cc:492] T ee44c7244b68469183a4e45baeaf5df4 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:21.563854 10992 leader_election.cc:290] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.563858 9426 ts_tablet_manager.cc:1403] T ee44c7244b68469183a4e45baeaf5df4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.008s
I20251215 14:55:21.565110 9426 raft_consensus.cc:359] T ee44c7244b68469183a4e45baeaf5df4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.565272 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49bba2b78f65470182e1d361eb1272a4" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.565482 9029 raft_consensus.cc:2393] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:21.565258 9426 raft_consensus.cc:385] T ee44c7244b68469183a4e45baeaf5df4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.569056 9426 raft_consensus.cc:740] T ee44c7244b68469183a4e45baeaf5df4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.569244 9426 consensus_queue.cc:260] T ee44c7244b68469183a4e45baeaf5df4 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.569711 9426 ts_tablet_manager.cc:1434] T ee44c7244b68469183a4e45baeaf5df4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251215 14:55:21.569959 9426 tablet_bootstrap.cc:492] T 88edc14acdad47a3907078d08e118ce7 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:21.572055 9426 tablet_bootstrap.cc:654] T 88edc14acdad47a3907078d08e118ce7 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.578994 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce147d1fcda2480daa557276c33a6096" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:21.579226 9314 raft_consensus.cc:3060] T ce147d1fcda2480daa557276c33a6096 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.579442 9427 tablet_bootstrap.cc:654] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.581279 9435 tablet_bootstrap.cc:492] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:21.581800 9314 raft_consensus.cc:2468] T ce147d1fcda2480daa557276c33a6096 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:21.582512 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a51cf25aab09432f92bbd3235c2ada56" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.582657 9303 raft_consensus.cc:2468] T a51cf25aab09432f92bbd3235c2ada56 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:21.582670 9435 tablet_bootstrap.cc:654] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.590236 9427 tablet_bootstrap.cc:492] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:21.590453 9427 ts_tablet_manager.cc:1403] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.003s
I20251215 14:55:21.590616 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e79295168c8b456ba4fdc2379fbd0961" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:21.590766 9303 raft_consensus.cc:3060] T e79295168c8b456ba4fdc2379fbd0961 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.591252 9427 raft_consensus.cc:359] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.591408 9427 raft_consensus.cc:385] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.591454 9427 raft_consensus.cc:740] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.591610 9427 consensus_queue.cc:260] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.593096 9427 ts_tablet_manager.cc:1434] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:21.597456 9427 tablet_bootstrap.cc:492] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:21.598935 9427 tablet_bootstrap.cc:654] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.610062 9427 tablet_bootstrap.cc:492] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:21.610190 9426 tablet_bootstrap.cc:492] T 88edc14acdad47a3907078d08e118ce7 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:21.610213 9427 ts_tablet_manager.cc:1403] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.004s
I20251215 14:55:21.610344 9426 ts_tablet_manager.cc:1403] T 88edc14acdad47a3907078d08e118ce7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.005s
I20251215 14:55:21.610932 9427 raft_consensus.cc:359] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.610962 9426 raft_consensus.cc:359] T 88edc14acdad47a3907078d08e118ce7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.611119 9427 raft_consensus.cc:385] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.611124 9426 raft_consensus.cc:385] T 88edc14acdad47a3907078d08e118ce7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.611186 9427 raft_consensus.cc:740] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.611192 9426 raft_consensus.cc:740] T 88edc14acdad47a3907078d08e118ce7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.611358 9427 consensus_queue.cc:260] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.611372 9426 consensus_queue.cc:260] T 88edc14acdad47a3907078d08e118ce7 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.611840 9426 ts_tablet_manager.cc:1434] T 88edc14acdad47a3907078d08e118ce7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251215 14:55:21.611994 9427 ts_tablet_manager.cc:1434] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:21.612102 9426 tablet_bootstrap.cc:492] T 06cb17538a7541358548f25303e91d37 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:21.612303 9427 tablet_bootstrap.cc:492] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:21.613471 9426 tablet_bootstrap.cc:654] T 06cb17538a7541358548f25303e91d37 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.617295 9427 tablet_bootstrap.cc:654] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.618127 9303 raft_consensus.cc:2468] T e79295168c8b456ba4fdc2379fbd0961 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:21.620581 10559 raft_consensus.cc:493] T 88edc14acdad47a3907078d08e118ce7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.620733 10559 raft_consensus.cc:515] T 88edc14acdad47a3907078d08e118ce7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.621394 10559 leader_election.cc:290] T 88edc14acdad47a3907078d08e118ce7 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.622648 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88edc14acdad47a3907078d08e118ce7" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.623971 10559 consensus_queue.cc:1048] T 6beaf5ae37ce41fd9123d6b3560351b7 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:21.627337 9426 tablet_bootstrap.cc:492] T 06cb17538a7541358548f25303e91d37 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:21.627462 9426 ts_tablet_manager.cc:1403] T 06cb17538a7541358548f25303e91d37 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20251215 14:55:21.628085 9426 raft_consensus.cc:359] T 06cb17538a7541358548f25303e91d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.628228 9426 raft_consensus.cc:385] T 06cb17538a7541358548f25303e91d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.628278 9426 raft_consensus.cc:740] T 06cb17538a7541358548f25303e91d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.628453 9426 consensus_queue.cc:260] T 06cb17538a7541358548f25303e91d37 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.628901 9426 ts_tablet_manager.cc:1434] T 06cb17538a7541358548f25303e91d37 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:21.629177 9426 tablet_bootstrap.cc:492] T 4167c404f73e484abcb2e5b30431b28c P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:21.630451 9426 tablet_bootstrap.cc:654] T 4167c404f73e484abcb2e5b30431b28c P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.631561 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "26e8a00c0065406d826271d103f892ba" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:21.631714 9025 raft_consensus.cc:3060] T 26e8a00c0065406d826271d103f892ba P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.632943 8978 leader_election.cc:304] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:21.633198 11030 raft_consensus.cc:2749] T 548e6d35016746e2b8f5184ee44071cb P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:21.633452 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:55:21.633560 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:21.633754 11030 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:21.634258 8978 leader_election.cc:304] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.634622 10835 raft_consensus.cc:2804] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:21.634704 10835 raft_consensus.cc:493] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.634764 10835 raft_consensus.cc:3060] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.635661 9025 raft_consensus.cc:2468] T 26e8a00c0065406d826271d103f892ba P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:21.635811 8978 leader_election.cc:304] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.636029 10756 raft_consensus.cc:2804] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:21.636137 10756 raft_consensus.cc:697] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:21.636265 9427 tablet_bootstrap.cc:492] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:21.636375 9427 ts_tablet_manager.cc:1403] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.009s
I20251215 14:55:21.636384 10756 consensus_queue.cc:237] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.637120 9427 raft_consensus.cc:359] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.637264 9427 raft_consensus.cc:385] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.637322 9427 raft_consensus.cc:740] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.639611 9427 consensus_queue.cc:260] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.640019 10835 raft_consensus.cc:515] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.640866 10835 leader_election.cc:290] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.641115 9427 ts_tablet_manager.cc:1434] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20251215 14:55:21.641412 9427 tablet_bootstrap.cc:492] T d45d6eebc703414fa9028faab9fc993c P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:21.641633 11030 consensus_queue.cc:1048] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:21.641748 8978 leader_election.cc:304] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:21.642113 11030 raft_consensus.cc:2804] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:21.642179 11030 raft_consensus.cc:493] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:21.642228 11030 raft_consensus.cc:3060] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.645860 11030 raft_consensus.cc:515] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.645897 11098 consensus_queue.cc:1048] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:21.646561 11030 leader_election.cc:290] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:21.658514 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 6: this message will repeat every 5th retry.
I20251215 14:55:21.661064 9427 tablet_bootstrap.cc:654] T d45d6eebc703414fa9028faab9fc993c P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.682206 9426 tablet_bootstrap.cc:492] T 4167c404f73e484abcb2e5b30431b28c P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:21.684875 9426 ts_tablet_manager.cc:1403] T 4167c404f73e484abcb2e5b30431b28c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.055s user 0.003s sys 0.001s
I20251215 14:55:21.687215 9248 leader_election.cc:304] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.687855 11098 raft_consensus.cc:2804] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:21.687984 11098 raft_consensus.cc:697] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:21.688267 11098 consensus_queue.cc:237] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.693570 9427 tablet_bootstrap.cc:492] T d45d6eebc703414fa9028faab9fc993c P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
W20251215 14:55:21.694067 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:21.694501 9427 ts_tablet_manager.cc:1403] T d45d6eebc703414fa9028faab9fc993c P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.053s user 0.007s sys 0.003s
I20251215 14:55:21.695600 9427 raft_consensus.cc:359] T d45d6eebc703414fa9028faab9fc993c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.695061 9426 raft_consensus.cc:359] T 4167c404f73e484abcb2e5b30431b28c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.697186 10559 raft_consensus.cc:493] T 032f27e7f6054188a3169a3c10ee4d09 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.697327 10559 raft_consensus.cc:515] T 032f27e7f6054188a3169a3c10ee4d09 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.697643 9427 raft_consensus.cc:385] T d45d6eebc703414fa9028faab9fc993c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.697207 9426 raft_consensus.cc:385] T 4167c404f73e484abcb2e5b30431b28c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.697996 9427 raft_consensus.cc:740] T d45d6eebc703414fa9028faab9fc993c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.697928 10559 leader_election.cc:290] T 032f27e7f6054188a3169a3c10ee4d09 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.698534 9427 consensus_queue.cc:260] T d45d6eebc703414fa9028faab9fc993c P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.698283 9426 raft_consensus.cc:740] T 4167c404f73e484abcb2e5b30431b28c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.698706 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "032f27e7f6054188a3169a3c10ee4d09" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.700088 9427 ts_tablet_manager.cc:1434] T d45d6eebc703414fa9028faab9fc993c P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251215 14:55:21.702019 9427 tablet_bootstrap.cc:492] T 4a98e436ade941989e40e34578572e3b P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:21.705679 9427 tablet_bootstrap.cc:654] T 4a98e436ade941989e40e34578572e3b P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.700925 9426 consensus_queue.cc:260] T 4167c404f73e484abcb2e5b30431b28c P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.710111 9426 ts_tablet_manager.cc:1434] T 4167c404f73e484abcb2e5b30431b28c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.024s user 0.002s sys 0.002s
I20251215 14:55:21.711480 9426 tablet_bootstrap.cc:492] T f0e8dad82b3e4eff971b7b6845970c4f P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:21.718189 9435 tablet_bootstrap.cc:492] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:21.718464 9435 ts_tablet_manager.cc:1403] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.137s user 0.007s sys 0.022s
I20251215 14:55:21.719888 9435 raft_consensus.cc:359] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.720177 9435 raft_consensus.cc:385] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.720297 9435 raft_consensus.cc:740] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.720664 9435 consensus_queue.cc:260] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.723752 9435 ts_tablet_manager.cc:1434] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:21.727370 9427 tablet_bootstrap.cc:492] T 4a98e436ade941989e40e34578572e3b P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:21.728478 9427 ts_tablet_manager.cc:1403] T 4a98e436ade941989e40e34578572e3b P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.027s user 0.007s sys 0.000s
I20251215 14:55:21.731314 9427 raft_consensus.cc:359] T 4a98e436ade941989e40e34578572e3b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.732617 9427 raft_consensus.cc:385] T 4a98e436ade941989e40e34578572e3b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.732939 9427 raft_consensus.cc:740] T 4a98e436ade941989e40e34578572e3b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.733392 9427 consensus_queue.cc:260] T 4a98e436ade941989e40e34578572e3b P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.734534 9426 tablet_bootstrap.cc:654] T f0e8dad82b3e4eff971b7b6845970c4f P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.734886 9435 tablet_bootstrap.cc:492] T 2b54d7dcdcc94e58b039b9f231f38d11 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:21.735520 9427 ts_tablet_manager.cc:1434] T 4a98e436ade941989e40e34578572e3b P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20251215 14:55:21.736515 9427 tablet_bootstrap.cc:492] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:21.738590 9427 tablet_bootstrap.cc:654] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:21.742367 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 55230us
I20251215 14:55:21.743033 9248 leader_election.cc:304] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:21.748670 11098 raft_consensus.cc:2804] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:21.748838 11098 raft_consensus.cc:697] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:21.749073 11098 consensus_queue.cc:237] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.749794 9435 tablet_bootstrap.cc:654] T 2b54d7dcdcc94e58b039b9f231f38d11 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.759667 9427 tablet_bootstrap.cc:492] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:21.760406 9427 ts_tablet_manager.cc:1403] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.002s
I20251215 14:55:21.760800 11038 raft_consensus.cc:493] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.760921 11038 raft_consensus.cc:515] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.761400 11038 leader_election.cc:290] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.762322 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fea3a1616074fdd81242bc44e76cc2c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:21.762812 9248 leader_election.cc:304] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
W20251215 14:55:21.763276 9249 leader_election.cc:343] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.763854 9427 raft_consensus.cc:359] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.764026 9427 raft_consensus.cc:385] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.764065 11079 raft_consensus.cc:2804] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:21.764084 9427 raft_consensus.cc:740] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.764168 11079 raft_consensus.cc:697] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:21.764266 9427 consensus_queue.cc:260] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.764386 11079 consensus_queue.cc:237] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.764833 9427 ts_tablet_manager.cc:1434] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:21.765106 9427 tablet_bootstrap.cc:492] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:21.766590 9427 tablet_bootstrap.cc:654] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.769945 9426 tablet_bootstrap.cc:492] T f0e8dad82b3e4eff971b7b6845970c4f P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:21.770339 9426 ts_tablet_manager.cc:1403] T f0e8dad82b3e4eff971b7b6845970c4f P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.059s user 0.006s sys 0.002s
I20251215 14:55:21.770632 8978 leader_election.cc:304] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:21.770915 10835 raft_consensus.cc:2804] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:21.771019 10835 raft_consensus.cc:697] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:21.771265 10835 consensus_queue.cc:237] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.772094 9426 raft_consensus.cc:359] T f0e8dad82b3e4eff971b7b6845970c4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.773537 9426 raft_consensus.cc:385] T f0e8dad82b3e4eff971b7b6845970c4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.774080 9426 raft_consensus.cc:740] T f0e8dad82b3e4eff971b7b6845970c4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.775027 9426 consensus_queue.cc:260] T f0e8dad82b3e4eff971b7b6845970c4f P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.778119 10756 raft_consensus.cc:493] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.778234 10756 raft_consensus.cc:515] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.778800 10756 leader_election.cc:290] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.777884 9426 ts_tablet_manager.cc:1434] T f0e8dad82b3e4eff971b7b6845970c4f P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20251215 14:55:21.780328 9426 tablet_bootstrap.cc:492] T 1c989af5bc624699b4cce2b5c95fc90e P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:21.782446 10756 raft_consensus.cc:493] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.782572 10756 raft_consensus.cc:515] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.783144 10756 leader_election.cc:290] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.786326 10992 raft_consensus.cc:493] T 9e317c8dc24e481abb709e932fa39c29 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.786480 10992 raft_consensus.cc:515] T 9e317c8dc24e481abb709e932fa39c29 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:21.787067 10992 leader_election.cc:290] T 9e317c8dc24e481abb709e932fa39c29 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.787012 9435 tablet_bootstrap.cc:492] T 2b54d7dcdcc94e58b039b9f231f38d11 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:21.787346 9435 ts_tablet_manager.cc:1403] T 2b54d7dcdcc94e58b039b9f231f38d11 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.062s user 0.005s sys 0.002s
I20251215 14:55:21.787930 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e317c8dc24e481abb709e932fa39c29" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.788965 9435 raft_consensus.cc:359] T 2b54d7dcdcc94e58b039b9f231f38d11 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.789352 9435 raft_consensus.cc:385] T 2b54d7dcdcc94e58b039b9f231f38d11 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.789484 9435 raft_consensus.cc:740] T 2b54d7dcdcc94e58b039b9f231f38d11 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.790102 9435 consensus_queue.cc:260] T 2b54d7dcdcc94e58b039b9f231f38d11 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.795020 9435 ts_tablet_manager.cc:1434] T 2b54d7dcdcc94e58b039b9f231f38d11 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20251215 14:55:21.797376 9435 tablet_bootstrap.cc:492] T ebeebb8f49ef4858804e2ed0b31b2196 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:21.798492 9426 tablet_bootstrap.cc:654] T 1c989af5bc624699b4cce2b5c95fc90e P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.809752 9427 tablet_bootstrap.cc:492] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:21.809928 9427 ts_tablet_manager.cc:1403] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.008s
I20251215 14:55:21.810621 9427 raft_consensus.cc:359] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.810808 9427 raft_consensus.cc:385] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.810858 9427 raft_consensus.cc:740] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.811085 9427 consensus_queue.cc:260] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.811573 9435 tablet_bootstrap.cc:654] T ebeebb8f49ef4858804e2ed0b31b2196 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.815133 9427 ts_tablet_manager.cc:1434] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:21.815426 9427 tablet_bootstrap.cc:492] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:21.816841 9427 tablet_bootstrap.cc:654] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.818501 9435 tablet_bootstrap.cc:492] T ebeebb8f49ef4858804e2ed0b31b2196 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:21.818663 9435 ts_tablet_manager.cc:1403] T ebeebb8f49ef4858804e2ed0b31b2196 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.000s
I20251215 14:55:21.820348 10559 raft_consensus.cc:493] T ee44c7244b68469183a4e45baeaf5df4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.820616 10559 raft_consensus.cc:515] T ee44c7244b68469183a4e45baeaf5df4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.821309 9435 raft_consensus.cc:359] T ebeebb8f49ef4858804e2ed0b31b2196 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.821468 9435 raft_consensus.cc:385] T ebeebb8f49ef4858804e2ed0b31b2196 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.821517 9435 raft_consensus.cc:740] T ebeebb8f49ef4858804e2ed0b31b2196 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.821710 9435 consensus_queue.cc:260] T ebeebb8f49ef4858804e2ed0b31b2196 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.822386 9435 ts_tablet_manager.cc:1434] T ebeebb8f49ef4858804e2ed0b31b2196 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251215 14:55:21.822613 10559 leader_election.cc:290] T ee44c7244b68469183a4e45baeaf5df4 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.822798 9435 tablet_bootstrap.cc:492] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:21.823032 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee44c7244b68469183a4e45baeaf5df4" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.823410 9029 raft_consensus.cc:2393] T ee44c7244b68469183a4e45baeaf5df4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:21.827263 9435 tablet_bootstrap.cc:654] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.832973 9435 tablet_bootstrap.cc:492] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:21.833127 9435 ts_tablet_manager.cc:1403] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20251215 14:55:21.833861 9435 raft_consensus.cc:359] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.834045 9435 raft_consensus.cc:385] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.834105 9435 raft_consensus.cc:740] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.834276 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fea3a1616074fdd81242bc44e76cc2c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.834301 9435 consensus_queue.cc:260] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.834815 9435 ts_tablet_manager.cc:1434] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:21.835114 9435 tablet_bootstrap.cc:492] T 14450105328041cdbd93969b756d9fa0 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:21.836228 9179 raft_consensus.cc:1275] T d4cff0ed3782446397dbae8a2da52ed7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 FOLLOWER]: Refusing update from remote peer e89303a500544272b601d7c29be802b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 14:55:21.836910 9435 tablet_bootstrap.cc:654] T 14450105328041cdbd93969b756d9fa0 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.837069 11098 consensus_queue.cc:1048] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:21.838975 9427 tablet_bootstrap.cc:492] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:21.839110 9427 ts_tablet_manager.cc:1403] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20251215 14:55:21.839900 9427 raft_consensus.cc:359] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.840092 9427 raft_consensus.cc:385] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.840144 9427 raft_consensus.cc:740] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.840344 9427 consensus_queue.cc:260] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.840883 9427 ts_tablet_manager.cc:1434] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:21.841262 9427 tablet_bootstrap.cc:492] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:21.842895 9427 tablet_bootstrap.cc:654] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.851650 9435 tablet_bootstrap.cc:492] T 14450105328041cdbd93969b756d9fa0 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:21.851814 9435 ts_tablet_manager.cc:1403] T 14450105328041cdbd93969b756d9fa0 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.003s
I20251215 14:55:21.853627 9435 raft_consensus.cc:359] T 14450105328041cdbd93969b756d9fa0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.853809 9435 raft_consensus.cc:385] T 14450105328041cdbd93969b756d9fa0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.853874 9435 raft_consensus.cc:740] T 14450105328041cdbd93969b756d9fa0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.854056 9435 consensus_queue.cc:260] T 14450105328041cdbd93969b756d9fa0 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.854576 9435 ts_tablet_manager.cc:1434] T 14450105328041cdbd93969b756d9fa0 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251215 14:55:21.854876 9435 tablet_bootstrap.cc:492] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:21.855475 11079 raft_consensus.cc:493] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.855651 11079 raft_consensus.cc:515] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.856696 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45d6eebc703414fa9028faab9fc993c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:21.857131 9435 tablet_bootstrap.cc:654] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:21.857358 9249 leader_election.cc:343] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.857702 11079 leader_election.cc:290] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.860260 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18054b180c77403387d15fc6ee42f58f" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:21.860486 9312 raft_consensus.cc:3060] T 18054b180c77403387d15fc6ee42f58f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.864444 9312 raft_consensus.cc:2468] T 18054b180c77403387d15fc6ee42f58f P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:21.867229 9427 tablet_bootstrap.cc:492] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:21.867403 9427 ts_tablet_manager.cc:1403] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.026s user 0.004s sys 0.001s
I20251215 14:55:21.868175 9427 raft_consensus.cc:359] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.868355 9427 raft_consensus.cc:385] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.868413 9427 raft_consensus.cc:740] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.868968 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a51cf25aab09432f92bbd3235c2ada56" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:21.869139 9308 raft_consensus.cc:3060] T a51cf25aab09432f92bbd3235c2ada56 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.869597 10835 raft_consensus.cc:493] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.869738 10835 raft_consensus.cc:515] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.870347 10835 leader_election.cc:290] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.871740 9308 raft_consensus.cc:2468] T a51cf25aab09432f92bbd3235c2ada56 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:21.873126 10500 generic_service.cc:196] Checking for leaks (request via RPC)
I20251215 14:55:21.875314 9427 consensus_queue.cc:260] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.875952 9427 ts_tablet_manager.cc:1434] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20251215 14:55:21.876252 9427 tablet_bootstrap.cc:492] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:21.877823 9427 tablet_bootstrap.cc:654] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.889274 11098 consensus_queue.cc:1048] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:21.891675 10992 raft_consensus.cc:493] T f0e8dad82b3e4eff971b7b6845970c4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.891744 9427 tablet_bootstrap.cc:492] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:21.891876 9427 ts_tablet_manager.cc:1403] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.005s
I20251215 14:55:21.891824 10992 raft_consensus.cc:515] T f0e8dad82b3e4eff971b7b6845970c4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.892052 9426 tablet_bootstrap.cc:492] T 1c989af5bc624699b4cce2b5c95fc90e P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:21.892154 9426 ts_tablet_manager.cc:1403] T 1c989af5bc624699b4cce2b5c95fc90e P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.112s user 0.004s sys 0.015s
I20251215 14:55:21.892356 10992 leader_election.cc:290] T f0e8dad82b3e4eff971b7b6845970c4f P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:21.892606 9427 raft_consensus.cc:359] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.892761 9427 raft_consensus.cc:385] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.892807 9427 raft_consensus.cc:740] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.892753 9426 raft_consensus.cc:359] T 1c989af5bc624699b4cce2b5c95fc90e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.892902 9426 raft_consensus.cc:385] T 1c989af5bc624699b4cce2b5c95fc90e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.892953 9426 raft_consensus.cc:740] T 1c989af5bc624699b4cce2b5c95fc90e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.892982 9427 consensus_queue.cc:260] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.893119 9426 consensus_queue.cc:260] T 1c989af5bc624699b4cce2b5c95fc90e P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.893431 9427 ts_tablet_manager.cc:1434] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:21.893616 9426 ts_tablet_manager.cc:1434] T 1c989af5bc624699b4cce2b5c95fc90e P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:21.893700 9427 tablet_bootstrap.cc:492] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:21.893874 9426 tablet_bootstrap.cc:492] T b4a856793e8b46cfb42110de5d383ff7 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:21.895244 9427 tablet_bootstrap.cc:654] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.895540 9426 tablet_bootstrap.cc:654] T b4a856793e8b46cfb42110de5d383ff7 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.898886 9426 tablet_bootstrap.cc:492] T b4a856793e8b46cfb42110de5d383ff7 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:21.899003 9426 ts_tablet_manager.cc:1403] T b4a856793e8b46cfb42110de5d383ff7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20251215 14:55:21.899657 9426 raft_consensus.cc:359] T b4a856793e8b46cfb42110de5d383ff7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.899819 9426 raft_consensus.cc:385] T b4a856793e8b46cfb42110de5d383ff7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.899866 9426 raft_consensus.cc:740] T b4a856793e8b46cfb42110de5d383ff7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.900056 9426 consensus_queue.cc:260] T b4a856793e8b46cfb42110de5d383ff7 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.900547 9426 ts_tablet_manager.cc:1434] T b4a856793e8b46cfb42110de5d383ff7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251215 14:55:21.900799 9426 tablet_bootstrap.cc:492] T e79295168c8b456ba4fdc2379fbd0961 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:21.904587 9435 tablet_bootstrap.cc:492] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:21.904743 9435 ts_tablet_manager.cc:1403] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.000s
I20251215 14:55:21.904976 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0e8dad82b3e4eff971b7b6845970c4f" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:21.906152 9435 raft_consensus.cc:359] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.906327 9435 raft_consensus.cc:385] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.906376 9435 raft_consensus.cc:740] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.906561 9435 consensus_queue.cc:260] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.907039 9435 ts_tablet_manager.cc:1434] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:21.907347 9435 tablet_bootstrap.cc:492] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:21.909071 9435 tablet_bootstrap.cc:654] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.910323 9427 tablet_bootstrap.cc:492] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:21.910460 9427 ts_tablet_manager.cc:1403] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.003s
I20251215 14:55:21.911134 9427 raft_consensus.cc:359] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.911312 9427 raft_consensus.cc:385] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.911373 9427 raft_consensus.cc:740] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.911597 9427 consensus_queue.cc:260] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.912076 9427 ts_tablet_manager.cc:1434] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:21.912343 9427 tablet_bootstrap.cc:492] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:21.913915 9427 tablet_bootstrap.cc:654] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.918721 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dc9405b80e84ae7a67a595c3596cc92" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.918907 9303 raft_consensus.cc:2468] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:21.919456 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a856793e8b46cfb42110de5d383ff7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.919629 9303 raft_consensus.cc:2468] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:21.920562 9426 tablet_bootstrap.cc:654] T e79295168c8b456ba4fdc2379fbd0961 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:21.922041 9115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 369086us
I20251215 14:55:21.922397 9115 leader_election.cc:304] T c902ad68a5c448828eb3ac419ffaca81 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:21.922988 9115 leader_election.cc:304] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:21.923413 10991 raft_consensus.cc:3060] T c902ad68a5c448828eb3ac419ffaca81 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.923696 11112 raft_consensus.cc:3060] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:21.925961 11112 raft_consensus.cc:2749] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:21.927750 9426 tablet_bootstrap.cc:492] T e79295168c8b456ba4fdc2379fbd0961 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:21.928076 9426 ts_tablet_manager.cc:1403] T e79295168c8b456ba4fdc2379fbd0961 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20251215 14:55:21.928920 9426 raft_consensus.cc:359] T e79295168c8b456ba4fdc2379fbd0961 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.929911 9426 raft_consensus.cc:385] T e79295168c8b456ba4fdc2379fbd0961 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.930305 9426 raft_consensus.cc:740] T e79295168c8b456ba4fdc2379fbd0961 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.930620 9426 consensus_queue.cc:260] T e79295168c8b456ba4fdc2379fbd0961 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.926041 10991 raft_consensus.cc:2749] T c902ad68a5c448828eb3ac419ffaca81 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:21.932605 9435 tablet_bootstrap.cc:492] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:21.938290 9435 ts_tablet_manager.cc:1403] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.000s
I20251215 14:55:21.941332 9426 ts_tablet_manager.cc:1434] T e79295168c8b456ba4fdc2379fbd0961 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20251215 14:55:21.942577 9426 tablet_bootstrap.cc:492] T 2b54d7dcdcc94e58b039b9f231f38d11 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:21.945837 9435 raft_consensus.cc:359] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.946974 9435 raft_consensus.cc:385] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:21.947257 9435 raft_consensus.cc:740] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:21.947782 9435 consensus_queue.cc:260] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.948838 9435 ts_tablet_manager.cc:1434] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.010s user 0.001s sys 0.002s
I20251215 14:55:21.951776 9435 tablet_bootstrap.cc:492] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:21.952430 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 05e70b4070b6437e9b934af4e6b93f6a (table default.Table_1c4625e0c84d45528a90ab30fb24012d [id=acc631af7be84511b009b9175eacd781], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 05e70b4070b6437e9b934af4e6b93f6a consensus state has no leader
I20251215 14:55:21.956288 10559 consensus_queue.cc:1048] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:21.961447 10835 raft_consensus.cc:493] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.961597 10835 raft_consensus.cc:515] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.962188 10835 leader_election.cc:290] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.967867 9426 tablet_bootstrap.cc:654] T 2b54d7dcdcc94e58b039b9f231f38d11 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:21.974460 9435 tablet_bootstrap.cc:654] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:21.980741 9115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 57776.4us
W20251215 14:55:21.981312 8976 leader_election.cc:343] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:21.983418 10756 raft_consensus.cc:493] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.983604 10756 raft_consensus.cc:515] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.984264 10756 leader_election.cc:290] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.986125 10756 raft_consensus.cc:493] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:21.986269 10756 raft_consensus.cc:515] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:21.986888 10756 leader_election.cc:290] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:21.987807 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49bba2b78f65470182e1d361eb1272a4" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.988029 9311 raft_consensus.cc:2393] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:21.989419 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88edc14acdad47a3907078d08e118ce7" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.989625 9311 raft_consensus.cc:2393] T 88edc14acdad47a3907078d08e118ce7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:21.990747 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "032f27e7f6054188a3169a3c10ee4d09" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.992218 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9e317c8dc24e481abb709e932fa39c29" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.993041 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4078381658347a6a9d3063cc0cb3a53" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.993043 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ee44c7244b68469183a4e45baeaf5df4" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.996044 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f0e8dad82b3e4eff971b7b6845970c4f" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:21.996265 9311 raft_consensus.cc:2393] T f0e8dad82b3e4eff971b7b6845970c4f P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:21.999244 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18054b180c77403387d15fc6ee42f58f" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:22.000281 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a51cf25aab09432f92bbd3235c2ada56" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:22.000433 9177 raft_consensus.cc:3060] T a51cf25aab09432f92bbd3235c2ada56 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.003053 9177 raft_consensus.cc:2468] T a51cf25aab09432f92bbd3235c2ada56 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:22.004062 9177 raft_consensus.cc:3060] T 032f27e7f6054188a3169a3c10ee4d09 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.009294 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dc9405b80e84ae7a67a595c3596cc92" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.009835 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a856793e8b46cfb42110de5d383ff7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.009981 9178 raft_consensus.cc:2468] T b4a856793e8b46cfb42110de5d383ff7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:22.012948 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4078381658347a6a9d3063cc0cb3a53" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.018183 9435 tablet_bootstrap.cc:492] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:22.018998 9435 ts_tablet_manager.cc:1403] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.067s user 0.001s sys 0.004s
I20251215 14:55:22.019922 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "295325c4a2ca41caaabddbd96d4bce19" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.020066 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b54d7dcdcc94e58b039b9f231f38d11" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.020234 9314 raft_consensus.cc:2468] T 2b54d7dcdcc94e58b039b9f231f38d11 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:22.020077 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1c989af5bc624699b4cce2b5c95fc90e" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.020504 9306 raft_consensus.cc:2468] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:22.021195 9435 raft_consensus.cc:359] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.021350 9435 raft_consensus.cc:385] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.021405 9435 raft_consensus.cc:740] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.023437 9178 raft_consensus.cc:3060] T 9e317c8dc24e481abb709e932fa39c29 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.022466 9435 consensus_queue.cc:260] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.033834 9435 ts_tablet_manager.cc:1434] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20251215 14:55:22.034869 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "295325c4a2ca41caaabddbd96d4bce19" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.038914 9435 tablet_bootstrap.cc:492] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:22.039120 10756 raft_consensus.cc:493] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.039280 10756 raft_consensus.cc:515] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.039394 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b54d7dcdcc94e58b039b9f231f38d11" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.039882 10756 leader_election.cc:290] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.042922 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45d6eebc703414fa9028faab9fc993c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:22.043177 9029 raft_consensus.cc:2468] T d45d6eebc703414fa9028faab9fc993c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:22.044037 8978 leader_election.cc:304] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:22.044667 10756 raft_consensus.cc:2804] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.044891 10756 raft_consensus.cc:697] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:22.045123 10756 consensus_queue.cc:237] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.046862 9435 tablet_bootstrap.cc:654] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.047329 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1c989af5bc624699b4cce2b5c95fc90e" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.047619 9177 raft_consensus.cc:2468] T 1c989af5bc624699b4cce2b5c95fc90e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:22.047945 9427 tablet_bootstrap.cc:492] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:22.048076 9427 ts_tablet_manager.cc:1403] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.136s user 0.017s sys 0.034s
I20251215 14:55:22.048843 9427 raft_consensus.cc:359] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.048988 9427 raft_consensus.cc:385] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.049036 9427 raft_consensus.cc:740] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.049230 9427 consensus_queue.cc:260] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.049763 9427 ts_tablet_manager.cc:1434] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:22.050004 9427 tablet_bootstrap.cc:492] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:22.050174 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "566fe9bb8a1849749087d840ef1c082d" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.051149 8978 leader_election.cc:304] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:22.051522 9427 tablet_bootstrap.cc:654] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.051764 11030 raft_consensus.cc:2804] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.059636 9426 tablet_bootstrap.cc:492] T 2b54d7dcdcc94e58b039b9f231f38d11 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.059659 9427 tablet_bootstrap.cc:492] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:22.059784 9427 ts_tablet_manager.cc:1403] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20251215 14:55:22.059866 9426 ts_tablet_manager.cc:1403] T 2b54d7dcdcc94e58b039b9f231f38d11 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.117s user 0.006s sys 0.005s
I20251215 14:55:22.060541 9426 raft_consensus.cc:359] T 2b54d7dcdcc94e58b039b9f231f38d11 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.060571 9427 raft_consensus.cc:359] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.060721 9426 raft_consensus.cc:385] T 2b54d7dcdcc94e58b039b9f231f38d11 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.060719 9427 raft_consensus.cc:385] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.060775 9427 raft_consensus.cc:740] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.060776 9426 raft_consensus.cc:740] T 2b54d7dcdcc94e58b039b9f231f38d11 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.060958 9115 leader_election.cc:304] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.060988 9427 consensus_queue.cc:260] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.061591 9427 ts_tablet_manager.cc:1434] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:22.062028 9427 tablet_bootstrap.cc:492] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:22.063071 11112 raft_consensus.cc:3060] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.060964 9426 consensus_queue.cc:260] T 2b54d7dcdcc94e58b039b9f231f38d11 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.065467 9426 ts_tablet_manager.cc:1434] T 2b54d7dcdcc94e58b039b9f231f38d11 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251215 14:55:22.065815 9426 tablet_bootstrap.cc:492] T 5dc9405b80e84ae7a67a595c3596cc92 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.066876 11112 raft_consensus.cc:2749] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.067517 9115 leader_election.cc:304] T 88edc14acdad47a3907078d08e118ce7 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.068415 11112 raft_consensus.cc:3060] T 88edc14acdad47a3907078d08e118ce7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.069835 9426 tablet_bootstrap.cc:654] T 5dc9405b80e84ae7a67a595c3596cc92 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.073486 9427 tablet_bootstrap.cc:654] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.075722 11112 raft_consensus.cc:2749] T 88edc14acdad47a3907078d08e118ce7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:22.076115 8976 leader_election.cc:343] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.078253 11166 consensus_queue.cc:1048] T 032f27e7f6054188a3169a3c10ee4d09 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.078627 11079 raft_consensus.cc:493] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.078749 11079 raft_consensus.cc:515] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.079253 11079 leader_election.cc:290] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.079443 11166 raft_consensus.cc:493] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.079730 11166 raft_consensus.cc:515] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.080312 11166 leader_election.cc:290] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.080819 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75d0d009c76d46e8863f7137273acd97" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:22.081261 9249 leader_election.cc:343] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:22.079738 8976 leader_election.cc:343] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.083714 11038 consensus_queue.cc:1048] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.085227 8976 leader_election.cc:304] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:22.085489 10756 raft_consensus.cc:2804] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.085605 10756 raft_consensus.cc:493] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.085722 10756 raft_consensus.cc:3060] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.087142 9427 tablet_bootstrap.cc:492] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:22.087314 9427 ts_tablet_manager.cc:1403] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.003s
I20251215 14:55:22.088018 9427 raft_consensus.cc:359] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.088166 9427 raft_consensus.cc:385] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.088215 9427 raft_consensus.cc:740] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.088387 9427 consensus_queue.cc:260] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.088642 10756 raft_consensus.cc:515] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.089195 10756 leader_election.cc:290] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.089243 9427 ts_tablet_manager.cc:1434] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251215 14:55:22.089536 9427 tablet_bootstrap.cc:492] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:22.090662 8976 leader_election.cc:343] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.091867 11079 consensus_queue.cc:1048] T 437ccec0421f4bdfb8c7e6a2fcb44bca P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.092237 9427 tablet_bootstrap.cc:654] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.092871 11079 consensus_queue.cc:1048] T eb309f7c439740c89470da5636523a69 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.093338 9115 leader_election.cc:304] T 032f27e7f6054188a3169a3c10ee4d09 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.093743 11112 raft_consensus.cc:2749] T 032f27e7f6054188a3169a3c10ee4d09 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:22.094408 9248 leader_election.cc:343] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.095674 9435 tablet_bootstrap.cc:492] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
W20251215 14:55:22.095744 8976 leader_election.cc:343] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.095813 9435 ts_tablet_manager.cc:1403] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.057s user 0.000s sys 0.003s
I20251215 14:55:22.096627 9435 raft_consensus.cc:359] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.096797 9435 raft_consensus.cc:385] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.096992 9115 leader_election.cc:304] T 9e317c8dc24e481abb709e932fa39c29 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.096853 9435 raft_consensus.cc:740] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.095440 9248 leader_election.cc:304] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:22.097203 11153 raft_consensus.cc:2749] T 9e317c8dc24e481abb709e932fa39c29 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.097451 9115 leader_election.cc:304] T ee44c7244b68469183a4e45baeaf5df4 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.097570 9435 consensus_queue.cc:260] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.098708 10528 raft_consensus.cc:2749] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:22.098795 8976 leader_election.cc:343] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.099013 10528 consensus_queue.cc:1048] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.099697 8976 leader_election.cc:304] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:22.100191 11153 raft_consensus.cc:3060] T ee44c7244b68469183a4e45baeaf5df4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.100549 10835 raft_consensus.cc:2804] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.100615 10835 raft_consensus.cc:493] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.100664 10835 raft_consensus.cc:3060] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.102875 11153 raft_consensus.cc:2749] T ee44c7244b68469183a4e45baeaf5df4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.103152 10835 raft_consensus.cc:515] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.103772 10835 leader_election.cc:290] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.105742 11153 consensus_queue.cc:1048] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.106499 9426 tablet_bootstrap.cc:492] T 5dc9405b80e84ae7a67a595c3596cc92 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.106638 9426 ts_tablet_manager.cc:1403] T 5dc9405b80e84ae7a67a595c3596cc92 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.002s
W20251215 14:55:22.106968 8976 leader_election.cc:343] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.107221 9115 leader_election.cc:304] T f0e8dad82b3e4eff971b7b6845970c4f P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.110162 11030 raft_consensus.cc:697] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:22.113269 11030 consensus_queue.cc:237] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.114418 11153 raft_consensus.cc:3060] T f0e8dad82b3e4eff971b7b6845970c4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.114398 9435 ts_tablet_manager.cc:1434] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.019s user 0.003s sys 0.000s
I20251215 14:55:22.115756 9435 tablet_bootstrap.cc:492] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:22.107339 9426 raft_consensus.cc:359] T 5dc9405b80e84ae7a67a595c3596cc92 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.116776 9426 raft_consensus.cc:385] T 5dc9405b80e84ae7a67a595c3596cc92 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.116848 9426 raft_consensus.cc:740] T 5dc9405b80e84ae7a67a595c3596cc92 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.117025 9426 consensus_queue.cc:260] T 5dc9405b80e84ae7a67a595c3596cc92 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.117578 11153 raft_consensus.cc:2749] T f0e8dad82b3e4eff971b7b6845970c4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.117816 10559 raft_consensus.cc:493] T 06cb17538a7541358548f25303e91d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.117913 10559 raft_consensus.cc:515] T 06cb17538a7541358548f25303e91d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:22.118410 10559 leader_election.cc:290] T 06cb17538a7541358548f25303e91d37 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:22.117631 9426 ts_tablet_manager.cc:1434] T 5dc9405b80e84ae7a67a595c3596cc92 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20251215 14:55:22.119403 9426 tablet_bootstrap.cc:492] T 548e6d35016746e2b8f5184ee44071cb P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.119728 10559 consensus_queue.cc:1048] T f9a0c31abcf046c9b76bea3f946ba9fc P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:22.112123 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 60550us
I20251215 14:55:22.123447 9426 tablet_bootstrap.cc:654] T 548e6d35016746e2b8f5184ee44071cb P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.124738 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06cb17538a7541358548f25303e91d37" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:22.125376 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06cb17538a7541358548f25303e91d37" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.125597 9308 raft_consensus.cc:2393] T 06cb17538a7541358548f25303e91d37 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:22.130038 8978 leader_election.cc:304] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.131233 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fb37d6a27554a44846e66c3ac2730f0" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.131811 10835 raft_consensus.cc:2804] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.131906 10835 raft_consensus.cc:493] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.131975 10835 raft_consensus.cc:3060] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.134814 10835 raft_consensus.cc:515] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.136340 10835 leader_election.cc:290] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.136790 11030 raft_consensus.cc:493] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.136924 11030 raft_consensus.cc:515] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.137948 11030 leader_election.cc:290] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.139454 9426 tablet_bootstrap.cc:492] T 548e6d35016746e2b8f5184ee44071cb P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.139612 9426 ts_tablet_manager.cc:1403] T 548e6d35016746e2b8f5184ee44071cb P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.005s
I20251215 14:55:22.139649 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a856793e8b46cfb42110de5d383ff7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:22.139842 9178 raft_consensus.cc:3060] T b4a856793e8b46cfb42110de5d383ff7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.140400 9426 raft_consensus.cc:359] T 548e6d35016746e2b8f5184ee44071cb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.140743 9426 raft_consensus.cc:385] T 548e6d35016746e2b8f5184ee44071cb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.140798 9426 raft_consensus.cc:740] T 548e6d35016746e2b8f5184ee44071cb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.140313 9248 leader_election.cc:304] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.141788 10528 raft_consensus.cc:2804] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.141866 10528 raft_consensus.cc:493] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.141918 10528 raft_consensus.cc:3060] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.142796 9178 raft_consensus.cc:2468] T b4a856793e8b46cfb42110de5d383ff7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:22.144039 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1c989af5bc624699b4cce2b5c95fc90e" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:22.144192 9178 raft_consensus.cc:3060] T 1c989af5bc624699b4cce2b5c95fc90e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.144500 10528 raft_consensus.cc:515] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.145130 10528 leader_election.cc:290] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.146010 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45d6eebc703414fa9028faab9fc993c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:22.146556 9249 leader_election.cc:343] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.146750 9178 raft_consensus.cc:2468] T 1c989af5bc624699b4cce2b5c95fc90e P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:22.150022 9426 consensus_queue.cc:260] T 548e6d35016746e2b8f5184ee44071cb P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.150755 9426 ts_tablet_manager.cc:1434] T 548e6d35016746e2b8f5184ee44071cb P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.011s user 0.002s sys 0.001s
I20251215 14:55:22.151116 9426 tablet_bootstrap.cc:492] T ce147d1fcda2480daa557276c33a6096 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.151826 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dc9405b80e84ae7a67a595c3596cc92" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:22.152040 9177 raft_consensus.cc:3060] T 5dc9405b80e84ae7a67a595c3596cc92 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.151980 10528 consensus_queue.cc:1048] T e9124dd3d98947b29289e0561976ada4 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.152978 9426 tablet_bootstrap.cc:654] T ce147d1fcda2480daa557276c33a6096 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.154685 9177 raft_consensus.cc:2468] T 5dc9405b80e84ae7a67a595c3596cc92 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
W20251215 14:55:22.158147 8978 leader_election.cc:343] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.158603 8978 leader_election.cc:304] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.159111 10835 raft_consensus.cc:2749] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.159890 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75d0d009c76d46e8863f7137273acd97" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.160961 9427 tablet_bootstrap.cc:492] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:22.161089 9427 ts_tablet_manager.cc:1403] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.072s user 0.000s sys 0.008s
I20251215 14:55:22.161906 9427 raft_consensus.cc:359] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.162063 9427 raft_consensus.cc:385] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.162114 9427 raft_consensus.cc:740] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.162297 9427 consensus_queue.cc:260] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.162770 9427 ts_tablet_manager.cc:1434] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:22.162777 10528 consensus_queue.cc:1048] T 6947983b19ee4ca59349979c6662bc1c P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.163031 9427 tablet_bootstrap.cc:492] T 042632f0dabd4a79a36a5f27bef12faa P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:22.164146 9029 raft_consensus.cc:1275] T d4cff0ed3782446397dbae8a2da52ed7 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Refusing update from remote peer e89303a500544272b601d7c29be802b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 14:55:22.167466 9427 tablet_bootstrap.cc:654] T 042632f0dabd4a79a36a5f27bef12faa P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.170782 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75d0d009c76d46e8863f7137273acd97" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:22.170936 9024 raft_consensus.cc:2468] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:22.170233 9435 tablet_bootstrap.cc:654] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.178575 9426 tablet_bootstrap.cc:492] T ce147d1fcda2480daa557276c33a6096 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.178741 9426 ts_tablet_manager.cc:1403] T ce147d1fcda2480daa557276c33a6096 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.005s
I20251215 14:55:22.179489 9426 raft_consensus.cc:359] T ce147d1fcda2480daa557276c33a6096 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.179689 9426 raft_consensus.cc:385] T ce147d1fcda2480daa557276c33a6096 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.179746 9426 raft_consensus.cc:740] T ce147d1fcda2480daa557276c33a6096 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.179945 9426 consensus_queue.cc:260] T ce147d1fcda2480daa557276c33a6096 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.180470 9426 ts_tablet_manager.cc:1434] T ce147d1fcda2480daa557276c33a6096 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:22.180778 9426 tablet_bootstrap.cc:492] T 18054b180c77403387d15fc6ee42f58f P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.182456 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45d6eebc703414fa9028faab9fc993c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:22.182555 9426 tablet_bootstrap.cc:654] T 18054b180c77403387d15fc6ee42f58f P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.182642 9030 raft_consensus.cc:3060] T d45d6eebc703414fa9028faab9fc993c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.185030 9030 raft_consensus.cc:2468] T d45d6eebc703414fa9028faab9fc993c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:22.189666 10832 raft_consensus.cc:493] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.189801 10832 raft_consensus.cc:515] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.190335 10832 leader_election.cc:290] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.190433 10832 raft_consensus.cc:493] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.190521 10832 raft_consensus.cc:515] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.190963 10832 leader_election.cc:290] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.204952 9426 tablet_bootstrap.cc:492] T 18054b180c77403387d15fc6ee42f58f P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.205130 9426 ts_tablet_manager.cc:1403] T 18054b180c77403387d15fc6ee42f58f P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.024s user 0.003s sys 0.001s
I20251215 14:55:22.206082 9426 raft_consensus.cc:359] T 18054b180c77403387d15fc6ee42f58f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.206285 9426 raft_consensus.cc:385] T 18054b180c77403387d15fc6ee42f58f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.206343 9426 raft_consensus.cc:740] T 18054b180c77403387d15fc6ee42f58f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.206758 9426 consensus_queue.cc:260] T 18054b180c77403387d15fc6ee42f58f P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.207314 9426 ts_tablet_manager.cc:1434] T 18054b180c77403387d15fc6ee42f58f P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20251215 14:55:22.207720 9426 tablet_bootstrap.cc:492] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.209816 9426 tablet_bootstrap.cc:654] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:22.210683 8976 leader_election.cc:343] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.211053 8976 leader_election.cc:304] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:22.211540 8976 leader_election.cc:304] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:22.212910 10756 consensus_queue.cc:1048] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.213337 10756 raft_consensus.cc:2804] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.213443 10756 raft_consensus.cc:697] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:22.213543 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "566fe9bb8a1849749087d840ef1c082d" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.213704 10756 consensus_queue.cc:237] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.215349 10832 raft_consensus.cc:2804] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.215369 11174 raft_consensus.cc:493] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.215478 10832 raft_consensus.cc:697] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:22.215500 11174 raft_consensus.cc:515] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.215699 10832 consensus_queue.cc:237] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.216377 11174 leader_election.cc:290] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.216502 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a98e436ade941989e40e34578572e3b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:22.217000 9249 leader_election.cc:343] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.221786 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fb37d6a27554a44846e66c3ac2730f0" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.227212 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ebeebb8f49ef4858804e2ed0b31b2196" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.227746 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a856793e8b46cfb42110de5d383ff7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:22.227984 9312 raft_consensus.cc:3060] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.228104 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d88741012a814d41ac074e86805f492d" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.230741 9312 raft_consensus.cc:2468] T b4a856793e8b46cfb42110de5d383ff7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:22.234040 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1c989af5bc624699b4cce2b5c95fc90e" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:22.234303 9312 raft_consensus.cc:3060] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.236922 9312 raft_consensus.cc:2468] T 1c989af5bc624699b4cce2b5c95fc90e P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:22.233697 9435 tablet_bootstrap.cc:492] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:22.237993 9435 ts_tablet_manager.cc:1403] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.123s user 0.005s sys 0.002s
I20251215 14:55:22.247742 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a98e436ade941989e40e34578572e3b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:22.248081 9024 raft_consensus.cc:2468] T 4a98e436ade941989e40e34578572e3b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:22.249102 9435 raft_consensus.cc:359] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.250686 9435 raft_consensus.cc:385] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.252079 10528 consensus_queue.cc:1048] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:22.162810 8978 leader_election.cc:343] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.252943 8978 leader_election.cc:304] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.251653 9435 raft_consensus.cc:740] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.254354 9435 consensus_queue.cc:260] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.256553 10528 consensus_queue.cc:1048] T d4cff0ed3782446397dbae8a2da52ed7 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:22.260074 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:22.260313 11174 consensus_queue.cc:1048] T c902ad68a5c448828eb3ac419ffaca81 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:22.260855 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 98089.1us
I20251215 14:55:22.261355 8978 leader_election.cc:304] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.261502 9435 ts_tablet_manager.cc:1434] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.023s user 0.003s sys 0.000s
I20251215 14:55:22.261713 9248 leader_election.cc:304] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.262151 11030 raft_consensus.cc:2749] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.262362 11030 raft_consensus.cc:2804] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.262473 11030 raft_consensus.cc:493] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.262450 10528 raft_consensus.cc:2804] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.262583 11030 raft_consensus.cc:3060] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.262584 10528 raft_consensus.cc:493] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.262786 10528 raft_consensus.cc:3060] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.265272 11030 raft_consensus.cc:515] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.266219 11030 leader_election.cc:290] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.267611 9435 tablet_bootstrap.cc:492] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:22.271062 9248 leader_election.cc:304] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.272136 11174 raft_consensus.cc:2804] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.272295 11079 raft_consensus.cc:493] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.272400 11079 raft_consensus.cc:515] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.272912 11079 leader_election.cc:290] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.273505 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "66249f9be0334affb4f4b0e7dd9212ea" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:22.274111 9249 leader_election.cc:343] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.274335 11174 raft_consensus.cc:697] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:22.275002 11174 consensus_queue.cc:237] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.278180 9427 tablet_bootstrap.cc:492] T 042632f0dabd4a79a36a5f27bef12faa P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:22.278180 9426 tablet_bootstrap.cc:492] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.278309 9427 ts_tablet_manager.cc:1403] T 042632f0dabd4a79a36a5f27bef12faa P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.115s user 0.002s sys 0.016s
I20251215 14:55:22.278309 9426 ts_tablet_manager.cc:1403] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.071s user 0.004s sys 0.001s
W20251215 14:55:22.279440 8978 leader_election.cc:343] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.279609 8978 leader_election.cc:304] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.279968 9427 raft_consensus.cc:359] T 042632f0dabd4a79a36a5f27bef12faa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.280124 9427 raft_consensus.cc:385] T 042632f0dabd4a79a36a5f27bef12faa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.280184 9427 raft_consensus.cc:740] T 042632f0dabd4a79a36a5f27bef12faa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.280428 9427 consensus_queue.cc:260] T 042632f0dabd4a79a36a5f27bef12faa P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.280691 11165 raft_consensus.cc:2749] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.280907 9427 ts_tablet_manager.cc:1434] T 042632f0dabd4a79a36a5f27bef12faa P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:22.281160 9427 tablet_bootstrap.cc:492] T cf6e4aa94f79403588dd1916226660fd P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:22.280534 8978 leader_election.cc:343] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.281368 8978 leader_election.cc:304] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.282269 9112 leader_election.cc:304] T 06cb17538a7541358548f25303e91d37 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.282514 10991 raft_consensus.cc:3060] T 06cb17538a7541358548f25303e91d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.282744 11165 raft_consensus.cc:2749] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.279071 9426 raft_consensus.cc:359] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.286561 9427 tablet_bootstrap.cc:654] T cf6e4aa94f79403588dd1916226660fd P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.284953 10991 raft_consensus.cc:2749] T 06cb17538a7541358548f25303e91d37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.286818 9426 raft_consensus.cc:385] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.286933 9426 raft_consensus.cc:740] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.287199 9426 consensus_queue.cc:260] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.289786 9426 ts_tablet_manager.cc:1434] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20251215 14:55:22.297758 9426 tablet_bootstrap.cc:492] T 26e8a00c0065406d826271d103f892ba P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:22.298172 8976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 86417.4us
I20251215 14:55:22.299937 8976 leader_election.cc:304] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:22.300366 10832 raft_consensus.cc:2804] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.300473 10832 raft_consensus.cc:697] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:22.300712 10832 consensus_queue.cc:237] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:22.302506 8976 leader_election.cc:343] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:22.303548 8976 leader_election.cc:343] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:22.304479 8976 leader_election.cc:343] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.306452 10756 raft_consensus.cc:493] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.306641 10756 raft_consensus.cc:515] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.307376 10756 leader_election.cc:290] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:22.310750 8775 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 7f9c173d11f1449b829a54190313bea3 (table default.Table_5227b3b62b1843ea9a43fecb24c0fd07 [id=1ff1a56115104321ba6aafed10d1506d], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7f9c173d11f1449b829a54190313bea3 consensus state has no leader
I20251215 14:55:22.307468 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b54d7dcdcc94e58b039b9f231f38d11" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:22.308156 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fea3a1616074fdd81242bc44e76cc2c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.311336 9175 raft_consensus.cc:3060] T 2b54d7dcdcc94e58b039b9f231f38d11 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.311961 10832 raft_consensus.cc:493] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.312070 10832 raft_consensus.cc:515] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.312861 9426 tablet_bootstrap.cc:654] T 26e8a00c0065406d826271d103f892ba P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.312866 10832 leader_election.cc:290] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:22.313115 8976 leader_election.cc:343] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.313599 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14450105328041cdbd93969b756d9fa0" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.313853 9175 raft_consensus.cc:2468] T 2b54d7dcdcc94e58b039b9f231f38d11 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
W20251215 14:55:22.314047 8976 leader_election.cc:343] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.311018 10991 consensus_queue.cc:1048] T 6be5f3269d9147d780f782bb5665b8b6 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.314612 10528 raft_consensus.cc:515] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.321038 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75d0d009c76d46e8863f7137273acd97" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:22.321512 9249 leader_election.cc:343] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.322916 9248 leader_election.cc:304] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.323354 11079 raft_consensus.cc:2804] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.323423 11079 raft_consensus.cc:493] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.323473 11079 raft_consensus.cc:3060] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.325851 11079 raft_consensus.cc:515] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.327256 11079 leader_election.cc:290] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.327564 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a98e436ade941989e40e34578572e3b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:22.328066 9249 leader_election.cc:343] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.328616 9435 tablet_bootstrap.cc:654] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.330343 8976 leader_election.cc:304] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:22.331023 10528 leader_election.cc:290] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.331416 10756 raft_consensus.cc:2804] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.331548 10756 raft_consensus.cc:697] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:22.331784 10756 consensus_queue.cc:237] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.333628 10756 consensus_queue.cc:1048] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.346755 11174 consensus_queue.cc:1048] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.353976 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "66249f9be0334affb4f4b0e7dd9212ea" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:22.366632 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75d0d009c76d46e8863f7137273acd97" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:22.366964 9029 raft_consensus.cc:3060] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.369974 9029 raft_consensus.cc:2468] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:22.372253 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a98e436ade941989e40e34578572e3b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:22.372676 9426 tablet_bootstrap.cc:492] T 26e8a00c0065406d826271d103f892ba P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.372815 9426 ts_tablet_manager.cc:1403] T 26e8a00c0065406d826271d103f892ba P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.075s user 0.012s sys 0.015s
I20251215 14:55:22.372606 9029 raft_consensus.cc:3060] T 4a98e436ade941989e40e34578572e3b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.373521 9426 raft_consensus.cc:359] T 26e8a00c0065406d826271d103f892ba P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.373687 9426 raft_consensus.cc:385] T 26e8a00c0065406d826271d103f892ba P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.373736 9426 raft_consensus.cc:740] T 26e8a00c0065406d826271d103f892ba P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.373911 9426 consensus_queue.cc:260] T 26e8a00c0065406d826271d103f892ba P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.376026 11166 raft_consensus.cc:493] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.376161 11166 raft_consensus.cc:515] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.376752 11166 leader_election.cc:290] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.376749 9435 tablet_bootstrap.cc:492] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:22.377336 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25615ca6c21d4d5f8880d3dff4253e61" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.377616 9435 ts_tablet_manager.cc:1403] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.111s user 0.005s sys 0.002s
W20251215 14:55:22.377987 8976 leader_election.cc:343] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.379683 9426 ts_tablet_manager.cc:1434] T 26e8a00c0065406d826271d103f892ba P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20251215 14:55:22.379951 9426 tablet_bootstrap.cc:492] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.380942 10991 raft_consensus.cc:493] T ce147d1fcda2480daa557276c33a6096 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.381053 10991 raft_consensus.cc:515] T ce147d1fcda2480daa557276c33a6096 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.381556 10991 leader_election.cc:290] T ce147d1fcda2480daa557276c33a6096 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:22.382212 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce147d1fcda2480daa557276c33a6096" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.382414 9312 raft_consensus.cc:2393] T ce147d1fcda2480daa557276c33a6096 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:22.381466 9037 raft_consensus.cc:1275] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Refusing update from remote peer 3ea5306c36594ef4a62211f2bd6669a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20251215 14:55:22.382678 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce147d1fcda2480daa557276c33a6096" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:22.382781 9037 pending_rounds.cc:85] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156: Aborting all ops after (but not including) 0
I20251215 14:55:22.382853 9037 pending_rounds.cc:107] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20251215 14:55:22.382946 9037 raft_consensus.cc:2889] T d09d7ce93d074bfaa830130b31bcc594 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20251215 14:55:22.383512 10991 consensus_queue.cc:1048] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.384506 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dc9405b80e84ae7a67a595c3596cc92" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:22.384639 9312 raft_consensus.cc:3060] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.385619 9115 leader_election.cc:304] T ce147d1fcda2480daa557276c33a6096 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.385857 10991 raft_consensus.cc:3060] T ce147d1fcda2480daa557276c33a6096 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.386641 11166 consensus_queue.cc:1048] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.387274 9312 raft_consensus.cc:2468] T 5dc9405b80e84ae7a67a595c3596cc92 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:22.388167 10991 raft_consensus.cc:2749] T ce147d1fcda2480daa557276c33a6096 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.390089 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75d0d009c76d46e8863f7137273acd97" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.390357 9312 raft_consensus.cc:2393] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:22.392562 9435 raft_consensus.cc:359] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.396601 9427 tablet_bootstrap.cc:492] T cf6e4aa94f79403588dd1916226660fd P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:22.396281 9435 raft_consensus.cc:385] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.396749 9427 ts_tablet_manager.cc:1403] T cf6e4aa94f79403588dd1916226660fd P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.116s user 0.007s sys 0.007s
I20251215 14:55:22.397192 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ebeebb8f49ef4858804e2ed0b31b2196" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.397534 9312 raft_consensus.cc:2468] T ebeebb8f49ef4858804e2ed0b31b2196 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:22.397537 9427 raft_consensus.cc:359] T cf6e4aa94f79403588dd1916226660fd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.397709 9427 raft_consensus.cc:385] T cf6e4aa94f79403588dd1916226660fd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.397773 9427 raft_consensus.cc:740] T cf6e4aa94f79403588dd1916226660fd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.396963 9435 raft_consensus.cc:740] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.398911 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d88741012a814d41ac074e86805f492d" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.400068 9435 consensus_queue.cc:260] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.403013 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b54d7dcdcc94e58b039b9f231f38d11" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:22.403244 9312 raft_consensus.cc:3060] T 2b54d7dcdcc94e58b039b9f231f38d11 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.407706 9426 tablet_bootstrap.cc:654] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.409027 9312 raft_consensus.cc:2468] T 2b54d7dcdcc94e58b039b9f231f38d11 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:22.409382 9427 consensus_queue.cc:260] T cf6e4aa94f79403588dd1916226660fd P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.410104 9427 ts_tablet_manager.cc:1434] T cf6e4aa94f79403588dd1916226660fd P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s
I20251215 14:55:22.410416 9427 tablet_bootstrap.cc:492] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:22.413218 9435 ts_tablet_manager.cc:1434] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.034s user 0.003s sys 0.000s
I20251215 14:55:22.416702 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14450105328041cdbd93969b756d9fa0" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.416509 9435 tablet_bootstrap.cc:492] T d88741012a814d41ac074e86805f492d P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:22.416889 9303 raft_consensus.cc:2468] T 14450105328041cdbd93969b756d9fa0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:22.415822 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fea3a1616074fdd81242bc44e76cc2c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.417271 9312 raft_consensus.cc:2468] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:22.418591 9029 raft_consensus.cc:2468] T 4a98e436ade941989e40e34578572e3b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:22.425256 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25615ca6c21d4d5f8880d3dff4253e61" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.433096 9426 tablet_bootstrap.cc:492] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.433728 8978 leader_election.cc:304] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.433983 11167 raft_consensus.cc:2749] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.434629 9435 tablet_bootstrap.cc:654] T d88741012a814d41ac074e86805f492d P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.436443 8978 leader_election.cc:304] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
W20251215 14:55:22.437289 8978 leader_election.cc:343] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.437426 8978 leader_election.cc:304] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.437932 10832 raft_consensus.cc:2804] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.438006 10832 raft_consensus.cc:493] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.438063 10832 raft_consensus.cc:3060] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.438623 11165 raft_consensus.cc:2749] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.439358 9426 ts_tablet_manager.cc:1403] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.001s
I20251215 14:55:22.440197 9426 raft_consensus.cc:359] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.440366 9426 raft_consensus.cc:385] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.440416 9426 raft_consensus.cc:740] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.440598 9426 consensus_queue.cc:260] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.442494 9427 tablet_bootstrap.cc:654] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.443102 9426 ts_tablet_manager.cc:1434] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:22.443508 9426 tablet_bootstrap.cc:492] T 4a98e436ade941989e40e34578572e3b P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.445209 9426 tablet_bootstrap.cc:654] T 4a98e436ade941989e40e34578572e3b P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.445657 11174 consensus_queue.cc:1048] T 6140a160980d49b09a5fda8475fc144f P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:22.446601 9248 leader_election.cc:343] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.447019 9248 leader_election.cc:304] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:22.447702 8978 leader_election.cc:304] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.447804 11192 consensus_queue.cc:1048] T 88edc14acdad47a3907078d08e118ce7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.448107 11174 raft_consensus.cc:2749] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.448101 8978 leader_election.cc:304] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.448215 11192 raft_consensus.cc:2804] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.448273 11192 raft_consensus.cc:493] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.448340 11192 raft_consensus.cc:3060] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.448362 10832 raft_consensus.cc:515] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.448935 10832 leader_election.cc:290] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.449595 10832 raft_consensus.cc:2804] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.449672 10832 raft_consensus.cc:493] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.449728 10832 raft_consensus.cc:3060] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.450876 11192 raft_consensus.cc:515] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.451526 11166 consensus_queue.cc:1048] T f0e8dad82b3e4eff971b7b6845970c4f P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.451901 10832 raft_consensus.cc:515] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.452425 10832 leader_election.cc:290] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.452203 9248 leader_election.cc:304] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.453121 11174 raft_consensus.cc:2804] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.453322 11174 raft_consensus.cc:697] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:22.453572 11174 consensus_queue.cc:237] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.453730 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ebeebb8f49ef4858804e2ed0b31b2196" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:22.454047 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fea3a1616074fdd81242bc44e76cc2c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:22.454607 9308 raft_consensus.cc:1275] T d09d7ce93d074bfaa830130b31bcc594 P e89303a500544272b601d7c29be802b4 [term 2 FOLLOWER]: Refusing update from remote peer 3ea5306c36594ef4a62211f2bd6669a3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 14:55:22.455298 11153 raft_consensus.cc:493] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.455406 11153 raft_consensus.cc:515] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.455919 11153 leader_election.cc:290] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:22.457113 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c4be1c01418432492268598f97289a0" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.457300 9308 raft_consensus.cc:2468] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
W20251215 14:55:22.458096 8976 leader_election.cc:343] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:22.458304 8976 leader_election.cc:343] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.458797 11153 consensus_queue.cc:1048] T d09d7ce93d074bfaa830130b31bcc594 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.459478 9115 leader_election.cc:304] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:22.461033 11165 consensus_queue.cc:1048] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.461490 11153 raft_consensus.cc:2804] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.461562 11153 raft_consensus.cc:493] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.461616 11153 raft_consensus.cc:3060] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.464125 11153 raft_consensus.cc:515] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.467031 9248 leader_election.cc:304] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.467887 11174 raft_consensus.cc:2804] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.468199 11174 raft_consensus.cc:697] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:22.468667 11174 consensus_queue.cc:237] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.472014 11153 leader_election.cc:290] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:22.473397 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c4be1c01418432492268598f97289a0" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:22.473548 9312 raft_consensus.cc:3060] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.476192 9312 raft_consensus.cc:2468] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:22.479741 9115 leader_election.cc:304] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:22.480500 10559 raft_consensus.cc:2804] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.480623 10559 raft_consensus.cc:697] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:22.480860 10559 consensus_queue.cc:237] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.485641 10528 consensus_queue.cc:1048] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.493742 11192 leader_election.cc:290] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.494880 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14450105328041cdbd93969b756d9fa0" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:22.495602 9435 tablet_bootstrap.cc:492] T d88741012a814d41ac074e86805f492d P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:22.495882 9435 ts_tablet_manager.cc:1403] T d88741012a814d41ac074e86805f492d P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.080s user 0.005s sys 0.005s
W20251215 14:55:22.496003 8976 leader_election.cc:343] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.497514 9435 raft_consensus.cc:359] T d88741012a814d41ac074e86805f492d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.497849 9435 raft_consensus.cc:385] T d88741012a814d41ac074e86805f492d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.497985 9435 raft_consensus.cc:740] T d88741012a814d41ac074e86805f492d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.499886 9172 raft_consensus.cc:3060] T 4167c404f73e484abcb2e5b30431b28c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.504294 11098 consensus_queue.cc:1048] T 4167c404f73e484abcb2e5b30431b28c P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.511447 8678 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu with pid 10152
I20251215 14:55:22.522192 11192 raft_consensus.cc:493] T 9c4be1c01418432492268598f97289a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.522442 11098 consensus_queue.cc:1048] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.522444 11192 raft_consensus.cc:515] T 9c4be1c01418432492268598f97289a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.523461 11192 leader_election.cc:290] T 9c4be1c01418432492268598f97289a0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.531152 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c4be1c01418432492268598f97289a0" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.519951 9435 consensus_queue.cc:260] T d88741012a814d41ac074e86805f492d P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:22.545558 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 96859.6us
W20251215 14:55:22.545913 8978 leader_election.cc:343] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.546056 8978 leader_election.cc:304] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.546612 11192 raft_consensus.cc:2749] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.546789 11192 consensus_queue.cc:1048] T 06cb17538a7541358548f25303e91d37 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.548353 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c4be1c01418432492268598f97289a0" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:22.548534 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c4be1c01418432492268598f97289a0" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:22.548588 9024 raft_consensus.cc:3060] T 9c4be1c01418432492268598f97289a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.549170 11098 raft_consensus.cc:493] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.549295 11098 raft_consensus.cc:515] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.549794 11098 leader_election.cc:290] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.551098 9435 ts_tablet_manager.cc:1434] T d88741012a814d41ac074e86805f492d P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.055s user 0.001s sys 0.001s
I20251215 14:55:22.551316 9024 raft_consensus.cc:2468] T 9c4be1c01418432492268598f97289a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:22.551631 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10cd2cbd7956444cb125d97310d2b102" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.555835 9427 tablet_bootstrap.cc:492] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:22.556113 9427 ts_tablet_manager.cc:1403] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.146s user 0.015s sys 0.006s
I20251215 14:55:22.557109 9427 raft_consensus.cc:359] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.557463 9427 raft_consensus.cc:385] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.557595 9427 raft_consensus.cc:740] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.557919 9427 consensus_queue.cc:260] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.558533 9427 ts_tablet_manager.cc:1434] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:22.559115 9427 tablet_bootstrap.cc:492] T 10cd2cbd7956444cb125d97310d2b102 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:22.561269 9427 tablet_bootstrap.cc:654] T 10cd2cbd7956444cb125d97310d2b102 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.563524 9426 tablet_bootstrap.cc:492] T 4a98e436ade941989e40e34578572e3b P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.563756 9426 ts_tablet_manager.cc:1403] T 4a98e436ade941989e40e34578572e3b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.120s user 0.011s sys 0.007s
W20251215 14:55:22.552356 9249 leader_election.cc:343] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.569620 9426 raft_consensus.cc:359] T 4a98e436ade941989e40e34578572e3b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.569819 9426 raft_consensus.cc:385] T 4a98e436ade941989e40e34578572e3b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.569877 9426 raft_consensus.cc:740] T 4a98e436ade941989e40e34578572e3b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.568598 9435 tablet_bootstrap.cc:492] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:22.570082 9426 consensus_queue.cc:260] T 4a98e436ade941989e40e34578572e3b P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.570580 9426 ts_tablet_manager.cc:1434] T 4a98e436ade941989e40e34578572e3b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20251215 14:55:22.570724 9178 raft_consensus.cc:3060] T e79295168c8b456ba4fdc2379fbd0961 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.570858 9426 tablet_bootstrap.cc:492] T e4078381658347a6a9d3063cc0cb3a53 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.571944 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ebeebb8f49ef4858804e2ed0b31b2196" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:22.572095 9312 raft_consensus.cc:3060] T ebeebb8f49ef4858804e2ed0b31b2196 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.574429 9312 raft_consensus.cc:2468] T ebeebb8f49ef4858804e2ed0b31b2196 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:22.579770 9426 tablet_bootstrap.cc:654] T e4078381658347a6a9d3063cc0cb3a53 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.586618 9435 tablet_bootstrap.cc:654] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.586684 11218 consensus_queue.cc:1048] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20251215 14:55:22.588943 9427 tablet_bootstrap.cc:492] T 10cd2cbd7956444cb125d97310d2b102 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:22.589120 9427 ts_tablet_manager.cc:1403] T 10cd2cbd7956444cb125d97310d2b102 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.006s
I20251215 14:55:22.589818 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fea3a1616074fdd81242bc44e76cc2c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:22.589975 9312 raft_consensus.cc:3060] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.590018 9427 raft_consensus.cc:359] T 10cd2cbd7956444cb125d97310d2b102 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.590210 9427 raft_consensus.cc:385] T 10cd2cbd7956444cb125d97310d2b102 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.590297 9427 raft_consensus.cc:740] T 10cd2cbd7956444cb125d97310d2b102 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.590507 9427 consensus_queue.cc:260] T 10cd2cbd7956444cb125d97310d2b102 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.591034 9427 ts_tablet_manager.cc:1434] T 10cd2cbd7956444cb125d97310d2b102 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:22.592654 9312 raft_consensus.cc:2468] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:22.595373 9427 tablet_bootstrap.cc:492] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:22.596427 9426 tablet_bootstrap.cc:492] T e4078381658347a6a9d3063cc0cb3a53 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.596706 9426 ts_tablet_manager.cc:1403] T e4078381658347a6a9d3063cc0cb3a53 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.026s user 0.007s sys 0.000s
I20251215 14:55:22.597548 9426 raft_consensus.cc:359] T e4078381658347a6a9d3063cc0cb3a53 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.602720 9426 raft_consensus.cc:385] T e4078381658347a6a9d3063cc0cb3a53 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.602872 9426 raft_consensus.cc:740] T e4078381658347a6a9d3063cc0cb3a53 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.603127 9426 consensus_queue.cc:260] T e4078381658347a6a9d3063cc0cb3a53 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.603828 9426 ts_tablet_manager.cc:1434] T e4078381658347a6a9d3063cc0cb3a53 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20251215 14:55:22.604156 9426 tablet_bootstrap.cc:492] T 75d0d009c76d46e8863f7137273acd97 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.606317 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14450105328041cdbd93969b756d9fa0" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:22.606474 9427 tablet_bootstrap.cc:654] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.606474 9303 raft_consensus.cc:3060] T 14450105328041cdbd93969b756d9fa0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.608981 9303 raft_consensus.cc:2468] T 14450105328041cdbd93969b756d9fa0 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:22.610479 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c4be1c01418432492268598f97289a0" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.610661 9426 tablet_bootstrap.cc:654] T 75d0d009c76d46e8863f7137273acd97 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.610673 9303 raft_consensus.cc:2393] T 9c4be1c01418432492268598f97289a0 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:22.631733 8978 leader_election.cc:304] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.632032 11218 raft_consensus.cc:2804] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.632174 11218 raft_consensus.cc:697] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:22.632440 11218 consensus_queue.cc:237] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.643651 8978 leader_election.cc:304] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.644165 11218 raft_consensus.cc:2804] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.644325 11218 raft_consensus.cc:697] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:22.644652 11218 consensus_queue.cc:237] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.660636 8978 leader_election.cc:304] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.661631 11218 raft_consensus.cc:2804] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.661867 11218 raft_consensus.cc:697] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:22.662142 11218 consensus_queue.cc:237] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.664024 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10cd2cbd7956444cb125d97310d2b102" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:22.664283 9029 raft_consensus.cc:2468] T 10cd2cbd7956444cb125d97310d2b102 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:22.668728 9435 tablet_bootstrap.cc:492] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:22.668864 9435 ts_tablet_manager.cc:1403] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.101s user 0.005s sys 0.000s
I20251215 14:55:22.669598 9435 raft_consensus.cc:359] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.669739 9435 raft_consensus.cc:385] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.669781 9435 raft_consensus.cc:740] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.669970 9435 consensus_queue.cc:260] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.671125 8978 leader_election.cc:304] T 9c4be1c01418432492268598f97289a0 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.671564 10832 raft_consensus.cc:2749] T 9c4be1c01418432492268598f97289a0 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.673579 10832 consensus_queue.cc:1048] T ce147d1fcda2480daa557276c33a6096 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.683655 9435 ts_tablet_manager.cc:1434] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s
I20251215 14:55:22.686347 9435 tablet_bootstrap.cc:492] T 295325c4a2ca41caaabddbd96d4bce19 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:22.693426 9426 tablet_bootstrap.cc:492] T 75d0d009c76d46e8863f7137273acd97 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.694638 9426 ts_tablet_manager.cc:1403] T 75d0d009c76d46e8863f7137273acd97 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.090s user 0.014s sys 0.018s
I20251215 14:55:22.696885 9427 tablet_bootstrap.cc:492] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:22.697706 9427 ts_tablet_manager.cc:1403] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.102s user 0.010s sys 0.022s
I20251215 14:55:22.698840 9427 raft_consensus.cc:359] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.699129 11098 raft_consensus.cc:493] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.699301 11098 raft_consensus.cc:515] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.699934 11098 leader_election.cc:290] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.700579 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf6e4aa94f79403588dd1916226660fd" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:22.701252 9249 leader_election.cc:343] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.701092 9426 raft_consensus.cc:359] T 75d0d009c76d46e8863f7137273acd97 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.701705 11098 consensus_queue.cc:1048] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.702005 9426 raft_consensus.cc:385] T 75d0d009c76d46e8863f7137273acd97 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.702425 9248 leader_election.cc:304] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.702559 9426 raft_consensus.cc:740] T 75d0d009c76d46e8863f7137273acd97 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.702898 11098 raft_consensus.cc:2804] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.702968 11098 raft_consensus.cc:493] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.703025 11098 raft_consensus.cc:3060] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.703482 9435 tablet_bootstrap.cc:654] T 295325c4a2ca41caaabddbd96d4bce19 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.704310 9426 consensus_queue.cc:260] T 75d0d009c76d46e8863f7137273acd97 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.707795 9426 ts_tablet_manager.cc:1434] T 75d0d009c76d46e8863f7137273acd97 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.013s user 0.000s sys 0.003s
I20251215 14:55:22.709069 9426 tablet_bootstrap.cc:492] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.710587 11098 raft_consensus.cc:515] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.715796 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10cd2cbd7956444cb125d97310d2b102" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:22.716418 9249 leader_election.cc:343] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.716670 11098 leader_election.cc:290] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.717130 9427 raft_consensus.cc:385] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.717525 9426 tablet_bootstrap.cc:654] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.722954 9435 tablet_bootstrap.cc:492] T 295325c4a2ca41caaabddbd96d4bce19 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:22.723153 9435 ts_tablet_manager.cc:1403] T 295325c4a2ca41caaabddbd96d4bce19 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.005s
I20251215 14:55:22.717260 9427 raft_consensus.cc:740] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.724077 9427 consensus_queue.cc:260] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.724519 11098 consensus_queue.cc:1048] T ee44c7244b68469183a4e45baeaf5df4 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.725204 11098 consensus_queue.cc:1048] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.726699 9427 ts_tablet_manager.cc:1434] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.029s user 0.001s sys 0.001s
I20251215 14:55:22.727281 9435 raft_consensus.cc:359] T 295325c4a2ca41caaabddbd96d4bce19 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.727826 9435 raft_consensus.cc:385] T 295325c4a2ca41caaabddbd96d4bce19 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.728091 9435 raft_consensus.cc:740] T 295325c4a2ca41caaabddbd96d4bce19 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.729274 9427 tablet_bootstrap.cc:492] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:22.729743 9435 consensus_queue.cc:260] T 295325c4a2ca41caaabddbd96d4bce19 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.731583 9435 ts_tablet_manager.cc:1434] T 295325c4a2ca41caaabddbd96d4bce19 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20251215 14:55:22.732407 9435 tablet_bootstrap.cc:492] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:22.739251 9435 tablet_bootstrap.cc:654] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.742767 9426 tablet_bootstrap.cc:492] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.743027 9426 ts_tablet_manager.cc:1403] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.034s user 0.006s sys 0.000s
I20251215 14:55:22.744338 9426 raft_consensus.cc:359] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.744908 9426 raft_consensus.cc:385] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.745018 9426 raft_consensus.cc:740] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.745397 9426 consensus_queue.cc:260] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:22.746817 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:22.748260 11218 raft_consensus.cc:493] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.748395 11218 raft_consensus.cc:515] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.748950 11218 leader_election.cc:290] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.749133 9426 ts_tablet_manager.cc:1434] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20251215 14:55:22.749574 9426 tablet_bootstrap.cc:492] T 566fe9bb8a1849749087d840ef1c082d P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.751048 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "404cb1888ca2402ab7a41d0d5efeacd8" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.751382 9426 tablet_bootstrap.cc:654] T 566fe9bb8a1849749087d840ef1c082d P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:22.751587 8976 leader_election.cc:343] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.751678 11153 raft_consensus.cc:493] T 18054b180c77403387d15fc6ee42f58f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.751812 11153 raft_consensus.cc:515] T 18054b180c77403387d15fc6ee42f58f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.752449 11153 leader_election.cc:290] T 18054b180c77403387d15fc6ee42f58f P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:22.759662 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18054b180c77403387d15fc6ee42f58f" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.759922 9308 raft_consensus.cc:2393] T 18054b180c77403387d15fc6ee42f58f P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:22.760475 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18054b180c77403387d15fc6ee42f58f" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:22.762177 9112 leader_election.cc:304] T 18054b180c77403387d15fc6ee42f58f P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.764266 10991 raft_consensus.cc:3060] T 18054b180c77403387d15fc6ee42f58f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.766944 10991 raft_consensus.cc:2749] T 18054b180c77403387d15fc6ee42f58f P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.767604 10528 raft_consensus.cc:493] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.767735 10528 raft_consensus.cc:515] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.768266 10528 leader_election.cc:290] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.768992 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "042632f0dabd4a79a36a5f27bef12faa" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:22.769501 9249 leader_election.cc:343] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.775457 9435 tablet_bootstrap.cc:492] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:22.775665 9435 ts_tablet_manager.cc:1403] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.043s user 0.005s sys 0.000s
I20251215 14:55:22.776554 9435 raft_consensus.cc:359] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.776801 9435 raft_consensus.cc:385] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.776897 9435 raft_consensus.cc:740] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.777128 9435 consensus_queue.cc:260] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.777693 9435 ts_tablet_manager.cc:1434] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:22.777762 9427 tablet_bootstrap.cc:654] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.778400 9435 tablet_bootstrap.cc:492] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:22.781033 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "404cb1888ca2402ab7a41d0d5efeacd8" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.781073 9435 tablet_bootstrap.cc:654] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.782255 9426 tablet_bootstrap.cc:492] T 566fe9bb8a1849749087d840ef1c082d P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.782389 9426 ts_tablet_manager.cc:1403] T 566fe9bb8a1849749087d840ef1c082d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.007s
I20251215 14:55:22.783135 9426 raft_consensus.cc:359] T 566fe9bb8a1849749087d840ef1c082d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.783313 9426 raft_consensus.cc:385] T 566fe9bb8a1849749087d840ef1c082d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.783360 9426 raft_consensus.cc:740] T 566fe9bb8a1849749087d840ef1c082d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.783535 9426 consensus_queue.cc:260] T 566fe9bb8a1849749087d840ef1c082d P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.784021 9426 ts_tablet_manager.cc:1434] T 566fe9bb8a1849749087d840ef1c082d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:22.784312 9426 tablet_bootstrap.cc:492] T ad2bead71c9a462bbd7888774c608ba9 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.786531 9426 tablet_bootstrap.cc:654] T ad2bead71c9a462bbd7888774c608ba9 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.791831 9426 tablet_bootstrap.cc:492] T ad2bead71c9a462bbd7888774c608ba9 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.791958 9426 ts_tablet_manager.cc:1403] T ad2bead71c9a462bbd7888774c608ba9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20251215 14:55:22.792572 9426 raft_consensus.cc:359] T ad2bead71c9a462bbd7888774c608ba9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.792716 9426 raft_consensus.cc:385] T ad2bead71c9a462bbd7888774c608ba9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.792762 9426 raft_consensus.cc:740] T ad2bead71c9a462bbd7888774c608ba9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.792929 9426 consensus_queue.cc:260] T ad2bead71c9a462bbd7888774c608ba9 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.793159 9435 tablet_bootstrap.cc:492] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:22.793499 9426 ts_tablet_manager.cc:1434] T ad2bead71c9a462bbd7888774c608ba9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20251215 14:55:22.793747 9426 tablet_bootstrap.cc:492] T 0fb37d6a27554a44846e66c3ac2730f0 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.793447 9435 ts_tablet_manager.cc:1403] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.006s
I20251215 14:55:22.795048 9426 tablet_bootstrap.cc:654] T 0fb37d6a27554a44846e66c3ac2730f0 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.798046 10756 raft_consensus.cc:493] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.798185 10756 raft_consensus.cc:515] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.798557 10528 raft_consensus.cc:493] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.798738 10756 leader_election.cc:290] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.798700 10528 raft_consensus.cc:515] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.799070 9426 tablet_bootstrap.cc:492] T 0fb37d6a27554a44846e66c3ac2730f0 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.799211 9426 ts_tablet_manager.cc:1403] T 0fb37d6a27554a44846e66c3ac2730f0 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20251215 14:55:22.799291 10528 leader_election.cc:290] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.799806 9426 raft_consensus.cc:359] T 0fb37d6a27554a44846e66c3ac2730f0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.799949 9426 raft_consensus.cc:385] T 0fb37d6a27554a44846e66c3ac2730f0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.800004 9426 raft_consensus.cc:740] T 0fb37d6a27554a44846e66c3ac2730f0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.800154 9426 consensus_queue.cc:260] T 0fb37d6a27554a44846e66c3ac2730f0 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.800295 9180 raft_consensus.cc:3060] T 26e8a00c0065406d826271d103f892ba P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.800590 9426 ts_tablet_manager.cc:1434] T 0fb37d6a27554a44846e66c3ac2730f0 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:22.800807 9426 tablet_bootstrap.cc:492] T ebeebb8f49ef4858804e2ed0b31b2196 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.799960 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4078381658347a6a9d3063cc0cb3a53" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.803154 9179 raft_consensus.cc:2468] T e4078381658347a6a9d3063cc0cb3a53 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:22.804536 9249 leader_election.cc:304] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:22.804811 11098 consensus_queue.cc:1048] T 26e8a00c0065406d826271d103f892ba P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.805199 11098 raft_consensus.cc:2804] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.805274 11098 raft_consensus.cc:493] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.805342 11098 raft_consensus.cc:3060] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.807339 9426 tablet_bootstrap.cc:654] T ebeebb8f49ef4858804e2ed0b31b2196 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.810348 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ef8c3e099ba4e4d8d661af5c72c5e8c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:22.811213 8976 leader_election.cc:343] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.812958 11098 raft_consensus.cc:515] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.813473 9180 raft_consensus.cc:3060] T 548e6d35016746e2b8f5184ee44071cb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.815920 9426 tablet_bootstrap.cc:492] T ebeebb8f49ef4858804e2ed0b31b2196 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.816045 9426 ts_tablet_manager.cc:1403] T ebeebb8f49ef4858804e2ed0b31b2196 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20251215 14:55:22.816552 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4078381658347a6a9d3063cc0cb3a53" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:22.816685 9178 raft_consensus.cc:3060] T e4078381658347a6a9d3063cc0cb3a53 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.816707 9426 raft_consensus.cc:359] T ebeebb8f49ef4858804e2ed0b31b2196 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.816823 9426 raft_consensus.cc:385] T ebeebb8f49ef4858804e2ed0b31b2196 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.816864 9426 raft_consensus.cc:740] T ebeebb8f49ef4858804e2ed0b31b2196 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.817330 9426 consensus_queue.cc:260] T ebeebb8f49ef4858804e2ed0b31b2196 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.817754 9426 ts_tablet_manager.cc:1434] T ebeebb8f49ef4858804e2ed0b31b2196 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:22.817977 9426 tablet_bootstrap.cc:492] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.819001 9178 raft_consensus.cc:2468] T e4078381658347a6a9d3063cc0cb3a53 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:22.819260 9426 tablet_bootstrap.cc:654] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.819850 9249 leader_election.cc:304] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:22.820426 11174 raft_consensus.cc:2804] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.820562 11174 raft_consensus.cc:697] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:22.820801 11174 consensus_queue.cc:237] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.822988 9426 tablet_bootstrap.cc:492] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.823098 9426 ts_tablet_manager.cc:1403] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20251215 14:55:22.823683 9426 raft_consensus.cc:359] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.823815 9426 raft_consensus.cc:385] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.823858 9426 raft_consensus.cc:740] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.824019 9426 consensus_queue.cc:260] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.824118 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ef8c3e099ba4e4d8d661af5c72c5e8c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.824307 9312 raft_consensus.cc:2468] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:22.824445 9426 ts_tablet_manager.cc:1434] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:22.824699 9426 tablet_bootstrap.cc:492] T 14450105328041cdbd93969b756d9fa0 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.826023 9426 tablet_bootstrap.cc:654] T 14450105328041cdbd93969b756d9fa0 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.828300 11098 leader_election.cc:290] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.839229 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10cd2cbd7956444cb125d97310d2b102" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:22.839419 9037 raft_consensus.cc:3060] T 10cd2cbd7956444cb125d97310d2b102 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.839996 11167 consensus_queue.cc:1048] T e79295168c8b456ba4fdc2379fbd0961 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.841789 9037 raft_consensus.cc:2468] T 10cd2cbd7956444cb125d97310d2b102 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:22.842669 11098 raft_consensus.cc:493] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.842839 11098 raft_consensus.cc:515] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.843794 11098 leader_election.cc:290] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.844105 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf6e4aa94f79403588dd1916226660fd" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:22.844259 9029 raft_consensus.cc:2468] T cf6e4aa94f79403588dd1916226660fd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:22.844573 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "566fe9bb8a1849749087d840ef1c082d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.844741 9178 raft_consensus.cc:2468] T 566fe9bb8a1849749087d840ef1c082d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:22.845464 9249 leader_election.cc:304] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:22.845783 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "042632f0dabd4a79a36a5f27bef12faa" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:22.845930 9025 raft_consensus.cc:2468] T 042632f0dabd4a79a36a5f27bef12faa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:22.845945 11079 consensus_queue.cc:1048] T 548e6d35016746e2b8f5184ee44071cb P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.846112 11098 raft_consensus.cc:2804] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.846251 11098 raft_consensus.cc:493] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.846402 11098 raft_consensus.cc:3060] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:22.854665 8978 leader_election.cc:343] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.854790 8978 leader_election.cc:304] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.855141 11167 raft_consensus.cc:2749] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.857260 9427 tablet_bootstrap.cc:492] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:22.857370 9427 ts_tablet_manager.cc:1403] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.128s user 0.000s sys 0.003s
I20251215 14:55:22.858105 9427 raft_consensus.cc:359] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.858260 9427 raft_consensus.cc:385] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.858929 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4078381658347a6a9d3063cc0cb3a53" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:22.859069 9037 raft_consensus.cc:3060] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.861605 9037 raft_consensus.cc:2468] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:22.863333 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4078381658347a6a9d3063cc0cb3a53" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:22.863540 9025 raft_consensus.cc:2376] T e4078381658347a6a9d3063cc0cb3a53 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1. Re-sending same reply.
I20251215 14:55:22.864835 9435 raft_consensus.cc:359] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.858300 9427 raft_consensus.cc:740] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.867906 9427 consensus_queue.cc:260] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.868350 9435 raft_consensus.cc:385] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.869446 9427 ts_tablet_manager.cc:1434] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20251215 14:55:22.869058 9435 raft_consensus.cc:740] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.870311 11098 raft_consensus.cc:515] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.871892 9427 tablet_bootstrap.cc:492] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:22.871646 9435 consensus_queue.cc:260] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.877178 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "566fe9bb8a1849749087d840ef1c082d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:22.877367 9179 raft_consensus.cc:3060] T 566fe9bb8a1849749087d840ef1c082d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.880122 9179 raft_consensus.cc:2468] T 566fe9bb8a1849749087d840ef1c082d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:22.880295 9427 tablet_bootstrap.cc:654] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.880170 11098 leader_election.cc:290] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.880556 9249 leader_election.cc:304] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:22.881111 11174 raft_consensus.cc:2804] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.881347 11174 raft_consensus.cc:697] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:22.881552 8978 leader_election.cc:304] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.881657 11174 consensus_queue.cc:237] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.882068 10756 raft_consensus.cc:2804] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.882143 10756 raft_consensus.cc:493] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.882203 10756 raft_consensus.cc:3060] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.885690 11079 raft_consensus.cc:493] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.885830 11079 raft_consensus.cc:515] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.880726 9435 ts_tablet_manager.cc:1434] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.086s user 0.002s sys 0.002s
I20251215 14:55:22.886406 11079 leader_election.cc:290] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.886723 9248 leader_election.cc:304] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.887039 10528 raft_consensus.cc:2804] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.887187 10528 raft_consensus.cc:697] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:22.887413 9248 leader_election.cc:304] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.887413 10528 consensus_queue.cc:237] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.887871 9248 leader_election.cc:304] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:22.888253 11079 raft_consensus.cc:2804] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.888315 11079 raft_consensus.cc:493] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.888367 11079 raft_consensus.cc:3060] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.888455 10756 raft_consensus.cc:515] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.889317 10756 leader_election.cc:290] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.889533 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ef8c3e099ba4e4d8d661af5c72c5e8c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:22.890009 8976 leader_election.cc:343] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.890223 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92ab40be35344612bdf65839e2637d6d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.890506 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "566fe9bb8a1849749087d840ef1c082d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:22.890964 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "566fe9bb8a1849749087d840ef1c082d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:22.892048 11098 raft_consensus.cc:2804] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.892127 11098 raft_consensus.cc:493] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.892195 11098 raft_consensus.cc:3060] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.890715 9029 raft_consensus.cc:2468] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:22.893313 11079 raft_consensus.cc:515] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.893812 11079 leader_election.cc:290] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.894979 9435 tablet_bootstrap.cc:492] T ad2bead71c9a462bbd7888774c608ba9 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:22.903697 11153 raft_consensus.cc:493] T 75d0d009c76d46e8863f7137273acd97 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.903851 11153 raft_consensus.cc:515] T 75d0d009c76d46e8863f7137273acd97 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.904531 11153 leader_election.cc:290] T 75d0d009c76d46e8863f7137273acd97 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:22.905592 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75d0d009c76d46e8863f7137273acd97" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:22.905833 9029 raft_consensus.cc:2393] T 75d0d009c76d46e8863f7137273acd97 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:22.906347 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75d0d009c76d46e8863f7137273acd97" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.907783 9112 leader_election.cc:304] T 75d0d009c76d46e8863f7137273acd97 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.908031 10991 raft_consensus.cc:3060] T 75d0d009c76d46e8863f7137273acd97 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.910499 10991 raft_consensus.cc:2749] T 75d0d009c76d46e8863f7137273acd97 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.918418 9427 tablet_bootstrap.cc:492] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:22.918633 9427 ts_tablet_manager.cc:1403] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.004s
I20251215 14:55:22.919481 9427 raft_consensus.cc:359] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.919715 9427 raft_consensus.cc:385] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.919807 9427 raft_consensus.cc:740] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.920068 9427 consensus_queue.cc:260] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.921643 9427 ts_tablet_manager.cc:1434] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251215 14:55:22.922755 9427 tablet_bootstrap.cc:492] T 92ab40be35344612bdf65839e2637d6d P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:22.930841 10991 raft_consensus.cc:493] T 4a98e436ade941989e40e34578572e3b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.931025 10991 raft_consensus.cc:515] T 4a98e436ade941989e40e34578572e3b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.931721 10991 leader_election.cc:290] T 4a98e436ade941989e40e34578572e3b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:22.932186 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a98e436ade941989e40e34578572e3b" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:22.932439 9029 raft_consensus.cc:2393] T 4a98e436ade941989e40e34578572e3b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:22.942716 9426 tablet_bootstrap.cc:492] T 14450105328041cdbd93969b756d9fa0 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:22.942899 9426 ts_tablet_manager.cc:1403] T 14450105328041cdbd93969b756d9fa0 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.118s user 0.005s sys 0.003s
I20251215 14:55:22.943727 9426 raft_consensus.cc:359] T 14450105328041cdbd93969b756d9fa0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.943904 9426 raft_consensus.cc:385] T 14450105328041cdbd93969b756d9fa0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:22.943949 9426 raft_consensus.cc:740] T 14450105328041cdbd93969b756d9fa0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:22.944147 9426 consensus_queue.cc:260] T 14450105328041cdbd93969b756d9fa0 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.944623 9426 ts_tablet_manager.cc:1434] T 14450105328041cdbd93969b756d9fa0 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:22.944897 9426 tablet_bootstrap.cc:492] T 404cb1888ca2402ab7a41d0d5efeacd8 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:22.948764 10756 raft_consensus.cc:493] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:22.948921 10756 raft_consensus.cc:515] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.949538 10756 leader_election.cc:290] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.950265 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ad2bead71c9a462bbd7888774c608ba9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:22.950544 9180 raft_consensus.cc:2468] T ad2bead71c9a462bbd7888774c608ba9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:22.950955 8976 leader_election.cc:304] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:22.951337 10756 raft_consensus.cc:2804] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.951409 10756 raft_consensus.cc:493] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:22.951467 10756 raft_consensus.cc:3060] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.954324 10756 raft_consensus.cc:515] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.955226 10756 leader_election.cc:290] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.930238 9435 tablet_bootstrap.cc:654] T ad2bead71c9a462bbd7888774c608ba9 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.961522 9427 tablet_bootstrap.cc:654] T 92ab40be35344612bdf65839e2637d6d P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:22.963248 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a98e436ade941989e40e34578572e3b" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:22.968429 9115 leader_election.cc:304] T 4a98e436ade941989e40e34578572e3b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:22.967087 11098 raft_consensus.cc:515] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:22.969372 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ad2bead71c9a462bbd7888774c608ba9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:22.969586 9180 raft_consensus.cc:3060] T ad2bead71c9a462bbd7888774c608ba9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.970081 11098 leader_election.cc:290] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:22.971850 11192 consensus_queue.cc:1048] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.972522 10991 raft_consensus.cc:3060] T 4a98e436ade941989e40e34578572e3b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:22.974912 10991 raft_consensus.cc:2749] T 4a98e436ade941989e40e34578572e3b P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:22.978787 10756 consensus_queue.cc:1048] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:22.981166 9180 raft_consensus.cc:2468] T ad2bead71c9a462bbd7888774c608ba9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:22.981582 8976 leader_election.cc:304] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:22.981918 10756 raft_consensus.cc:2804] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:22.982024 10756 raft_consensus.cc:697] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:22.982254 10756 consensus_queue.cc:237] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:22.986517 9249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 96636.8us
I20251215 14:55:22.988039 9426 tablet_bootstrap.cc:654] T 404cb1888ca2402ab7a41d0d5efeacd8 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:23.003624 9249 leader_election.cc:343] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:22.989678 10991 raft_consensus.cc:493] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.011777 10991 raft_consensus.cc:515] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.012467 10991 leader_election.cc:290] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:22.989702 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "042632f0dabd4a79a36a5f27bef12faa" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:23.012826 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d88741012a814d41ac074e86805f492d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:23.013023 9029 raft_consensus.cc:2468] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:23.013131 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d88741012a814d41ac074e86805f492d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:23.013340 9312 raft_consensus.cc:2468] T d88741012a814d41ac074e86805f492d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:23.013412 9112 leader_election.cc:304] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:22.990906 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf6e4aa94f79403588dd1916226660fd" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:23.013720 10991 raft_consensus.cc:2804] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:22.991330 11153 raft_consensus.cc:493] T ebeebb8f49ef4858804e2ed0b31b2196 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.013820 10991 raft_consensus.cc:493] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:23.013886 10991 raft_consensus.cc:3060] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.013862 11153 raft_consensus.cc:515] T ebeebb8f49ef4858804e2ed0b31b2196 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.014392 11153 leader_election.cc:290] T ebeebb8f49ef4858804e2ed0b31b2196 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:23.014871 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ebeebb8f49ef4858804e2ed0b31b2196" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:23.016517 10991 raft_consensus.cc:515] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.017078 10991 leader_election.cc:290] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:23.017403 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d88741012a814d41ac074e86805f492d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:23.017561 9029 raft_consensus.cc:3060] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.019985 9029 raft_consensus.cc:2468] T d88741012a814d41ac074e86805f492d P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:23.020565 9112 leader_election.cc:304] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:23.020826 10991 raft_consensus.cc:2804] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
W20251215 14:55:23.020936 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 133138us
I20251215 14:55:23.021786 10991 raft_consensus.cc:697] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:23.022142 10991 consensus_queue.cc:237] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.025923 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ebeebb8f49ef4858804e2ed0b31b2196" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:23.026150 9312 raft_consensus.cc:2393] T ebeebb8f49ef4858804e2ed0b31b2196 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:23.027289 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d88741012a814d41ac074e86805f492d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:23.027426 9308 raft_consensus.cc:3060] T d88741012a814d41ac074e86805f492d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.028127 9435 tablet_bootstrap.cc:492] T ad2bead71c9a462bbd7888774c608ba9 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:23.028560 9435 ts_tablet_manager.cc:1403] T ad2bead71c9a462bbd7888774c608ba9 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.134s user 0.004s sys 0.008s
I20251215 14:55:23.030982 9426 tablet_bootstrap.cc:492] T 404cb1888ca2402ab7a41d0d5efeacd8 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:23.031685 9115 leader_election.cc:304] T ebeebb8f49ef4858804e2ed0b31b2196 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:23.031872 9427 tablet_bootstrap.cc:492] T 92ab40be35344612bdf65839e2637d6d P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:23.031991 9427 ts_tablet_manager.cc:1403] T 92ab40be35344612bdf65839e2637d6d P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.109s user 0.002s sys 0.004s
I20251215 14:55:23.032207 11153 raft_consensus.cc:3060] T ebeebb8f49ef4858804e2ed0b31b2196 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.032722 9427 raft_consensus.cc:359] T 92ab40be35344612bdf65839e2637d6d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.032868 9427 raft_consensus.cc:385] T 92ab40be35344612bdf65839e2637d6d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.032913 9427 raft_consensus.cc:740] T 92ab40be35344612bdf65839e2637d6d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.033095 9427 consensus_queue.cc:260] T 92ab40be35344612bdf65839e2637d6d P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.033375 9426 ts_tablet_manager.cc:1403] T 404cb1888ca2402ab7a41d0d5efeacd8 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.089s user 0.004s sys 0.000s
I20251215 14:55:23.034116 9426 raft_consensus.cc:359] T 404cb1888ca2402ab7a41d0d5efeacd8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:23.020404 9249 leader_election.cc:343] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:23.034255 9426 raft_consensus.cc:385] T 404cb1888ca2402ab7a41d0d5efeacd8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.034303 9426 raft_consensus.cc:740] T 404cb1888ca2402ab7a41d0d5efeacd8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.034502 9426 consensus_queue.cc:260] T 404cb1888ca2402ab7a41d0d5efeacd8 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.034591 11153 raft_consensus.cc:2749] T ebeebb8f49ef4858804e2ed0b31b2196 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:23.039438 9427 ts_tablet_manager.cc:1434] T 92ab40be35344612bdf65839e2637d6d P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20251215 14:55:23.041463 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ef8c3e099ba4e4d8d661af5c72c5e8c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:23.041623 9306 raft_consensus.cc:3060] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.042332 9426 ts_tablet_manager.cc:1434] T 404cb1888ca2402ab7a41d0d5efeacd8 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20251215 14:55:23.044685 9427 tablet_bootstrap.cc:492] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:23.044833 9426 tablet_bootstrap.cc:492] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:23.045006 9308 raft_consensus.cc:2468] T d88741012a814d41ac074e86805f492d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:23.045197 9306 raft_consensus.cc:2468] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:23.048334 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ad2bead71c9a462bbd7888774c608ba9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:23.047912 9435 raft_consensus.cc:359] T ad2bead71c9a462bbd7888774c608ba9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.048707 9435 raft_consensus.cc:385] T ad2bead71c9a462bbd7888774c608ba9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.048978 9435 raft_consensus.cc:740] T ad2bead71c9a462bbd7888774c608ba9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.049423 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ad2bead71c9a462bbd7888774c608ba9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:23.050118 9427 tablet_bootstrap.cc:654] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.049829 9435 consensus_queue.cc:260] T ad2bead71c9a462bbd7888774c608ba9 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.050694 9314 raft_consensus.cc:2468] T ad2bead71c9a462bbd7888774c608ba9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
W20251215 14:55:23.051613 9249 leader_election.cc:343] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:23.056190 9435 ts_tablet_manager.cc:1434] T ad2bead71c9a462bbd7888774c608ba9 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.027s user 0.002s sys 0.001s
I20251215 14:55:23.060181 9435 tablet_bootstrap.cc:492] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:23.061059 9427 tablet_bootstrap.cc:492] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:23.061266 9427 ts_tablet_manager.cc:1403] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.000s
I20251215 14:55:23.062109 9427 raft_consensus.cc:359] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:23.062637 9427 raft_consensus.cc:385] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.062741 9427 raft_consensus.cc:740] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.051751 9426 tablet_bootstrap.cc:654] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.065400 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "042632f0dabd4a79a36a5f27bef12faa" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:23.065551 9030 raft_consensus.cc:3060] T 042632f0dabd4a79a36a5f27bef12faa P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.065873 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92ab40be35344612bdf65839e2637d6d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:23.066027 9029 raft_consensus.cc:2468] T 92ab40be35344612bdf65839e2637d6d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:23.066289 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf6e4aa94f79403588dd1916226660fd" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:23.066407 9024 raft_consensus.cc:3060] T cf6e4aa94f79403588dd1916226660fd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.068133 9030 raft_consensus.cc:2468] T 042632f0dabd4a79a36a5f27bef12faa P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:23.068913 9024 raft_consensus.cc:2468] T cf6e4aa94f79403588dd1916226660fd P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:23.069607 8978 leader_election.cc:304] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:23.070619 11166 raft_consensus.cc:2804] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:23.070715 11166 raft_consensus.cc:697] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:23.070923 11166 consensus_queue.cc:237] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.071527 11192 consensus_queue.cc:1048] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.071429 9435 tablet_bootstrap.cc:654] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.090801 9248 leader_election.cc:304] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:23.091068 11270 raft_consensus.cc:2804] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:23.091142 11270 raft_consensus.cc:493] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:23.091228 11270 raft_consensus.cc:3060] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.093816 11270 raft_consensus.cc:515] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.094358 11270 leader_election.cc:290] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.094892 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92ab40be35344612bdf65839e2637d6d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:23.095191 9248 leader_election.cc:304] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:23.095672 9248 leader_election.cc:304] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:23.095626 11271 raft_consensus.cc:2804] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
W20251215 14:55:23.095697 9249 leader_election.cc:343] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:23.096195 11038 raft_consensus.cc:2804] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:23.096305 11038 raft_consensus.cc:697] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:23.096534 11038 consensus_queue.cc:237] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.063069 9427 consensus_queue.cc:260] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:23.096798 11271 raft_consensus.cc:697] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:23.097546 11271 consensus_queue.cc:237] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.098789 9427 ts_tablet_manager.cc:1434] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.037s user 0.002s sys 0.000s
I20251215 14:55:23.102947 9427 tablet_bootstrap.cc:492] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:23.110669 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92ab40be35344612bdf65839e2637d6d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:23.110939 9024 raft_consensus.cc:3060] T 92ab40be35344612bdf65839e2637d6d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.113752 9024 raft_consensus.cc:2468] T 92ab40be35344612bdf65839e2637d6d P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:23.113881 9435 tablet_bootstrap.cc:492] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:23.114790 9435 ts_tablet_manager.cc:1403] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.009s
I20251215 14:55:23.115479 9248 leader_election.cc:304] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:23.116024 11174 raft_consensus.cc:2804] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:23.116137 11174 raft_consensus.cc:697] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:23.116345 11174 consensus_queue.cc:237] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.119489 9427 tablet_bootstrap.cc:654] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.119618 9435 raft_consensus.cc:359] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:23.121054 9435 raft_consensus.cc:385] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.121412 9435 raft_consensus.cc:740] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.122614 9435 consensus_queue.cc:260] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:23.125705 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 55636us
I20251215 14:55:23.125845 9435 ts_tablet_manager.cc:1434] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
W20251215 14:55:23.126588 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 6: this message will repeat every 5th retry.
I20251215 14:55:23.127224 9435 tablet_bootstrap.cc:492] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:23.128643 8678 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
/tmp/dist-test-taskyVdQs_/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.121.190:44279
--webserver_interface=127.8.121.190
--webserver_port=40239
--builtin_ntp_servers=127.8.121.148:35915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20251215 14:55:23.130640 11192 consensus_queue.cc:1048] T 18054b180c77403387d15fc6ee42f58f P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.134642 11192 raft_consensus.cc:493] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.134778 11192 raft_consensus.cc:515] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.135438 11192 leader_election.cc:290] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.136569 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39d0bab4179d4af68d2dbcd3e215873e" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:23.137120 8976 leader_election.cc:343] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:23.146952 9435 tablet_bootstrap.cc:654] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.150499 10756 consensus_queue.cc:1048] T a51cf25aab09432f92bbd3235c2ada56 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.152582 10756 consensus_queue.cc:1048] T b4a856793e8b46cfb42110de5d383ff7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.156044 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39d0bab4179d4af68d2dbcd3e215873e" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
W20251215 14:55:23.165406 8978 leader_election.cc:343] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:23.165766 8978 leader_election.cc:304] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:23.166050 11283 raft_consensus.cc:2749] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:23.169157 9427 tablet_bootstrap.cc:492] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:23.169371 9427 ts_tablet_manager.cc:1403] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.067s user 0.002s sys 0.004s
I20251215 14:55:23.169957 9426 tablet_bootstrap.cc:492] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:23.170727 11174 raft_consensus.cc:493] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.170871 11174 raft_consensus.cc:515] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.172016 11174 leader_election.cc:290] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.171983 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fb37d6a27554a44846e66c3ac2730f0" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:23.172364 9179 raft_consensus.cc:2468] T 0fb37d6a27554a44846e66c3ac2730f0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:23.171778 9426 ts_tablet_manager.cc:1403] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.128s user 0.010s sys 0.005s
I20251215 14:55:23.172744 9249 leader_election.cc:304] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:23.173173 11174 raft_consensus.cc:2804] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:23.173250 11174 raft_consensus.cc:493] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:23.173311 11174 raft_consensus.cc:3060] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.174201 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fb37d6a27554a44846e66c3ac2730f0" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:23.174419 9024 raft_consensus.cc:2468] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:23.175051 9427 raft_consensus.cc:359] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.175316 9427 raft_consensus.cc:385] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.175415 9427 raft_consensus.cc:740] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.175659 9427 consensus_queue.cc:260] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.176007 11174 raft_consensus.cc:515] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.186784 11166 raft_consensus.cc:493] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.187041 11166 raft_consensus.cc:515] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.188752 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8d4d6163853448ceaff5c1954cfc64e7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:23.189272 8976 leader_election.cc:343] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:23.189823 11166 leader_election.cc:290] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.189234 9435 tablet_bootstrap.cc:492] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:23.196585 9427 ts_tablet_manager.cc:1434] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.027s user 0.002s sys 0.000s
I20251215 14:55:23.196710 9435 ts_tablet_manager.cc:1403] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.070s user 0.003s sys 0.002s
I20251215 14:55:23.198107 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8d4d6163853448ceaff5c1954cfc64e7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:23.197266 9426 raft_consensus.cc:359] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:23.200217 8978 leader_election.cc:343] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:23.200196 9426 raft_consensus.cc:385] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.201290 9426 raft_consensus.cc:740] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.203737 8978 leader_election.cc:304] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:23.204285 11166 raft_consensus.cc:2749] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:23.204994 9427 tablet_bootstrap.cc:492] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:23.203891 9426 consensus_queue.cc:260] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:23.206655 9435 raft_consensus.cc:359] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.208412 9435 raft_consensus.cc:385] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.209208 9435 raft_consensus.cc:740] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.210178 9426 ts_tablet_manager.cc:1434] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.037s user 0.004s sys 0.000s
I20251215 14:55:23.211205 9427 tablet_bootstrap.cc:654] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.211102 9435 consensus_queue.cc:260] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.213385 9426 tablet_bootstrap.cc:492] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:23.218250 9435 ts_tablet_manager.cc:1434] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.020s user 0.002s sys 0.001s
W20251215 14:55:23.219223 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:23.221822 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fb37d6a27554a44846e66c3ac2730f0" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:23.221997 9175 raft_consensus.cc:3060] T 0fb37d6a27554a44846e66c3ac2730f0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.221619 9435 tablet_bootstrap.cc:492] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:23.224844 9175 raft_consensus.cc:2468] T 0fb37d6a27554a44846e66c3ac2730f0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:23.225311 9249 leader_election.cc:304] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:23.225656 11038 raft_consensus.cc:2804] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:23.225884 11038 raft_consensus.cc:697] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:23.226186 11038 consensus_queue.cc:237] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.227108 11174 leader_election.cc:290] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.228943 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fb37d6a27554a44846e66c3ac2730f0" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:23.229110 9029 raft_consensus.cc:3060] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.232623 9029 raft_consensus.cc:2468] T 0fb37d6a27554a44846e66c3ac2730f0 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:23.232501 9426 tablet_bootstrap.cc:654] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.236514 9427 tablet_bootstrap.cc:492] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:23.236678 9427 ts_tablet_manager.cc:1403] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.032s user 0.006s sys 0.000s
I20251215 14:55:23.237444 9427 raft_consensus.cc:359] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.237736 9427 raft_consensus.cc:385] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.237823 9427 raft_consensus.cc:740] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.238058 9427 consensus_queue.cc:260] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.239530 9427 ts_tablet_manager.cc:1434] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251215 14:55:23.239837 11270 consensus_queue.cc:1048] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.242489 9427 tablet_bootstrap.cc:492] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:23.243865 11271 raft_consensus.cc:493] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.244009 11271 raft_consensus.cc:515] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.244558 11271 leader_election.cc:290] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.244762 10559 raft_consensus.cc:493] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.244877 10559 raft_consensus.cc:515] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.245461 10559 leader_election.cc:290] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:23.246167 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25615ca6c21d4d5f8880d3dff4253e61" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:23.246340 9029 raft_consensus.cc:2468] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:23.247099 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25615ca6c21d4d5f8880d3dff4253e61" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:23.247139 9112 leader_election.cc:304] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:23.247292 9312 raft_consensus.cc:2468] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:23.247524 10559 raft_consensus.cc:2804] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:23.247598 10559 raft_consensus.cc:493] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:23.247658 10559 raft_consensus.cc:3060] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.248109 9435 tablet_bootstrap.cc:654] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.250106 10559 raft_consensus.cc:515] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.251081 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25615ca6c21d4d5f8880d3dff4253e61" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:23.251292 9029 raft_consensus.cc:3060] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.251900 10559 leader_election.cc:290] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:23.252791 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25615ca6c21d4d5f8880d3dff4253e61" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:23.253021 9179 raft_consensus.cc:2393] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:23.253760 9029 raft_consensus.cc:2468] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:23.254173 9112 leader_election.cc:304] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:23.254539 10559 raft_consensus.cc:2804] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:23.254693 10559 raft_consensus.cc:697] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:23.255012 10559 consensus_queue.cc:237] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.256559 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25615ca6c21d4d5f8880d3dff4253e61" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:23.256729 9312 raft_consensus.cc:3060] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.259311 9312 raft_consensus.cc:2468] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:23.261391 9427 tablet_bootstrap.cc:654] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.261665 11271 consensus_queue.cc:1048] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.264889 11079 consensus_queue.cc:1048] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.276197 11153 raft_consensus.cc:493] T 14450105328041cdbd93969b756d9fa0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.276381 11153 raft_consensus.cc:515] T 14450105328041cdbd93969b756d9fa0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.276979 11153 leader_election.cc:290] T 14450105328041cdbd93969b756d9fa0 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:23.278494 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14450105328041cdbd93969b756d9fa0" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:23.279453 9303 raft_consensus.cc:2393] T 14450105328041cdbd93969b756d9fa0 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:23.280759 11079 raft_consensus.cc:493] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.280897 11079 raft_consensus.cc:515] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.281472 11079 leader_election.cc:290] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.282461 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "404cb1888ca2402ab7a41d0d5efeacd8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:23.282647 9180 raft_consensus.cc:2468] T 404cb1888ca2402ab7a41d0d5efeacd8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:23.283118 9249 leader_election.cc:304] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:23.283491 11079 raft_consensus.cc:2804] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:23.283568 11079 raft_consensus.cc:493] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:23.283627 11079 raft_consensus.cc:3060] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.286408 11079 raft_consensus.cc:515] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.286716 9435 tablet_bootstrap.cc:492] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:23.286988 9435 ts_tablet_manager.cc:1403] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.066s user 0.004s sys 0.003s
I20251215 14:55:23.287629 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "404cb1888ca2402ab7a41d0d5efeacd8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:23.287854 9180 raft_consensus.cc:3060] T 404cb1888ca2402ab7a41d0d5efeacd8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.263352 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "25615ca6c21d4d5f8880d3dff4253e61" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:23.266924 11166 raft_consensus.cc:493] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.290885 9180 raft_consensus.cc:2468] T 404cb1888ca2402ab7a41d0d5efeacd8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:23.291046 9028 raft_consensus.cc:2393] T 25615ca6c21d4d5f8880d3dff4253e61 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:23.291023 11166 raft_consensus.cc:515] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.291676 11166 leader_election.cc:290] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.278256 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14450105328041cdbd93969b756d9fa0" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:23.292740 9112 leader_election.cc:304] T 14450105328041cdbd93969b756d9fa0 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:23.293092 11153 raft_consensus.cc:3060] T 14450105328041cdbd93969b756d9fa0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.295395 11153 raft_consensus.cc:2749] T 14450105328041cdbd93969b756d9fa0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:23.287078 11079 leader_election.cc:290] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.296519 9249 leader_election.cc:304] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:23.288599 9435 raft_consensus.cc:359] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.296801 9435 raft_consensus.cc:385] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.297267 11270 raft_consensus.cc:2804] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:23.297386 11270 raft_consensus.cc:697] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:23.297609 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a7a401d5386499183b6560411f593b6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:23.297616 11270 consensus_queue.cc:237] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:23.298055 8976 leader_election.cc:343] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:23.298666 9426 tablet_bootstrap.cc:492] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:23.298933 9426 ts_tablet_manager.cc:1403] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.086s user 0.008s sys 0.000s
I20251215 14:55:23.304052 9426 raft_consensus.cc:359] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.305150 9426 raft_consensus.cc:385] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.305572 9426 raft_consensus.cc:740] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.306326 9435 raft_consensus.cc:740] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.306957 9426 consensus_queue.cc:260] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.309079 9435 consensus_queue.cc:260] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.314204 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "404cb1888ca2402ab7a41d0d5efeacd8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:23.314498 9029 raft_consensus.cc:2468] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:23.314283 9426 ts_tablet_manager.cc:1434] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20251215 14:55:23.315793 9435 ts_tablet_manager.cc:1434] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.029s user 0.003s sys 0.000s
I20251215 14:55:23.316812 9426 tablet_bootstrap.cc:492] T cf6e4aa94f79403588dd1916226660fd P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:23.318423 9427 tablet_bootstrap.cc:492] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:23.318600 9427 ts_tablet_manager.cc:1403] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.076s user 0.003s sys 0.000s
I20251215 14:55:23.319435 9427 raft_consensus.cc:359] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.319651 9427 raft_consensus.cc:385] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.319741 9427 raft_consensus.cc:740] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.321761 9427 consensus_queue.cc:260] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.322608 9427 ts_tablet_manager.cc:1434] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251215 14:55:23.322907 9427 tablet_bootstrap.cc:492] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:23.327340 9427 tablet_bootstrap.cc:654] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.332460 11166 consensus_queue.cc:1048] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.336318 9426 tablet_bootstrap.cc:654] T cf6e4aa94f79403588dd1916226660fd P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.338119 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "404cb1888ca2402ab7a41d0d5efeacd8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:23.338804 9029 raft_consensus.cc:3060] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.341763 9029 raft_consensus.cc:2468] T 404cb1888ca2402ab7a41d0d5efeacd8 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:23.344036 9435 tablet_bootstrap.cc:492] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:23.345614 9435 tablet_bootstrap.cc:654] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.352239 9248 leader_election.cc:304] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:23.355599 11270 raft_consensus.cc:2749] T 25615ca6c21d4d5f8880d3dff4253e61 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:23.361027 9435 tablet_bootstrap.cc:492] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:23.361366 9435 ts_tablet_manager.cc:1403] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.004s
I20251215 14:55:23.362227 11174 consensus_queue.cc:1048] T 4a98e436ade941989e40e34578572e3b P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.363349 9435 raft_consensus.cc:359] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.363688 9435 raft_consensus.cc:385] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.363827 9435 raft_consensus.cc:740] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.364302 9435 consensus_queue.cc:260] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.365224 11174 consensus_queue.cc:1048] T 75d0d009c76d46e8863f7137273acd97 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.368167 9435 ts_tablet_manager.cc:1434] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20251215 14:55:23.369556 9435 tablet_bootstrap.cc:492] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:23.377383 9435 tablet_bootstrap.cc:654] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.378376 9426 tablet_bootstrap.cc:492] T cf6e4aa94f79403588dd1916226660fd P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:23.378515 9426 ts_tablet_manager.cc:1403] T cf6e4aa94f79403588dd1916226660fd P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.062s user 0.006s sys 0.002s
I20251215 14:55:23.379094 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a7a401d5386499183b6560411f593b6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:23.379626 9426 raft_consensus.cc:359] T cf6e4aa94f79403588dd1916226660fd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.379784 9426 raft_consensus.cc:385] T cf6e4aa94f79403588dd1916226660fd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.379837 9426 raft_consensus.cc:740] T cf6e4aa94f79403588dd1916226660fd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.380023 9426 consensus_queue.cc:260] T cf6e4aa94f79403588dd1916226660fd P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.383232 9426 ts_tablet_manager.cc:1434] T cf6e4aa94f79403588dd1916226660fd P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20251215 14:55:23.386705 9426 tablet_bootstrap.cc:492] T 66249f9be0334affb4f4b0e7dd9212ea P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:23.390224 9426 tablet_bootstrap.cc:654] T 66249f9be0334affb4f4b0e7dd9212ea P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.397603 11166 consensus_queue.cc:1048] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:23.413048 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 95b78c1518f1481794948f2db1055f38 (table default.Table_3060c957ad034dafb3040834508f89b0 [id=50a94314f5ba46e3a75b5a15e7362299], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 95b78c1518f1481794948f2db1055f38 consensus state has no leader
I20251215 14:55:23.417526 9426 tablet_bootstrap.cc:492] T 66249f9be0334affb4f4b0e7dd9212ea P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:23.417837 9426 ts_tablet_manager.cc:1403] T 66249f9be0334affb4f4b0e7dd9212ea P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.007s
I20251215 14:55:23.418536 11166 consensus_queue.cc:1048] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.419404 9426 raft_consensus.cc:359] T 66249f9be0334affb4f4b0e7dd9212ea P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.419759 9426 raft_consensus.cc:385] T 66249f9be0334affb4f4b0e7dd9212ea P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.419905 9426 raft_consensus.cc:740] T 66249f9be0334affb4f4b0e7dd9212ea P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.420432 10756 consensus_queue.cc:1048] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.421344 11153 raft_consensus.cc:493] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.421452 11153 raft_consensus.cc:515] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.421047 9426 consensus_queue.cc:260] T 66249f9be0334affb4f4b0e7dd9212ea P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.421962 11153 leader_election.cc:290] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:23.423580 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "295325c4a2ca41caaabddbd96d4bce19" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:23.423754 9024 raft_consensus.cc:2468] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:23.424428 9112 leader_election.cc:304] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:23.424907 11153 raft_consensus.cc:2804] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:23.424975 11153 raft_consensus.cc:493] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:23.425017 9426 ts_tablet_manager.cc:1434] T 66249f9be0334affb4f4b0e7dd9212ea P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20251215 14:55:23.426139 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "295325c4a2ca41caaabddbd96d4bce19" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:23.426313 9312 raft_consensus.cc:2468] T 295325c4a2ca41caaabddbd96d4bce19 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:23.425030 11153 raft_consensus.cc:3060] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.426887 9426 tablet_bootstrap.cc:492] T 92ab40be35344612bdf65839e2637d6d P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:23.429219 11153 raft_consensus.cc:515] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.431282 11166 consensus_queue.cc:1048] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.432214 11153 leader_election.cc:290] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:23.432708 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "295325c4a2ca41caaabddbd96d4bce19" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:23.432883 9029 raft_consensus.cc:3060] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.435499 9029 raft_consensus.cc:2468] T 295325c4a2ca41caaabddbd96d4bce19 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:23.436158 9112 leader_election.cc:304] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:23.436746 10991 raft_consensus.cc:2804] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:23.436885 10991 raft_consensus.cc:697] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:23.437115 10991 consensus_queue.cc:237] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.438694 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "295325c4a2ca41caaabddbd96d4bce19" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:23.438869 9312 raft_consensus.cc:3060] T 295325c4a2ca41caaabddbd96d4bce19 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.439961 9426 tablet_bootstrap.cc:654] T 92ab40be35344612bdf65839e2637d6d P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.441365 9312 raft_consensus.cc:2468] T 295325c4a2ca41caaabddbd96d4bce19 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
W20251215 14:55:23.476771 9249 consensus_peers.cc:597] T d45d6eebc703414fa9028faab9fc993c P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:23.478428 11165 consensus_queue.cc:1048] T 1c989af5bc624699b4cce2b5c95fc90e P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:23.480377 8978 leader_election.cc:343] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:23.480500 8978 leader_election.cc:304] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:23.480942 11165 raft_consensus.cc:2749] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:23.483074 11165 consensus_queue.cc:1048] T 5dc9405b80e84ae7a67a595c3596cc92 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.497467 9427 tablet_bootstrap.cc:492] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:23.497697 9427 ts_tablet_manager.cc:1403] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.175s user 0.061s sys 0.100s
I20251215 14:55:23.498788 9427 raft_consensus.cc:359] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.499037 9427 raft_consensus.cc:385] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.499143 9427 raft_consensus.cc:740] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.499423 9427 consensus_queue.cc:260] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.499953 9427 ts_tablet_manager.cc:1434] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:23.500263 9427 tablet_bootstrap.cc:492] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:23.501937 9427 tablet_bootstrap.cc:654] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.507011 9435 tablet_bootstrap.cc:492] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:23.507524 9435 ts_tablet_manager.cc:1403] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.138s user 0.008s sys 0.014s
I20251215 14:55:23.508939 9435 raft_consensus.cc:359] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.509290 9435 raft_consensus.cc:385] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.509418 9435 raft_consensus.cc:740] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.509826 9435 consensus_queue.cc:260] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.511595 9435 ts_tablet_manager.cc:1434] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:23.512686 9435 tablet_bootstrap.cc:492] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:23.515630 11165 consensus_queue.cc:1048] T 2b54d7dcdcc94e58b039b9f231f38d11 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.516819 11165 consensus_queue.cc:1048] T ebeebb8f49ef4858804e2ed0b31b2196 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.519902 9426 tablet_bootstrap.cc:492] T 92ab40be35344612bdf65839e2637d6d P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:23.520183 9426 ts_tablet_manager.cc:1403] T 92ab40be35344612bdf65839e2637d6d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.094s user 0.004s sys 0.013s
I20251215 14:55:23.520371 9427 tablet_bootstrap.cc:492] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:23.520481 9427 ts_tablet_manager.cc:1403] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.008s
I20251215 14:55:23.521205 9427 raft_consensus.cc:359] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.521344 9427 raft_consensus.cc:385] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.521390 9427 raft_consensus.cc:740] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.521612 9427 consensus_queue.cc:260] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.522220 9427 ts_tablet_manager.cc:1434] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:23.521723 9426 raft_consensus.cc:359] T 92ab40be35344612bdf65839e2637d6d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.522397 10559 raft_consensus.cc:493] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.522387 9426 raft_consensus.cc:385] T 92ab40be35344612bdf65839e2637d6d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.522516 9427 tablet_bootstrap.cc:492] T 3bd33107c2ed4b27841f3e1ece1df152 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:23.522531 9426 raft_consensus.cc:740] T 92ab40be35344612bdf65839e2637d6d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.522558 10559 raft_consensus.cc:515] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:23.523219 10559 leader_election.cc:290] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:23.522938 9426 consensus_queue.cc:260] T 92ab40be35344612bdf65839e2637d6d P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.523698 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a09ed5b19594fba9e73f7b6e3f7bd4f" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:23.523882 9303 raft_consensus.cc:2468] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:23.524109 9427 tablet_bootstrap.cc:654] T 3bd33107c2ed4b27841f3e1ece1df152 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.524235 9435 tablet_bootstrap.cc:654] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.524770 9115 leader_election.cc:304] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:23.526209 9426 ts_tablet_manager.cc:1434] T 92ab40be35344612bdf65839e2637d6d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20251215 14:55:23.526718 10559 raft_consensus.cc:2804] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:23.526798 10559 raft_consensus.cc:493] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:23.526870 10559 raft_consensus.cc:3060] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.528169 9426 tablet_bootstrap.cc:492] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:23.530913 10559 raft_consensus.cc:515] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:23.532058 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a09ed5b19594fba9e73f7b6e3f7bd4f" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:23.532145 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a09ed5b19594fba9e73f7b6e3f7bd4f" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:23.532218 9029 raft_consensus.cc:3060] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.532303 9303 raft_consensus.cc:3060] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.534795 9029 raft_consensus.cc:2468] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:23.534963 9303 raft_consensus.cc:2468] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:23.535202 9112 leader_election.cc:304] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:23.535293 9426 tablet_bootstrap.cc:654] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.537081 11153 raft_consensus.cc:2804] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:23.537200 11153 raft_consensus.cc:697] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:23.537451 11153 consensus_queue.cc:237] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:23.539690 10559 leader_election.cc:290] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:23.544723 9427 tablet_bootstrap.cc:492] T 3bd33107c2ed4b27841f3e1ece1df152 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:23.544919 9427 ts_tablet_manager.cc:1403] T 3bd33107c2ed4b27841f3e1ece1df152 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.019s
I20251215 14:55:23.546264 9427 raft_consensus.cc:359] T 3bd33107c2ed4b27841f3e1ece1df152 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:23.546468 9427 raft_consensus.cc:385] T 3bd33107c2ed4b27841f3e1ece1df152 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.546552 9427 raft_consensus.cc:740] T 3bd33107c2ed4b27841f3e1ece1df152 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.546772 9427 consensus_queue.cc:260] T 3bd33107c2ed4b27841f3e1ece1df152 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:23.547505 9426 tablet_bootstrap.cc:492] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:23.548662 9427 ts_tablet_manager.cc:1434] T 3bd33107c2ed4b27841f3e1ece1df152 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:23.549186 9435 tablet_bootstrap.cc:492] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:23.549469 9435 ts_tablet_manager.cc:1403] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.037s user 0.006s sys 0.000s
I20251215 14:55:23.549621 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a09ed5b19594fba9e73f7b6e3f7bd4f" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:23.549808 9024 raft_consensus.cc:2376] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1. Re-sending same reply.
I20251215 14:55:23.550388 9427 tablet_bootstrap.cc:492] T 5c025355716a43569a1bebb46de7dd93 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:23.550952 9435 raft_consensus.cc:359] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.551367 9435 raft_consensus.cc:385] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.551429 10832 consensus_queue.cc:1048] T 14450105328041cdbd93969b756d9fa0 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.551501 9435 raft_consensus.cc:740] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.551896 9435 consensus_queue.cc:260] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.553519 9427 tablet_bootstrap.cc:654] T 5c025355716a43569a1bebb46de7dd93 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.553478 9435 ts_tablet_manager.cc:1434] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:23.553550 9426 ts_tablet_manager.cc:1403] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.000s
I20251215 14:55:23.555552 9435 tablet_bootstrap.cc:492] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:23.558679 9426 raft_consensus.cc:359] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.559535 9426 raft_consensus.cc:385] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.559810 9426 raft_consensus.cc:740] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.560724 9426 consensus_queue.cc:260] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.562410 9426 ts_tablet_manager.cc:1434] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.008s user 0.002s sys 0.001s
I20251215 14:55:23.563632 9426 tablet_bootstrap.cc:492] T 8d4d6163853448ceaff5c1954cfc64e7 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:23.571005 9435 tablet_bootstrap.cc:654] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.574908 9426 tablet_bootstrap.cc:654] T 8d4d6163853448ceaff5c1954cfc64e7 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.590206 9426 tablet_bootstrap.cc:492] T 8d4d6163853448ceaff5c1954cfc64e7 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:23.592573 9435 tablet_bootstrap.cc:492] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:23.598212 9435 ts_tablet_manager.cc:1403] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.043s user 0.007s sys 0.000s
I20251215 14:55:23.599836 9435 raft_consensus.cc:359] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.600179 9435 raft_consensus.cc:385] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.600308 9435 raft_consensus.cc:740] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.600713 9435 consensus_queue.cc:260] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.591228 9426 ts_tablet_manager.cc:1403] T 8d4d6163853448ceaff5c1954cfc64e7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.006s
I20251215 14:55:23.603281 9435 ts_tablet_manager.cc:1434] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20251215 14:55:23.605131 9435 tablet_bootstrap.cc:492] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:23.595010 11153 consensus_queue.cc:1048] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20251215 14:55:23.608098 9426 raft_consensus.cc:359] T 8d4d6163853448ceaff5c1954cfc64e7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.609681 9426 raft_consensus.cc:385] T 8d4d6163853448ceaff5c1954cfc64e7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.610219 9426 raft_consensus.cc:740] T 8d4d6163853448ceaff5c1954cfc64e7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.612233 9426 consensus_queue.cc:260] T 8d4d6163853448ceaff5c1954cfc64e7 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.615767 9426 ts_tablet_manager.cc:1434] T 8d4d6163853448ceaff5c1954cfc64e7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.014s user 0.000s sys 0.003s
I20251215 14:55:23.617053 9435 tablet_bootstrap.cc:654] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.618269 9426 tablet_bootstrap.cc:492] T 042632f0dabd4a79a36a5f27bef12faa P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:23.624732 8976 consensus_peers.cc:597] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:23.627947 9426 tablet_bootstrap.cc:654] T 042632f0dabd4a79a36a5f27bef12faa P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.639601 11153 consensus_queue.cc:1048] T 9c4be1c01418432492268598f97289a0 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.640837 9426 tablet_bootstrap.cc:492] T 042632f0dabd4a79a36a5f27bef12faa P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:23.642673 9435 tablet_bootstrap.cc:492] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:23.642962 9435 ts_tablet_manager.cc:1403] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.005s
I20251215 14:55:23.645102 9435 raft_consensus.cc:359] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.645489 9435 raft_consensus.cc:385] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.645578 9435 raft_consensus.cc:740] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.646027 9435 consensus_queue.cc:260] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.647410 9426 ts_tablet_manager.cc:1403] T 042632f0dabd4a79a36a5f27bef12faa P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.002s
I20251215 14:55:23.648650 9435 ts_tablet_manager.cc:1434] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20251215 14:55:23.650843 9435 tablet_bootstrap.cc:492] T d39e0db04f3c4bd3831c00b2b4825035 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:23.653523 9426 raft_consensus.cc:359] T 042632f0dabd4a79a36a5f27bef12faa P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.654812 9426 raft_consensus.cc:385] T 042632f0dabd4a79a36a5f27bef12faa P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.655248 9426 raft_consensus.cc:740] T 042632f0dabd4a79a36a5f27bef12faa P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.656603 9426 consensus_queue.cc:260] T 042632f0dabd4a79a36a5f27bef12faa P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.660748 9426 ts_tablet_manager.cc:1434] T 042632f0dabd4a79a36a5f27bef12faa P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.013s user 0.002s sys 0.001s
I20251215 14:55:23.662941 9435 tablet_bootstrap.cc:654] T d39e0db04f3c4bd3831c00b2b4825035 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.663008 9426 tablet_bootstrap.cc:492] T 6fea3a1616074fdd81242bc44e76cc2c P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:23.667214 11218 raft_consensus.cc:493] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.667399 11218 raft_consensus.cc:515] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.668135 11218 leader_election.cc:290] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.669678 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d39e0db04f3c4bd3831c00b2b4825035" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:23.670332 8976 leader_election.cc:343] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:23.674448 9426 tablet_bootstrap.cc:654] T 6fea3a1616074fdd81242bc44e76cc2c P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.680102 9435 tablet_bootstrap.cc:492] T d39e0db04f3c4bd3831c00b2b4825035 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:23.680377 9435 ts_tablet_manager.cc:1403] T d39e0db04f3c4bd3831c00b2b4825035 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.002s
I20251215 14:55:23.681823 9435 raft_consensus.cc:359] T d39e0db04f3c4bd3831c00b2b4825035 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.682155 9435 raft_consensus.cc:385] T d39e0db04f3c4bd3831c00b2b4825035 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.682276 9435 raft_consensus.cc:740] T d39e0db04f3c4bd3831c00b2b4825035 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.682631 9435 consensus_queue.cc:260] T d39e0db04f3c4bd3831c00b2b4825035 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.685079 9435 ts_tablet_manager.cc:1434] T d39e0db04f3c4bd3831c00b2b4825035 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:23.686422 9435 tablet_bootstrap.cc:492] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:23.693409 9426 tablet_bootstrap.cc:492] T 6fea3a1616074fdd81242bc44e76cc2c P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:23.693794 9426 ts_tablet_manager.cc:1403] T 6fea3a1616074fdd81242bc44e76cc2c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.004s
I20251215 14:55:23.695629 9426 raft_consensus.cc:359] T 6fea3a1616074fdd81242bc44e76cc2c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.696063 9426 raft_consensus.cc:385] T 6fea3a1616074fdd81242bc44e76cc2c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.696254 9426 raft_consensus.cc:740] T 6fea3a1616074fdd81242bc44e76cc2c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.697458 9426 consensus_queue.cc:260] T 6fea3a1616074fdd81242bc44e76cc2c P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.701524 9426 ts_tablet_manager.cc:1434] T 6fea3a1616074fdd81242bc44e76cc2c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20251215 14:55:23.701860 9435 tablet_bootstrap.cc:654] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.704183 9426 tablet_bootstrap.cc:492] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:23.713711 9426 tablet_bootstrap.cc:654] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.726861 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d39e0db04f3c4bd3831c00b2b4825035" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:23.727098 9304 raft_consensus.cc:2468] T d39e0db04f3c4bd3831c00b2b4825035 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:23.734848 9435 tablet_bootstrap.cc:492] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:23.735214 9435 ts_tablet_manager.cc:1403] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.049s user 0.006s sys 0.001s
I20251215 14:55:23.736639 9435 raft_consensus.cc:359] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.736984 9435 raft_consensus.cc:385] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.737111 9435 raft_consensus.cc:740] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.737514 9435 consensus_queue.cc:260] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.741037 9435 ts_tablet_manager.cc:1434] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20251215 14:55:23.742084 11166 raft_consensus.cc:493] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.742293 11166 raft_consensus.cc:515] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.742866 11166 leader_election.cc:290] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.742985 11165 consensus_queue.cc:1048] T 6fea3a1616074fdd81242bc44e76cc2c P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.743414 9435 tablet_bootstrap.cc:492] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:23.743887 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8eb90003cf02440e9752af134a3670b6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:23.743965 9426 tablet_bootstrap.cc:492] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
W20251215 14:55:23.744782 8976 leader_election.cc:343] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:23.744920 9426 ts_tablet_manager.cc:1403] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.000s
I20251215 14:55:23.753238 8978 leader_election.cc:304] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:23.753748 11165 raft_consensus.cc:2804] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:23.753829 11165 raft_consensus.cc:493] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:23.753885 11165 raft_consensus.cc:3060] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.756742 11165 raft_consensus.cc:515] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.757790 11166 raft_consensus.cc:493] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.757912 11166 raft_consensus.cc:515] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.758409 11166 leader_election.cc:290] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.759192 11165 leader_election.cc:290] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.757946 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d39e0db04f3c4bd3831c00b2b4825035" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:23.752203 9426 raft_consensus.cc:359] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:23.759073 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "66249f9be0334affb4f4b0e7dd9212ea" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:23.762712 9170 raft_consensus.cc:2468] T 66249f9be0334affb4f4b0e7dd9212ea P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:23.762871 9426 raft_consensus.cc:385] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251215 14:55:23.763434 8976 leader_election.cc:343] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:23.763638 8976 leader_election.cc:304] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:23.763967 11165 raft_consensus.cc:2804] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:23.764093 11165 raft_consensus.cc:493] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:23.764230 11165 raft_consensus.cc:3060] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.763777 9426 raft_consensus.cc:740] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.765654 9435 tablet_bootstrap.cc:654] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.765516 9426 consensus_queue.cc:260] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:23.767632 11165 raft_consensus.cc:515] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.771682 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "66249f9be0334affb4f4b0e7dd9212ea" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:23.771883 9170 raft_consensus.cc:3060] T 66249f9be0334affb4f4b0e7dd9212ea P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.774667 9170 raft_consensus.cc:2468] T 66249f9be0334affb4f4b0e7dd9212ea P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:23.775300 8976 leader_election.cc:304] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:23.775592 11166 raft_consensus.cc:2804] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:23.775715 11166 raft_consensus.cc:697] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:23.775949 11166 consensus_queue.cc:237] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.781320 9426 ts_tablet_manager.cc:1434] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.035s user 0.000s sys 0.004s
I20251215 14:55:23.784271 9426 tablet_bootstrap.cc:492] T fc3bcd441f1948a5a79d20e2e205d7f2 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:23.789657 11165 leader_election.cc:290] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.792070 11271 raft_consensus.cc:493] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.792235 11271 raft_consensus.cc:515] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.792246 9426 tablet_bootstrap.cc:654] T fc3bcd441f1948a5a79d20e2e205d7f2 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.792848 11271 leader_election.cc:290] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.793716 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8d4d6163853448ceaff5c1954cfc64e7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:23.794035 9170 raft_consensus.cc:2468] T 8d4d6163853448ceaff5c1954cfc64e7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:23.794503 9249 leader_election.cc:304] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:23.794845 11271 raft_consensus.cc:2804] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:23.794914 11271 raft_consensus.cc:493] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:23.794968 11271 raft_consensus.cc:3060] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.798046 11271 raft_consensus.cc:515] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.799234 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8d4d6163853448ceaff5c1954cfc64e7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:23.799449 9175 raft_consensus.cc:3060] T 8d4d6163853448ceaff5c1954cfc64e7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.801334 9435 tablet_bootstrap.cc:492] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:23.801594 9435 ts_tablet_manager.cc:1403] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.059s user 0.004s sys 0.004s
I20251215 14:55:23.802663 9175 raft_consensus.cc:2468] T 8d4d6163853448ceaff5c1954cfc64e7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:23.803229 9435 raft_consensus.cc:359] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.803615 9249 leader_election.cc:304] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:23.803632 9435 raft_consensus.cc:385] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.803891 11038 raft_consensus.cc:2804] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:23.803848 9435 raft_consensus.cc:740] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.803987 11038 raft_consensus.cc:697] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:23.804229 11038 consensus_queue.cc:237] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.804294 9435 consensus_queue.cc:260] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.807545 9435 ts_tablet_manager.cc:1434] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s
I20251215 14:55:23.808000 11271 leader_election.cc:290] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.808772 9435 tablet_bootstrap.cc:492] T 3bd33107c2ed4b27841f3e1ece1df152 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:23.809758 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:23.815199 9426 tablet_bootstrap.cc:492] T fc3bcd441f1948a5a79d20e2e205d7f2 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:23.815534 9426 ts_tablet_manager.cc:1403] T fc3bcd441f1948a5a79d20e2e205d7f2 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.032s user 0.004s sys 0.002s
I20251215 14:55:23.816390 10528 consensus_queue.cc:1048] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.817180 9426 raft_consensus.cc:359] T fc3bcd441f1948a5a79d20e2e205d7f2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.817546 9426 raft_consensus.cc:385] T fc3bcd441f1948a5a79d20e2e205d7f2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.817727 9426 raft_consensus.cc:740] T fc3bcd441f1948a5a79d20e2e205d7f2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.819356 9426 consensus_queue.cc:260] T fc3bcd441f1948a5a79d20e2e205d7f2 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.821630 10991 raft_consensus.cc:493] T 042632f0dabd4a79a36a5f27bef12faa P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.821785 10991 raft_consensus.cc:515] T 042632f0dabd4a79a36a5f27bef12faa P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.822386 10991 leader_election.cc:290] T 042632f0dabd4a79a36a5f27bef12faa P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:23.822284 9435 tablet_bootstrap.cc:654] T 3bd33107c2ed4b27841f3e1ece1df152 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.823068 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "042632f0dabd4a79a36a5f27bef12faa" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:23.823897 9426 ts_tablet_manager.cc:1434] T fc3bcd441f1948a5a79d20e2e205d7f2 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.008s user 0.000s sys 0.003s
I20251215 14:55:23.824383 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "042632f0dabd4a79a36a5f27bef12faa" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:23.824654 9029 raft_consensus.cc:2393] T 042632f0dabd4a79a36a5f27bef12faa P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:23.826071 9112 leader_election.cc:304] T 042632f0dabd4a79a36a5f27bef12faa P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:23.826357 9426 tablet_bootstrap.cc:492] T d45d6eebc703414fa9028faab9fc993c P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:23.828040 10991 raft_consensus.cc:3060] T 042632f0dabd4a79a36a5f27bef12faa P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.830842 10991 raft_consensus.cc:2749] T 042632f0dabd4a79a36a5f27bef12faa P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:23.834777 9426 tablet_bootstrap.cc:654] T d45d6eebc703414fa9028faab9fc993c P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.838578 9435 tablet_bootstrap.cc:492] T 3bd33107c2ed4b27841f3e1ece1df152 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:23.838857 9435 ts_tablet_manager.cc:1403] T 3bd33107c2ed4b27841f3e1ece1df152 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.005s
I20251215 14:55:23.840366 9435 raft_consensus.cc:359] T 3bd33107c2ed4b27841f3e1ece1df152 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:23.840797 9435 raft_consensus.cc:385] T 3bd33107c2ed4b27841f3e1ece1df152 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.840940 9435 raft_consensus.cc:740] T 3bd33107c2ed4b27841f3e1ece1df152 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.841302 9435 consensus_queue.cc:260] T 3bd33107c2ed4b27841f3e1ece1df152 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:23.845003 9435 ts_tablet_manager.cc:1434] T 3bd33107c2ed4b27841f3e1ece1df152 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20251215 14:55:23.846580 9435 tablet_bootstrap.cc:492] T 7a29174caad24ebc9d26b4169085dc08 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:23.855120 9435 tablet_bootstrap.cc:654] T 7a29174caad24ebc9d26b4169085dc08 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.855553 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8d4d6163853448ceaff5c1954cfc64e7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:23.855819 9029 raft_consensus.cc:2468] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:23.859014 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8d4d6163853448ceaff5c1954cfc64e7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:23.859228 9029 raft_consensus.cc:3060] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.861903 9029 raft_consensus.cc:2468] T 8d4d6163853448ceaff5c1954cfc64e7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:23.864161 9426 tablet_bootstrap.cc:492] T d45d6eebc703414fa9028faab9fc993c P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:23.864499 9426 ts_tablet_manager.cc:1403] T d45d6eebc703414fa9028faab9fc993c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.039s user 0.005s sys 0.003s
I20251215 14:55:23.866734 9426 raft_consensus.cc:359] T d45d6eebc703414fa9028faab9fc993c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.867209 9426 raft_consensus.cc:385] T d45d6eebc703414fa9028faab9fc993c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.867419 9426 raft_consensus.cc:740] T d45d6eebc703414fa9028faab9fc993c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.868646 9426 consensus_queue.cc:260] T d45d6eebc703414fa9028faab9fc993c P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.871616 9426 ts_tablet_manager.cc:1434] T d45d6eebc703414fa9028faab9fc993c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20251215 14:55:23.873159 9426 tablet_bootstrap.cc:492] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:23.874396 11098 raft_consensus.cc:493] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.874564 11098 raft_consensus.cc:515] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.875208 11098 leader_election.cc:290] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.878229 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39d0bab4179d4af68d2dbcd3e215873e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:23.878811 11098 raft_consensus.cc:493] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.878966 11098 raft_consensus.cc:515] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.879611 11098 leader_election.cc:290] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:23.886638 9435 tablet_bootstrap.cc:492] T 7a29174caad24ebc9d26b4169085dc08 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:23.886991 9435 ts_tablet_manager.cc:1403] T 7a29174caad24ebc9d26b4169085dc08 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.000s
I20251215 14:55:23.888526 9435 raft_consensus.cc:359] T 7a29174caad24ebc9d26b4169085dc08 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.888864 9435 raft_consensus.cc:385] T 7a29174caad24ebc9d26b4169085dc08 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.888999 9435 raft_consensus.cc:740] T 7a29174caad24ebc9d26b4169085dc08 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.889405 9435 consensus_queue.cc:260] T 7a29174caad24ebc9d26b4169085dc08 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.890853 11098 consensus_queue.cc:1048] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.891342 9435 ts_tablet_manager.cc:1434] T 7a29174caad24ebc9d26b4169085dc08 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:23.892583 9435 tablet_bootstrap.cc:492] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:23.893538 10832 consensus_queue.cc:1048] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.900012 9435 tablet_bootstrap.cc:654] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.889547 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be4393dc706f45a89b9b2c9727cd7726" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:23.890771 9426 tablet_bootstrap.cc:654] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.910900 9172 raft_consensus.cc:3060] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:23.914963 10832 raft_consensus.cc:493] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:23.915087 10832 raft_consensus.cc:515] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.915724 10832 leader_election.cc:290] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:23.916769 9249 leader_election.cc:343] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:23.916982 9249 leader_election.cc:343] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:23.917708 10832 consensus_queue.cc:1048] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.927857 11153 consensus_queue.cc:1048] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.929781 9426 tablet_bootstrap.cc:492] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:23.930122 9426 ts_tablet_manager.cc:1403] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.009s
I20251215 14:55:23.931689 9426 raft_consensus.cc:359] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.932052 9426 raft_consensus.cc:385] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.932191 9426 raft_consensus.cc:740] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.932596 9426 consensus_queue.cc:260] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.933887 9426 ts_tablet_manager.cc:1434] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20251215 14:55:23.935542 9426 tablet_bootstrap.cc:492] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:23.942591 9435 tablet_bootstrap.cc:492] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:23.942883 9435 ts_tablet_manager.cc:1403] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.007s
I20251215 14:55:23.943349 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e1472ce5a464a12a711d513446abe2a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:23.944008 8976 leader_election.cc:343] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:23.944617 9435 raft_consensus.cc:359] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.945026 9435 raft_consensus.cc:385] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.945151 9435 raft_consensus.cc:740] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.945531 9435 consensus_queue.cc:260] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.949419 9426 tablet_bootstrap.cc:654] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.949498 9435 ts_tablet_manager.cc:1434] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20251215 14:55:23.951562 9435 tablet_bootstrap.cc:492] T 022c9c0d19ac450cb270319004886fe2 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:23.961449 9435 tablet_bootstrap.cc:654] T 022c9c0d19ac450cb270319004886fe2 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.961784 10559 consensus_queue.cc:1048] T d88741012a814d41ac074e86805f492d P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:23.974570 9426 tablet_bootstrap.cc:492] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:23.974917 9426 ts_tablet_manager.cc:1403] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.005s
I20251215 14:55:23.976608 9426 raft_consensus.cc:359] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.977012 9426 raft_consensus.cc:385] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.977101 9426 raft_consensus.cc:740] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.977556 9426 consensus_queue.cc:260] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.979846 9426 ts_tablet_manager.cc:1434] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20251215 14:55:23.981185 9435 tablet_bootstrap.cc:492] T 022c9c0d19ac450cb270319004886fe2 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:23.982092 9426 tablet_bootstrap.cc:492] T d39e0db04f3c4bd3831c00b2b4825035 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:23.982224 9435 ts_tablet_manager.cc:1403] T 022c9c0d19ac450cb270319004886fe2 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.031s user 0.006s sys 0.001s
I20251215 14:55:23.988092 9435 raft_consensus.cc:359] T 022c9c0d19ac450cb270319004886fe2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.989318 9435 raft_consensus.cc:385] T 022c9c0d19ac450cb270319004886fe2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:23.989939 9435 raft_consensus.cc:740] T 022c9c0d19ac450cb270319004886fe2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:23.991479 9435 consensus_queue.cc:260] T 022c9c0d19ac450cb270319004886fe2 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:23.992466 9426 tablet_bootstrap.cc:654] T d39e0db04f3c4bd3831c00b2b4825035 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:23.995286 9435 ts_tablet_manager.cc:1434] T 022c9c0d19ac450cb270319004886fe2 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.012s user 0.001s sys 0.002s
I20251215 14:55:23.997256 9435 tablet_bootstrap.cc:492] T 82575517299b4e69a0871714dde9aacc P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.003931 10559 raft_consensus.cc:493] T 6fea3a1616074fdd81242bc44e76cc2c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.004070 10559 raft_consensus.cc:515] T 6fea3a1616074fdd81242bc44e76cc2c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.004583 10559 leader_election.cc:290] T 6fea3a1616074fdd81242bc44e76cc2c P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:24.005187 9435 tablet_bootstrap.cc:654] T 82575517299b4e69a0871714dde9aacc P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.006593 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fea3a1616074fdd81242bc44e76cc2c" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:24.006817 9308 raft_consensus.cc:2393] T 6fea3a1616074fdd81242bc44e76cc2c P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:24.022185 9426 tablet_bootstrap.cc:492] T d39e0db04f3c4bd3831c00b2b4825035 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:24.022998 9426 ts_tablet_manager.cc:1403] T d39e0db04f3c4bd3831c00b2b4825035 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.042s user 0.000s sys 0.006s
I20251215 14:55:24.026779 9426 raft_consensus.cc:359] T d39e0db04f3c4bd3831c00b2b4825035 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.027889 9426 raft_consensus.cc:385] T d39e0db04f3c4bd3831c00b2b4825035 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.028661 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6fea3a1616074fdd81242bc44e76cc2c" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.028395 9426 raft_consensus.cc:740] T d39e0db04f3c4bd3831c00b2b4825035 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.030555 9112 leader_election.cc:304] T 6fea3a1616074fdd81242bc44e76cc2c P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:24.030023 9426 consensus_queue.cc:260] T d39e0db04f3c4bd3831c00b2b4825035 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.030848 10559 raft_consensus.cc:3060] T 6fea3a1616074fdd81242bc44e76cc2c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.033546 10559 raft_consensus.cc:2749] T 6fea3a1616074fdd81242bc44e76cc2c P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:24.033973 9426 ts_tablet_manager.cc:1434] T d39e0db04f3c4bd3831c00b2b4825035 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.011s user 0.000s sys 0.003s
I20251215 14:55:24.035542 9426 tablet_bootstrap.cc:492] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:24.036286 9427 tablet_bootstrap.cc:492] T 5c025355716a43569a1bebb46de7dd93 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:24.036463 9427 ts_tablet_manager.cc:1403] T 5c025355716a43569a1bebb46de7dd93 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.486s user 0.128s sys 0.171s
I20251215 14:55:24.037246 9427 raft_consensus.cc:359] T 5c025355716a43569a1bebb46de7dd93 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.037460 9427 raft_consensus.cc:385] T 5c025355716a43569a1bebb46de7dd93 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.037573 9427 raft_consensus.cc:740] T 5c025355716a43569a1bebb46de7dd93 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.037827 9427 consensus_queue.cc:260] T 5c025355716a43569a1bebb46de7dd93 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.038331 9427 ts_tablet_manager.cc:1434] T 5c025355716a43569a1bebb46de7dd93 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:24.038616 9427 tablet_bootstrap.cc:492] T fc3bcd441f1948a5a79d20e2e205d7f2 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:24.039996 9427 tablet_bootstrap.cc:654] T fc3bcd441f1948a5a79d20e2e205d7f2 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.042461 9435 tablet_bootstrap.cc:492] T 82575517299b4e69a0871714dde9aacc P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.042814 9435 ts_tablet_manager.cc:1403] T 82575517299b4e69a0871714dde9aacc P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.003s
I20251215 14:55:24.045037 9435 raft_consensus.cc:359] T 82575517299b4e69a0871714dde9aacc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.045636 9435 raft_consensus.cc:385] T 82575517299b4e69a0871714dde9aacc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.045836 9435 raft_consensus.cc:740] T 82575517299b4e69a0871714dde9aacc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.046300 9435 consensus_queue.cc:260] T 82575517299b4e69a0871714dde9aacc P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.049309 9435 ts_tablet_manager.cc:1434] T 82575517299b4e69a0871714dde9aacc P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20251215 14:55:24.051432 9426 tablet_bootstrap.cc:654] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.051774 9435 tablet_bootstrap.cc:492] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:24.052031 9249 consensus_peers.cc:597] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:24.058001 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8eb90003cf02440e9752af134a3670b6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:24.064486 9435 tablet_bootstrap.cc:654] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.072289 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d39e0db04f3c4bd3831c00b2b4825035" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:24.072517 9312 raft_consensus.cc:3060] T d39e0db04f3c4bd3831c00b2b4825035 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.074153 9426 tablet_bootstrap.cc:492] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:24.074499 9426 ts_tablet_manager.cc:1403] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.039s user 0.000s sys 0.006s
I20251215 14:55:24.075639 9312 raft_consensus.cc:2468] T d39e0db04f3c4bd3831c00b2b4825035 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:24.076157 9426 raft_consensus.cc:359] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.076505 9426 raft_consensus.cc:385] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.076648 9426 raft_consensus.cc:740] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.077065 9426 consensus_queue.cc:260] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.079012 9426 ts_tablet_manager.cc:1434] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:24.080515 9426 tablet_bootstrap.cc:492] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:24.088330 11292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251215 14:55:24.088726 11292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
I20251215 14:55:24.088496 9426 tablet_bootstrap.cc:654] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:24.088846 11292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20251215 14:55:24.093485 11271 raft_consensus.cc:493] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.093724 11271 raft_consensus.cc:515] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.094619 11271 leader_election.cc:290] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:24.097748 9112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 67191.8us
I20251215 14:55:24.094664 9435 tablet_bootstrap.cc:492] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.101408 9435 ts_tablet_manager.cc:1403] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.050s user 0.006s sys 0.002s
W20251215 14:55:24.102237 11292 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20251215 14:55:24.102329 11292 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20251215 14:55:24.102411 11292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251215 14:55:24.102484 11292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251215 14:55:24.102571 11292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251215 14:55:24.102636 11292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251215 14:55:24.103142 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "66249f9be0334affb4f4b0e7dd9212ea" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:24.103209 9435 raft_consensus.cc:359] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.103451 9312 raft_consensus.cc:2468] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:24.103551 9435 raft_consensus.cc:385] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.103744 9435 raft_consensus.cc:740] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.099388 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e1472ce5a464a12a711d513446abe2a" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:24.104159 9435 consensus_queue.cc:260] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:24.104564 9249 leader_election.cc:343] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:24.105286 9435 ts_tablet_manager.cc:1434] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20251215 14:55:24.106015 9435 tablet_bootstrap.cc:492] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.109814 9435 tablet_bootstrap.cc:654] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.116210 9426 tablet_bootstrap.cc:492] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:24.116489 9426 ts_tablet_manager.cc:1403] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.004s
I20251215 14:55:24.117713 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "66249f9be0334affb4f4b0e7dd9212ea" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:24.117954 9312 raft_consensus.cc:3060] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.117800 9426 raft_consensus.cc:359] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.118135 9426 raft_consensus.cc:385] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.118266 9426 raft_consensus.cc:740] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.118451 11292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.8.121.148:35915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.8.121.190:44279,127.8.121.189:45723,127.8.121.188:43131
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.8.121.190:44279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.8.121.190
--webserver_port=40239
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision dc741732bb6a40213e11a13869fad06a49a209a3
build type FASTDEBUG
built by None at 15 Dec 2025 14:43:20 UTC on 24a791456cd2
build id 9528
ASAN enabled
I20251215 14:55:24.118670 9426 consensus_queue.cc:260] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.119669 9426 ts_tablet_manager.cc:1434] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:24.120563 11292 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251215 14:55:24.120831 9426 tablet_bootstrap.cc:492] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:24.121801 9312 raft_consensus.cc:2468] T 66249f9be0334affb4f4b0e7dd9212ea P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:24.122893 11292 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251215 14:55:24.126112 9303 raft_consensus.cc:3060] T ad2bead71c9a462bbd7888774c608ba9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.126768 9426 tablet_bootstrap.cc:654] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.131803 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e1472ce5a464a12a711d513446abe2a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:24.132061 9303 raft_consensus.cc:2468] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:24.135147 10559 raft_consensus.cc:493] T 92ab40be35344612bdf65839e2637d6d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.135365 10559 raft_consensus.cc:515] T 92ab40be35344612bdf65839e2637d6d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.135994 10559 leader_election.cc:290] T 92ab40be35344612bdf65839e2637d6d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.138463 9435 tablet_bootstrap.cc:492] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.138885 9435 ts_tablet_manager.cc:1403] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.006s
I20251215 14:55:24.140744 9435 raft_consensus.cc:359] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.141253 9435 raft_consensus.cc:385] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.141449 9435 raft_consensus.cc:740] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.142189 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92ab40be35344612bdf65839e2637d6d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:24.142450 9435 consensus_queue.cc:260] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.144801 9426 tablet_bootstrap.cc:492] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
W20251215 14:55:24.146183 11384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 14:55:24.146236 9426 ts_tablet_manager.cc:1403] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.000s
I20251215 14:55:24.147281 11271 consensus_queue.cc:1048] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:24.147581 9435 ts_tablet_manager.cc:1434] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s
I20251215 14:55:24.150195 9435 tablet_bootstrap.cc:492] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.153141 9426 raft_consensus.cc:359] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:24.156095 11385 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 14:55:24.154845 9426 raft_consensus.cc:385] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.157362 9426 raft_consensus.cc:740] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
W20251215 14:55:24.160302 9112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 47588.2us
I20251215 14:55:24.159570 9426 consensus_queue.cc:260] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.162820 10832 raft_consensus.cc:493] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.163002 10832 raft_consensus.cc:515] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.163668 10832 leader_election.cc:290] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.164633 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92ab40be35344612bdf65839e2637d6d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.164954 9029 raft_consensus.cc:2393] T 92ab40be35344612bdf65839e2637d6d P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:24.165951 11292 server_base.cc:1047] running on GCE node
I20251215 14:55:24.166738 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84477b0a4bd14522908cc28e7015e4f9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:24.166934 11389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251215 14:55:24.167084 9426 ts_tablet_manager.cc:1434] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.020s user 0.004s sys 0.000s
W20251215 14:55:24.167389 8976 leader_election.cc:343] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:24.168569 9435 tablet_bootstrap.cc:654] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.169210 9426 tablet_bootstrap.cc:492] T 6a7a401d5386499183b6560411f593b6 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:24.169482 11292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251215 14:55:24.178592 9426 tablet_bootstrap.cc:654] T 6a7a401d5386499183b6560411f593b6 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.184496 9426 tablet_bootstrap.cc:492] T 6a7a401d5386499183b6560411f593b6 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:24.186373 9426 ts_tablet_manager.cc:1403] T 6a7a401d5386499183b6560411f593b6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20251215 14:55:24.188023 11153 raft_consensus.cc:493] T d45d6eebc703414fa9028faab9fc993c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.188189 9435 tablet_bootstrap.cc:492] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.188241 11153 raft_consensus.cc:515] T d45d6eebc703414fa9028faab9fc993c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.188449 9435 ts_tablet_manager.cc:1403] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.003s
I20251215 14:55:24.188967 11153 leader_election.cc:290] T d45d6eebc703414fa9028faab9fc993c P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:24.189854 9435 raft_consensus.cc:359] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.190142 9435 raft_consensus.cc:385] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.190282 9435 raft_consensus.cc:740] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.190658 9435 consensus_queue.cc:260] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.192149 9435 ts_tablet_manager.cc:1434] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20251215 14:55:24.193995 9435 tablet_bootstrap.cc:492] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.194825 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84477b0a4bd14522908cc28e7015e4f9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:24.194936 9426 raft_consensus.cc:359] T 6a7a401d5386499183b6560411f593b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.196203 9426 raft_consensus.cc:385] T 6a7a401d5386499183b6560411f593b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.196403 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45d6eebc703414fa9028faab9fc993c" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:24.196606 9426 raft_consensus.cc:740] T 6a7a401d5386499183b6560411f593b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.197528 11153 raft_consensus.cc:493] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.197719 11153 raft_consensus.cc:515] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.198312 11153 leader_election.cc:290] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.197810 9426 consensus_queue.cc:260] T 6a7a401d5386499183b6560411f593b6 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.199694 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "022c9c0d19ac450cb270319004886fe2" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:24.199935 9312 raft_consensus.cc:2468] T 022c9c0d19ac450cb270319004886fe2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:24.205437 9115 leader_election.cc:304] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:24.206780 9427 tablet_bootstrap.cc:492] T fc3bcd441f1948a5a79d20e2e205d7f2 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:24.206930 11380 raft_consensus.cc:2804] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:24.207062 9427 ts_tablet_manager.cc:1403] T fc3bcd441f1948a5a79d20e2e205d7f2 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.169s user 0.030s sys 0.022s
I20251215 14:55:24.207278 11380 raft_consensus.cc:493] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:24.208076 9427 raft_consensus.cc:359] T fc3bcd441f1948a5a79d20e2e205d7f2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.208340 9427 raft_consensus.cc:385] T fc3bcd441f1948a5a79d20e2e205d7f2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.208374 11380 raft_consensus.cc:3060] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.208452 9427 raft_consensus.cc:740] T fc3bcd441f1948a5a79d20e2e205d7f2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.208727 9427 consensus_queue.cc:260] T fc3bcd441f1948a5a79d20e2e205d7f2 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.209339 9427 ts_tablet_manager.cc:1434] T fc3bcd441f1948a5a79d20e2e205d7f2 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:24.206779 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d45d6eebc703414fa9028faab9fc993c" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.209995 9427 tablet_bootstrap.cc:492] T 022c9c0d19ac450cb270319004886fe2 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:24.211814 9427 tablet_bootstrap.cc:654] T 022c9c0d19ac450cb270319004886fe2 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.212486 9435 tablet_bootstrap.cc:654] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.212949 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "022c9c0d19ac450cb270319004886fe2" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.210455 9426 ts_tablet_manager.cc:1434] T 6a7a401d5386499183b6560411f593b6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.023s user 0.003s sys 0.000s
I20251215 14:55:24.213984 9426 tablet_bootstrap.cc:492] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:24.214417 9112 leader_election.cc:304] T 92ab40be35344612bdf65839e2637d6d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:24.214918 10559 raft_consensus.cc:3060] T 92ab40be35344612bdf65839e2637d6d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.217540 10559 raft_consensus.cc:2749] T 92ab40be35344612bdf65839e2637d6d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:24.218089 11153 raft_consensus.cc:493] T cf6e4aa94f79403588dd1916226660fd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.218272 11153 raft_consensus.cc:515] T cf6e4aa94f79403588dd1916226660fd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.219024 11292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251215 14:55:24.219564 9426 tablet_bootstrap.cc:654] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.220009 11153 leader_election.cc:290] T cf6e4aa94f79403588dd1916226660fd P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.220726 11153 raft_consensus.cc:493] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.220890 11153 raft_consensus.cc:515] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:24.221475 11153 leader_election.cc:290] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:24.224388 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bd33107c2ed4b27841f3e1ece1df152" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:24.224647 9314 raft_consensus.cc:2468] T 3bd33107c2ed4b27841f3e1ece1df152 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:24.225349 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf6e4aa94f79403588dd1916226660fd" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:24.226867 9115 leader_election.cc:304] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:24.227216 10559 raft_consensus.cc:493] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.227519 10559 raft_consensus.cc:515] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.228855 10559 leader_election.cc:290] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.229271 10559 raft_consensus.cc:2804] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:24.229439 10559 raft_consensus.cc:493] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:24.229653 10559 raft_consensus.cc:3060] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.234967 11292 hybrid_clock.cc:648] HybridClock initialized: now 1765810524234826 us; error 105 us; skew 500 ppm
I20251215 14:55:24.235527 11292 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251215 14:55:24.238065 10559 raft_consensus.cc:515] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:24.239713 10559 leader_election.cc:290] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:24.246904 10559 consensus_queue.cc:1048] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:24.254660 9180 raft_consensus.cc:3060] T cf6e4aa94f79403588dd1916226660fd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.264609 9426 tablet_bootstrap.cc:492] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:24.264768 9426 ts_tablet_manager.cc:1403] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.051s user 0.013s sys 0.000s
I20251215 14:55:24.265419 9426 raft_consensus.cc:359] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.265618 9426 raft_consensus.cc:385] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.265672 9426 raft_consensus.cc:740] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.265751 9112 leader_election.cc:304] T d45d6eebc703414fa9028faab9fc993c P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:24.265836 9426 consensus_queue.cc:260] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:24.266183 9112 leader_election.cc:343] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:24.266789 10559 raft_consensus.cc:2749] T d45d6eebc703414fa9028faab9fc993c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:24.267979 11038 consensus_queue.cc:1048] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
W20251215 14:55:24.268105 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 44055.2us
I20251215 14:55:24.268517 11174 consensus_queue.cc:1048] T e4078381658347a6a9d3063cc0cb3a53 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:24.269102 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bd33107c2ed4b27841f3e1ece1df152" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:24.269307 9314 raft_consensus.cc:3060] T 3bd33107c2ed4b27841f3e1ece1df152 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.269848 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39d0bab4179d4af68d2dbcd3e215873e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.270017 9024 raft_consensus.cc:2468] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:24.270638 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be4393dc706f45a89b9b2c9727cd7726" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.271464 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8eb90003cf02440e9752af134a3670b6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:24.276448 9435 tablet_bootstrap.cc:492] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.276669 9435 ts_tablet_manager.cc:1403] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.083s user 0.000s sys 0.016s
I20251215 14:55:24.277518 9435 raft_consensus.cc:359] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.277750 9435 raft_consensus.cc:385] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.277848 9435 raft_consensus.cc:740] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.278112 9435 consensus_queue.cc:260] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.278663 9435 ts_tablet_manager.cc:1434] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:24.278987 9435 tablet_bootstrap.cc:492] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.280758 9435 tablet_bootstrap.cc:654] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.266228 9426 ts_tablet_manager.cc:1434] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:24.281880 9426 tablet_bootstrap.cc:492] T 0fed3b34844e4e5b8518c0165df342d1 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:24.283581 11380 raft_consensus.cc:515] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.284220 11380 leader_election.cc:290] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.284844 11174 raft_consensus.cc:493] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.284968 11174 raft_consensus.cc:515] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.285485 11174 leader_election.cc:290] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.289822 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "022c9c0d19ac450cb270319004886fe2" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:24.290004 9303 raft_consensus.cc:3060] T 022c9c0d19ac450cb270319004886fe2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.290220 11174 consensus_queue.cc:1048] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:24.292716 9303 raft_consensus.cc:2468] T 022c9c0d19ac450cb270319004886fe2 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:24.303753 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf6e4aa94f79403588dd1916226660fd" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.304019 9024 raft_consensus.cc:2393] T cf6e4aa94f79403588dd1916226660fd P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:24.304699 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bd33107c2ed4b27841f3e1ece1df152" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.304868 9024 raft_consensus.cc:2468] T 3bd33107c2ed4b27841f3e1ece1df152 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:24.306877 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bd33107c2ed4b27841f3e1ece1df152" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:24.307024 9024 raft_consensus.cc:3060] T 3bd33107c2ed4b27841f3e1ece1df152 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.307440 11292 webserver.cc:492] Webserver started at http://127.8.121.190:40239/ using document root <none> and password file <none>
I20251215 14:55:24.307407 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8eb90003cf02440e9752af134a3670b6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.307835 9029 raft_consensus.cc:2468] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:24.308583 11292 fs_manager.cc:362] Metadata directory not provided
I20251215 14:55:24.308722 11292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251215 14:55:24.309844 9024 raft_consensus.cc:2468] T 3bd33107c2ed4b27841f3e1ece1df152 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
W20251215 14:55:24.313560 8978 leader_election.cc:343] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:24.314112 8978 leader_election.cc:304] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:24.314877 11218 raft_consensus.cc:2749] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:24.316309 9025 raft_consensus.cc:3060] T 566fe9bb8a1849749087d840ef1c082d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.319901 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e1472ce5a464a12a711d513446abe2a" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.320044 9025 raft_consensus.cc:2468] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:24.321185 8978 leader_election.cc:304] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:24.321941 11283 raft_consensus.cc:2804] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:24.322149 11283 raft_consensus.cc:697] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:24.322424 11283 consensus_queue.cc:237] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.326244 11166 consensus_queue.cc:1048] T ad2bead71c9a462bbd7888774c608ba9 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:24.327211 9427 tablet_bootstrap.cc:492] T 022c9c0d19ac450cb270319004886fe2 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:24.327337 9427 ts_tablet_manager.cc:1403] T 022c9c0d19ac450cb270319004886fe2 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.117s user 0.005s sys 0.008s
W20251215 14:55:24.291293 9115 leader_election.cc:343] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:24.297143 9426 tablet_bootstrap.cc:654] T 0fed3b34844e4e5b8518c0165df342d1 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.327970 9427 raft_consensus.cc:359] T 022c9c0d19ac450cb270319004886fe2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.328114 9427 raft_consensus.cc:385] T 022c9c0d19ac450cb270319004886fe2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.328164 9427 raft_consensus.cc:740] T 022c9c0d19ac450cb270319004886fe2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.328037 9115 leader_election.cc:304] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:24.328310 9427 consensus_queue.cc:260] T 022c9c0d19ac450cb270319004886fe2 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.328706 9427 ts_tablet_manager.cc:1434] T 022c9c0d19ac450cb270319004886fe2 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:24.328642 10559 consensus_queue.cc:1048] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:24.328696 11398 consensus_queue.cc:1048] T 25615ca6c21d4d5f8880d3dff4253e61 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:24.328965 9427 tablet_bootstrap.cc:492] T a71d029bbd88416da1dbcad09dc93115 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:24.329030 10559 raft_consensus.cc:2804] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:24.329144 10559 raft_consensus.cc:697] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:24.329357 10559 consensus_queue.cc:237] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.330224 9427 tablet_bootstrap.cc:654] T a71d029bbd88416da1dbcad09dc93115 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.338186 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc3bcd441f1948a5a79d20e2e205d7f2" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:24.339020 8978 leader_election.cc:304] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:24.339726 11218 raft_consensus.cc:2804] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:24.339795 11218 raft_consensus.cc:493] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:24.339847 11218 raft_consensus.cc:3060] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.342299 11218 raft_consensus.cc:515] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.342976 11218 leader_election.cc:290] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.326359 9112 leader_election.cc:304] T cf6e4aa94f79403588dd1916226660fd P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:24.343870 9112 leader_election.cc:304] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters: e89303a500544272b601d7c29be802b4
I20251215 14:55:24.344681 11398 raft_consensus.cc:2804] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:24.344811 11398 raft_consensus.cc:493] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:24.344933 11398 raft_consensus.cc:3060] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.346596 9175 raft_consensus.cc:2468] T fc3bcd441f1948a5a79d20e2e205d7f2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:24.347676 11398 raft_consensus.cc:515] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.348342 11398 leader_election.cc:290] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.351238 11380 raft_consensus.cc:493] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.351425 11380 raft_consensus.cc:515] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.352044 11380 leader_election.cc:290] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.352422 9112 leader_election.cc:304] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:24.354462 11380 raft_consensus.cc:2804] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:24.354630 11380 raft_consensus.cc:697] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:24.357447 11380 consensus_queue.cc:237] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:24.358023 8978 leader_election.cc:343] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:24.358258 8978 leader_election.cc:304] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:24.358639 11218 raft_consensus.cc:2749] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:24.359560 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8eb90003cf02440e9752af134a3670b6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:24.360551 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c025355716a43569a1bebb46de7dd93" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:24.368548 11153 raft_consensus.cc:2749] T cf6e4aa94f79403588dd1916226660fd P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:24.375594 9249 leader_election.cc:304] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:24.376305 11271 raft_consensus.cc:2804] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:24.376380 11271 raft_consensus.cc:493] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:24.376438 11271 raft_consensus.cc:3060] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.378983 11271 raft_consensus.cc:515] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.379690 11271 leader_election.cc:290] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.381795 11218 consensus_queue.cc:1048] T 2ef8c3e099ba4e4d8d661af5c72c5e8c P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:24.383059 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:24.387154 9426 tablet_bootstrap.cc:492] T 0fed3b34844e4e5b8518c0165df342d1 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:24.387460 9426 ts_tablet_manager.cc:1403] T 0fed3b34844e4e5b8518c0165df342d1 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.106s user 0.008s sys 0.015s
I20251215 14:55:24.392393 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "022c9c0d19ac450cb270319004886fe2" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:24.392630 9024 raft_consensus.cc:3060] T 022c9c0d19ac450cb270319004886fe2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.393750 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8eb90003cf02440e9752af134a3670b6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:24.393958 9029 raft_consensus.cc:3060] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.394595 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c025355716a43569a1bebb46de7dd93" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.394735 9030 raft_consensus.cc:2468] T 5c025355716a43569a1bebb46de7dd93 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:24.394968 9426 raft_consensus.cc:359] T 0fed3b34844e4e5b8518c0165df342d1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.395810 9426 raft_consensus.cc:385] T 0fed3b34844e4e5b8518c0165df342d1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.396534 9029 raft_consensus.cc:2468] T 8eb90003cf02440e9752af134a3670b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:24.396201 9426 raft_consensus.cc:740] T 0fed3b34844e4e5b8518c0165df342d1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.397879 9024 raft_consensus.cc:2468] T 022c9c0d19ac450cb270319004886fe2 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:24.398825 9426 consensus_queue.cc:260] T 0fed3b34844e4e5b8518c0165df342d1 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.399755 9435 tablet_bootstrap.cc:492] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.399879 9435 ts_tablet_manager.cc:1403] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.121s user 0.013s sys 0.012s
I20251215 14:55:24.400187 9426 ts_tablet_manager.cc:1434] T 0fed3b34844e4e5b8518c0165df342d1 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20251215 14:55:24.400570 9435 raft_consensus.cc:359] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.400733 9435 raft_consensus.cc:385] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.400799 9435 raft_consensus.cc:740] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.400975 9435 consensus_queue.cc:260] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.401122 9426 tablet_bootstrap.cc:492] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:24.401436 9435 ts_tablet_manager.cc:1434] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:24.401690 9435 tablet_bootstrap.cc:492] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.403141 9435 tablet_bootstrap.cc:654] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.403726 9426 tablet_bootstrap.cc:654] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.405010 11292 fs_manager.cc:714] Time spent opening directory manager: real 0.093s user 0.009s sys 0.011s
I20251215 14:55:24.406286 11270 consensus_queue.cc:1048] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:24.407155 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc3bcd441f1948a5a79d20e2e205d7f2" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:24.407344 9172 raft_consensus.cc:3060] T fc3bcd441f1948a5a79d20e2e205d7f2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.409312 9435 tablet_bootstrap.cc:492] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.409832 9172 raft_consensus.cc:2468] T fc3bcd441f1948a5a79d20e2e205d7f2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:24.414660 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e1472ce5a464a12a711d513446abe2a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:24.415298 9435 ts_tablet_manager.cc:1403] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.003s
I20251215 14:55:24.413014 11270 raft_consensus.cc:493] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.415639 11270 raft_consensus.cc:515] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.415997 9435 raft_consensus.cc:359] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.416158 9435 raft_consensus.cc:385] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.416213 9435 raft_consensus.cc:740] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.416401 9435 consensus_queue.cc:260] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.416662 11270 leader_election.cc:290] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.416872 9435 ts_tablet_manager.cc:1434] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:24.417176 9435 tablet_bootstrap.cc:492] T 52e93348b205408f83efff27fde48e9b P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.418876 9435 tablet_bootstrap.cc:654] T 52e93348b205408f83efff27fde48e9b P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.419901 11417 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251215 14:55:24.420554 11271 raft_consensus.cc:493] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.420799 11271 raft_consensus.cc:515] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.421494 11271 leader_election.cc:290] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.421684 11271 raft_consensus.cc:493] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.421854 11271 raft_consensus.cc:515] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.421926 11292 fs_manager.cc:730] Time spent opening block manager: real 0.015s user 0.002s sys 0.000s
I20251215 14:55:24.422767 11271 leader_election.cc:290] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.422117 11292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data,/tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
uuid: "cad1fca07ac7419cb608c21541f672f3"
format_stamp: "Formatted at 2025-12-15 14:54:58 on dist-test-slave-z089"
I20251215 14:55:24.423369 11292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251215 14:55:24.423745 11270 raft_consensus.cc:493] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.423885 11270 raft_consensus.cc:515] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.424399 11270 leader_election.cc:290] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.433589 9426 tablet_bootstrap.cc:492] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:24.433877 9426 ts_tablet_manager.cc:1403] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.033s user 0.009s sys 0.013s
W20251215 14:55:24.434965 8976 leader_election.cc:343] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:24.435364 9426 raft_consensus.cc:359] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.435760 9426 raft_consensus.cc:385] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.435858 9426 raft_consensus.cc:740] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.436246 9426 consensus_queue.cc:260] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.438513 9435 tablet_bootstrap.cc:492] T 52e93348b205408f83efff27fde48e9b P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.438515 9426 ts_tablet_manager.cc:1434] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20251215 14:55:24.438673 9435 ts_tablet_manager.cc:1403] T 52e93348b205408f83efff27fde48e9b P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.000s
I20251215 14:55:24.439136 9426 tablet_bootstrap.cc:492] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:24.439460 9435 raft_consensus.cc:359] T 52e93348b205408f83efff27fde48e9b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.439648 9435 raft_consensus.cc:385] T 52e93348b205408f83efff27fde48e9b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.439713 9435 raft_consensus.cc:740] T 52e93348b205408f83efff27fde48e9b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.439905 9435 consensus_queue.cc:260] T 52e93348b205408f83efff27fde48e9b P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.440383 9435 ts_tablet_manager.cc:1434] T 52e93348b205408f83efff27fde48e9b P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:24.440670 9435 tablet_bootstrap.cc:492] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.442478 9435 tablet_bootstrap.cc:654] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.442903 9426 tablet_bootstrap.cc:654] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.459244 9435 tablet_bootstrap.cc:492] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.459421 9435 ts_tablet_manager.cc:1403] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.000s
I20251215 14:55:24.460175 9435 raft_consensus.cc:359] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.460355 9435 raft_consensus.cc:385] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.460417 9435 raft_consensus.cc:740] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.460602 9435 consensus_queue.cc:260] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.461118 9435 ts_tablet_manager.cc:1434] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:24.461405 9435 tablet_bootstrap.cc:492] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.462620 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd025ffa766d45f8bc6c42c6eaa3418c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:24.463088 9435 tablet_bootstrap.cc:654] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.463748 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10890fcab7204cc7b7468402952f824c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:24.472849 9426 tablet_bootstrap.cc:492] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:24.473189 9426 ts_tablet_manager.cc:1403] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.034s user 0.010s sys 0.009s
I20251215 14:55:24.475118 9426 raft_consensus.cc:359] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.475685 9426 raft_consensus.cc:385] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.475867 9426 raft_consensus.cc:740] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.476836 9426 consensus_queue.cc:260] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.477452 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a7a401d5386499183b6560411f593b6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:24.477708 9172 raft_consensus.cc:2468] T 6a7a401d5386499183b6560411f593b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:24.478984 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e1472ce5a464a12a711d513446abe2a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:24.478132 9426 ts_tablet_manager.cc:1434] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20251215 14:55:24.479153 9303 raft_consensus.cc:3060] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.479489 9435 tablet_bootstrap.cc:492] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.479606 9435 ts_tablet_manager.cc:1403] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.000s
I20251215 14:55:24.480075 9426 tablet_bootstrap.cc:492] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:24.480319 9435 raft_consensus.cc:359] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.480450 9435 raft_consensus.cc:385] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.480494 9435 raft_consensus.cc:740] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.480675 9435 consensus_queue.cc:260] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.481127 9435 ts_tablet_manager.cc:1434] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:24.481369 9435 tablet_bootstrap.cc:492] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.481994 9303 raft_consensus.cc:2468] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:24.482910 9435 tablet_bootstrap.cc:654] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.484169 9426 tablet_bootstrap.cc:654] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.489964 9112 leader_election.cc:304] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:24.493304 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86f18ff40af547da85de8966b12f76f4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:24.501309 11380 raft_consensus.cc:2804] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:24.477113 9249 leader_election.cc:304] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:24.501653 11380 raft_consensus.cc:493] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:24.503029 9435 tablet_bootstrap.cc:492] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.503185 9435 ts_tablet_manager.cc:1403] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.003s
I20251215 14:55:24.503592 11380 raft_consensus.cc:3060] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:24.499007 9115 leader_election.cc:343] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:24.506328 9115 leader_election.cc:343] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:24.507124 11270 raft_consensus.cc:2804] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:24.507663 11292 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251215 14:55:24.507750 11270 raft_consensus.cc:697] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:24.508062 11270 consensus_queue.cc:237] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.509284 11292 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251215 14:55:24.509661 11292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251215 14:55:24.516923 9435 raft_consensus.cc:359] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.517115 9435 raft_consensus.cc:385] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.517163 9435 raft_consensus.cc:740] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.517344 9435 consensus_queue.cc:260] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.517833 9435 ts_tablet_manager.cc:1434] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20251215 14:55:24.518100 9435 tablet_bootstrap.cc:492] T 84477b0a4bd14522908cc28e7015e4f9 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.519521 9435 tablet_bootstrap.cc:654] T 84477b0a4bd14522908cc28e7015e4f9 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.520591 11038 consensus_queue.cc:1048] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:24.522032 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 5e5c1626a30444bf987a7d7e09a586f7 (table default.Table_74d3e3d32e1d494eaf2e694a1313979d [id=cd317b83fc264aa09cd8833ce85a5dba], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5e5c1626a30444bf987a7d7e09a586f7 consensus state has no leader
I20251215 14:55:24.506783 9112 leader_election.cc:304] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters: e89303a500544272b601d7c29be802b4
I20251215 14:55:24.531427 9435 tablet_bootstrap.cc:492] T 84477b0a4bd14522908cc28e7015e4f9 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.531641 9435 ts_tablet_manager.cc:1403] T 84477b0a4bd14522908cc28e7015e4f9 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.005s
I20251215 14:55:24.532301 9435 raft_consensus.cc:359] T 84477b0a4bd14522908cc28e7015e4f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.532460 9435 raft_consensus.cc:385] T 84477b0a4bd14522908cc28e7015e4f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.532516 9435 raft_consensus.cc:740] T 84477b0a4bd14522908cc28e7015e4f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.532716 9435 consensus_queue.cc:260] T 84477b0a4bd14522908cc28e7015e4f9 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.533213 9435 ts_tablet_manager.cc:1434] T 84477b0a4bd14522908cc28e7015e4f9 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:24.533501 9435 tablet_bootstrap.cc:492] T 5c025355716a43569a1bebb46de7dd93 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.534861 9435 tablet_bootstrap.cc:654] T 5c025355716a43569a1bebb46de7dd93 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.535243 11153 raft_consensus.cc:2804] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:24.535383 11153 raft_consensus.cc:697] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:24.535602 11153 consensus_queue.cc:237] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:24.545328 9112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 44189.6us
I20251215 14:55:24.547231 10559 consensus_queue.cc:1048] T 295325c4a2ca41caaabddbd96d4bce19 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:24.549999 9435 tablet_bootstrap.cc:492] T 5c025355716a43569a1bebb46de7dd93 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.550140 9435 ts_tablet_manager.cc:1403] T 5c025355716a43569a1bebb46de7dd93 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20251215 14:55:24.550793 9435 raft_consensus.cc:359] T 5c025355716a43569a1bebb46de7dd93 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.550949 9435 raft_consensus.cc:385] T 5c025355716a43569a1bebb46de7dd93 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.551004 9435 raft_consensus.cc:740] T 5c025355716a43569a1bebb46de7dd93 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.551225 9435 consensus_queue.cc:260] T 5c025355716a43569a1bebb46de7dd93 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.551714 9435 ts_tablet_manager.cc:1434] T 5c025355716a43569a1bebb46de7dd93 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:24.551971 9435 tablet_bootstrap.cc:492] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.553319 9435 tablet_bootstrap.cc:654] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:24.556811 9249 leader_election.cc:343] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:24.557083 9249 leader_election.cc:343] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:24.557363 9249 leader_election.cc:304] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:24.557663 9249 leader_election.cc:343] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:24.600212 11380 raft_consensus.cc:515] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:24.613152 9249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 55519.2us
I20251215 14:55:24.557983 11098 raft_consensus.cc:2804] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:24.563796 9435 tablet_bootstrap.cc:492] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.613983 11098 raft_consensus.cc:493] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:24.614078 9435 ts_tablet_manager.cc:1403] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.062s user 0.001s sys 0.005s
I20251215 14:55:24.614326 11098 raft_consensus.cc:3060] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.614925 9435 raft_consensus.cc:359] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.615092 9435 raft_consensus.cc:385] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.615142 9435 raft_consensus.cc:740] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.615352 9435 consensus_queue.cc:260] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.615844 9435 ts_tablet_manager.cc:1434] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:24.616122 9435 tablet_bootstrap.cc:492] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.617753 9435 tablet_bootstrap.cc:654] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.612800 11038 raft_consensus.cc:493] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.618826 11038 raft_consensus.cc:515] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.620505 11038 leader_election.cc:290] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.633395 9435 tablet_bootstrap.cc:492] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.657815 9435 ts_tablet_manager.cc:1403] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.042s user 0.004s sys 0.006s
I20251215 14:55:24.658593 9435 raft_consensus.cc:359] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.658762 9435 raft_consensus.cc:385] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.658814 9435 raft_consensus.cc:740] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.659009 9435 consensus_queue.cc:260] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.659534 9435 ts_tablet_manager.cc:1434] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:24.659816 9435 tablet_bootstrap.cc:492] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.661350 9435 tablet_bootstrap.cc:654] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.636730 11098 raft_consensus.cc:515] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.665191 11098 leader_election.cc:290] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.605580 11398 raft_consensus.cc:493] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.665493 11398 raft_consensus.cc:515] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.666092 11398 leader_election.cc:290] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.666440 11398 raft_consensus.cc:493] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.666549 11398 raft_consensus.cc:515] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.666996 11398 leader_election.cc:290] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.664376 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f45f8b2fbf754d359deb666cb605c789" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:24.669059 11380 leader_election.cc:290] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.674516 11398 consensus_queue.cc:1048] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:24.689729 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc3bcd441f1948a5a79d20e2e205d7f2" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.689950 9025 raft_consensus.cc:2468] T fc3bcd441f1948a5a79d20e2e205d7f2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:24.694653 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc3bcd441f1948a5a79d20e2e205d7f2" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:24.694856 9025 raft_consensus.cc:3060] T fc3bcd441f1948a5a79d20e2e205d7f2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.697992 9025 raft_consensus.cc:2468] T fc3bcd441f1948a5a79d20e2e205d7f2 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:24.642822 11270 raft_consensus.cc:493] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.686086 9435 tablet_bootstrap.cc:492] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.703611 9435 ts_tablet_manager.cc:1403] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.044s user 0.006s sys 0.005s
I20251215 14:55:24.703596 11270 raft_consensus.cc:515] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.704545 9435 raft_consensus.cc:359] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.704711 9435 raft_consensus.cc:385] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.704763 9435 raft_consensus.cc:740] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.704613 11270 leader_election.cc:290] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.704948 9435 consensus_queue.cc:260] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.705436 9435 ts_tablet_manager.cc:1434] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:24.705746 9435 tablet_bootstrap.cc:492] T 8eb90003cf02440e9752af134a3670b6 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.707474 9435 tablet_bootstrap.cc:654] T 8eb90003cf02440e9752af134a3670b6 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.712694 11174 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.712973 11174 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:24.713778 11174 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.719010 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c025355716a43569a1bebb46de7dd93" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:24.719401 9025 raft_consensus.cc:3060] T 5c025355716a43569a1bebb46de7dd93 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.719635 9435 tablet_bootstrap.cc:492] T 8eb90003cf02440e9752af134a3670b6 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.719774 9435 ts_tablet_manager.cc:1403] T 8eb90003cf02440e9752af134a3670b6 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.004s
I20251215 14:55:24.720512 9435 raft_consensus.cc:359] T 8eb90003cf02440e9752af134a3670b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.720664 9435 raft_consensus.cc:385] T 8eb90003cf02440e9752af134a3670b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.720716 9435 raft_consensus.cc:740] T 8eb90003cf02440e9752af134a3670b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.720897 9435 consensus_queue.cc:260] T 8eb90003cf02440e9752af134a3670b6 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.721381 9435 ts_tablet_manager.cc:1434] T 8eb90003cf02440e9752af134a3670b6 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:24.721644 9435 tablet_bootstrap.cc:492] T 2b686ad43973448c8e24230d7d1d7250 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.723182 9435 tablet_bootstrap.cc:654] T 2b686ad43973448c8e24230d7d1d7250 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.726313 9025 raft_consensus.cc:2468] T 5c025355716a43569a1bebb46de7dd93 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:24.726850 11380 raft_consensus.cc:493] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.727296 11380 raft_consensus.cc:515] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.727986 11380 leader_election.cc:290] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.728750 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82575517299b4e69a0871714dde9aacc" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.729331 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a29174caad24ebc9d26b4169085dc08" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.742163 9427 tablet_bootstrap.cc:492] T a71d029bbd88416da1dbcad09dc93115 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:24.742383 9427 ts_tablet_manager.cc:1403] T a71d029bbd88416da1dbcad09dc93115 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.413s user 0.140s sys 0.222s
I20251215 14:55:24.743276 9427 raft_consensus.cc:359] T a71d029bbd88416da1dbcad09dc93115 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.743528 9427 raft_consensus.cc:385] T a71d029bbd88416da1dbcad09dc93115 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.743628 9427 raft_consensus.cc:740] T a71d029bbd88416da1dbcad09dc93115 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.743857 9427 consensus_queue.cc:260] T a71d029bbd88416da1dbcad09dc93115 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.744328 9427 ts_tablet_manager.cc:1434] T a71d029bbd88416da1dbcad09dc93115 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:24.744630 9427 tablet_bootstrap.cc:492] T be4393dc706f45a89b9b2c9727cd7726 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:24.749868 9427 tablet_bootstrap.cc:654] T be4393dc706f45a89b9b2c9727cd7726 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:24.762742 9249 leader_election.cc:343] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:24.768527 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82575517299b4e69a0871714dde9aacc" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:24.768937 9312 raft_consensus.cc:2468] T 82575517299b4e69a0871714dde9aacc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:24.769402 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a29174caad24ebc9d26b4169085dc08" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:24.770201 9303 raft_consensus.cc:2468] T 7a29174caad24ebc9d26b4169085dc08 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:24.772133 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "52e93348b205408f83efff27fde48e9b" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.772866 9112 leader_election.cc:304] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:24.774808 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd025ffa766d45f8bc6c42c6eaa3418c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.775525 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86f18ff40af547da85de8966b12f76f4" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.775789 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10890fcab7204cc7b7468402952f824c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:24.782510 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:24.788336 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c025355716a43569a1bebb46de7dd93" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:24.788534 9303 raft_consensus.cc:3060] T 5c025355716a43569a1bebb46de7dd93 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.791500 9303 raft_consensus.cc:2468] T 5c025355716a43569a1bebb46de7dd93 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:24.791855 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a7a401d5386499183b6560411f593b6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.792199 9024 raft_consensus.cc:2468] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:24.781564 9426 tablet_bootstrap.cc:492] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:24.788019 11153 raft_consensus.cc:493] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.804261 9426 ts_tablet_manager.cc:1403] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.324s user 0.024s sys 0.047s
I20251215 14:55:24.804566 11153 raft_consensus.cc:515] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.805342 11153 leader_election.cc:290] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.801970 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a7a401d5386499183b6560411f593b6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:24.806207 9180 raft_consensus.cc:3060] T 6a7a401d5386499183b6560411f593b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.809569 9180 raft_consensus.cc:2468] T 6a7a401d5386499183b6560411f593b6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:24.812909 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "90c7925890474a76b35a3ce5e6db8ebf" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:24.814306 11398 consensus_queue.cc:1048] T 6a09ed5b19594fba9e73f7b6e3f7bd4f P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:24.815083 9426 raft_consensus.cc:359] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.815253 11153 raft_consensus.cc:2804] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:24.815284 9426 raft_consensus.cc:385] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.815544 9426 raft_consensus.cc:740] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.815776 11153 raft_consensus.cc:697] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:24.815743 9426 consensus_queue.cc:260] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.816310 9426 ts_tablet_manager.cc:1434] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.012s user 0.002s sys 0.000s
I20251215 14:55:24.816298 11153 consensus_queue.cc:237] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.816690 9426 tablet_bootstrap.cc:492] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:24.818565 9426 tablet_bootstrap.cc:654] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:24.824074 9112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 51264.9us
W20251215 14:55:24.824445 9112 leader_election.cc:343] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:24.824746 9112 leader_election.cc:343] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:24.824954 9112 leader_election.cc:343] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:24.830978 9115 leader_election.cc:304] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:24.831378 11398 raft_consensus.cc:2804] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:24.831498 11398 raft_consensus.cc:493] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:24.831616 11398 raft_consensus.cc:3060] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.834610 11398 raft_consensus.cc:515] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.835469 11398 leader_election.cc:290] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.837669 8978 leader_election.cc:304] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:24.838320 11165 raft_consensus.cc:2804] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:24.838443 11165 raft_consensus.cc:697] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:24.838707 11165 consensus_queue.cc:237] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.798363 9435 tablet_bootstrap.cc:492] T 2b686ad43973448c8e24230d7d1d7250 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.851148 9435 ts_tablet_manager.cc:1403] T 2b686ad43973448c8e24230d7d1d7250 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.130s user 0.006s sys 0.032s
I20251215 14:55:24.852028 9435 raft_consensus.cc:359] T 2b686ad43973448c8e24230d7d1d7250 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:24.852203 9435 raft_consensus.cc:385] T 2b686ad43973448c8e24230d7d1d7250 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.852255 9435 raft_consensus.cc:740] T 2b686ad43973448c8e24230d7d1d7250 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.852429 9435 consensus_queue.cc:260] T 2b686ad43973448c8e24230d7d1d7250 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:24.852097 11398 raft_consensus.cc:493] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.852910 9435 ts_tablet_manager.cc:1434] T 2b686ad43973448c8e24230d7d1d7250 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:24.852759 11398 raft_consensus.cc:515] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.853178 9435 tablet_bootstrap.cc:492] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.854422 11398 leader_election.cc:290] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.854774 9435 tablet_bootstrap.cc:654] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.859458 9435 tablet_bootstrap.cc:492] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.859589 9435 ts_tablet_manager.cc:1403] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s
I20251215 14:55:24.865854 9435 raft_consensus.cc:359] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:24.866041 9435 raft_consensus.cc:385] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.866093 9435 raft_consensus.cc:740] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.866281 9435 consensus_queue.cc:260] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:24.866721 9426 tablet_bootstrap.cc:492] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:24.866783 9435 ts_tablet_manager.cc:1434] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20251215 14:55:24.867038 9435 tablet_bootstrap.cc:492] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.867044 9426 ts_tablet_manager.cc:1403] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.050s user 0.010s sys 0.000s
I20251215 14:55:24.868706 9435 tablet_bootstrap.cc:654] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.868837 9426 raft_consensus.cc:359] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.869258 9426 raft_consensus.cc:385] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.869464 9426 raft_consensus.cc:740] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.869999 9426 consensus_queue.cc:260] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.872395 9426 ts_tablet_manager.cc:1434] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.005s user 0.000s sys 0.003s
I20251215 14:55:24.873310 11473 raft_consensus.cc:493] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.873592 11473 raft_consensus.cc:515] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.874343 11473 leader_election.cc:290] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.874895 9426 tablet_bootstrap.cc:492] T d20ffd43dce84ffe8c770053e5705cbd P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:24.874836 11174 raft_consensus.cc:493] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.875761 11174 raft_consensus.cc:515] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.876351 11174 leader_election.cc:290] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.882721 11283 raft_consensus.cc:493] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.882927 11283 raft_consensus.cc:515] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:24.883777 11283 leader_election.cc:290] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:24.884235 9115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 53310.5us
I20251215 14:55:24.885565 9248 leader_election.cc:304] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:24.888314 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82575517299b4e69a0871714dde9aacc" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:24.888731 9032 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be4393dc706f45a89b9b2c9727cd7726" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.891300 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84f036eb44a44e0597bc9af88d81a017" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.886183 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fed3b34844e4e5b8518c0165df342d1" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:24.894528 9170 raft_consensus.cc:2468] T 0fed3b34844e4e5b8518c0165df342d1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:24.887558 11380 raft_consensus.cc:493] T d39e0db04f3c4bd3831c00b2b4825035 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.894992 11380 raft_consensus.cc:515] T d39e0db04f3c4bd3831c00b2b4825035 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.888083 9426 tablet_bootstrap.cc:654] T d20ffd43dce84ffe8c770053e5705cbd P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.896080 11380 leader_election.cc:290] T d39e0db04f3c4bd3831c00b2b4825035 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.897181 9115 leader_election.cc:304] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:24.895830 9435 tablet_bootstrap.cc:492] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.897661 9435 ts_tablet_manager.cc:1403] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.031s user 0.005s sys 0.010s
I20251215 14:55:24.902422 11038 raft_consensus.cc:2804] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:24.902565 11038 raft_consensus.cc:493] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:24.902695 11038 raft_consensus.cc:3060] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.903301 9435 raft_consensus.cc:359] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:24.903717 9435 raft_consensus.cc:385] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.903852 9435 raft_consensus.cc:740] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.904656 9435 consensus_queue.cc:260] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:24.905923 11038 raft_consensus.cc:515] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.906147 9435 ts_tablet_manager.cc:1434] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20251215 14:55:24.906955 9435 tablet_bootstrap.cc:492] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.910151 11380 raft_consensus.cc:2804] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:24.910305 11380 raft_consensus.cc:493] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:24.910427 11380 raft_consensus.cc:3060] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.892971 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "265a8937802a4b9cbf0edaf3e2a41ba8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:24.907879 9248 leader_election.cc:343] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:24.915127 9435 tablet_bootstrap.cc:654] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.917039 9426 tablet_bootstrap.cc:492] T d20ffd43dce84ffe8c770053e5705cbd P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:24.917172 9426 ts_tablet_manager.cc:1403] T d20ffd43dce84ffe8c770053e5705cbd P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.003s
I20251215 14:55:24.917824 9426 raft_consensus.cc:359] T d20ffd43dce84ffe8c770053e5705cbd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.917984 9426 raft_consensus.cc:385] T d20ffd43dce84ffe8c770053e5705cbd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.918040 9426 raft_consensus.cc:740] T d20ffd43dce84ffe8c770053e5705cbd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.914968 9249 leader_election.cc:304] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:24.918213 9426 consensus_queue.cc:260] T d20ffd43dce84ffe8c770053e5705cbd P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.918650 11098 raft_consensus.cc:2804] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:24.918673 9426 ts_tablet_manager.cc:1434] T d20ffd43dce84ffe8c770053e5705cbd P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:24.918808 11098 raft_consensus.cc:697] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:24.918920 9426 tablet_bootstrap.cc:492] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:24.919126 11098 consensus_queue.cc:237] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.914685 11270 raft_consensus.cc:493] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.920490 9426 tablet_bootstrap.cc:654] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.920605 11270 raft_consensus.cc:515] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.921301 11270 leader_election.cc:290] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.908347 11038 leader_election.cc:290] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.915256 9248 leader_election.cc:304] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:24.922226 11270 raft_consensus.cc:2749] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:24.929836 11398 raft_consensus.cc:493] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.930178 11398 raft_consensus.cc:515] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.930846 11398 leader_election.cc:290] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.931443 9435 tablet_bootstrap.cc:492] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:24.931578 9435 ts_tablet_manager.cc:1403] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.025s user 0.004s sys 0.000s
I20251215 14:55:24.932264 9435 raft_consensus.cc:359] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:24.932431 9435 raft_consensus.cc:385] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.932719 9435 raft_consensus.cc:740] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.932898 9435 consensus_queue.cc:260] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:24.933215 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d39e0db04f3c4bd3831c00b2b4825035" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.933367 9435 ts_tablet_manager.cc:1434] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:24.933641 9435 tablet_bootstrap.cc:492] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.934993 9435 tablet_bootstrap.cc:654] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.934988 11398 raft_consensus.cc:493] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:24.935298 11398 raft_consensus.cc:515] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.935997 11398 leader_election.cc:290] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
W20251215 14:55:24.939554 9249 leader_election.cc:343] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:24.940292 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:55:24.942699 11174 consensus_queue.cc:1048] T 042632f0dabd4a79a36a5f27bef12faa P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:24.945761 11473 consensus_queue.cc:1048] T 10cd2cbd7956444cb125d97310d2b102 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:24.946409 9112 leader_election.cc:343] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:24.951788 9112 leader_election.cc:343] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:24.952276 9249 leader_election.cc:304] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:24.954820 9112 leader_election.cc:343] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:24.959704 11270 raft_consensus.cc:2804] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:24.959959 11270 raft_consensus.cc:493] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:24.960120 11270 raft_consensus.cc:3060] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:24.962705 11270 raft_consensus.cc:515] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.963486 11270 leader_election.cc:290] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:24.964517 9435 tablet_bootstrap.cc:492] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
W20251215 14:55:24.964946 9249 leader_election.cc:343] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:24.957983 11380 raft_consensus.cc:515] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.965373 9435 ts_tablet_manager.cc:1403] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.032s user 0.008s sys 0.007s
I20251215 14:55:24.972596 9435 raft_consensus.cc:359] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:24.974299 9435 raft_consensus.cc:385] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.974916 9435 raft_consensus.cc:740] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.976929 9435 consensus_queue.cc:260] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:24.981798 9435 ts_tablet_manager.cc:1434] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.014s user 0.001s sys 0.002s
I20251215 14:55:24.984525 9435 tablet_bootstrap.cc:492] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:24.987622 11380 leader_election.cc:290] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:24.991021 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39d0bab4179d4af68d2dbcd3e215873e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:24.992020 9427 tablet_bootstrap.cc:492] T be4393dc706f45a89b9b2c9727cd7726 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:24.992229 9427 ts_tablet_manager.cc:1403] T be4393dc706f45a89b9b2c9727cd7726 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.248s user 0.084s sys 0.098s
I20251215 14:55:24.993017 9427 raft_consensus.cc:359] T be4393dc706f45a89b9b2c9727cd7726 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.993276 9427 raft_consensus.cc:385] T be4393dc706f45a89b9b2c9727cd7726 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:24.993386 9427 raft_consensus.cc:740] T be4393dc706f45a89b9b2c9727cd7726 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:24.993659 9427 consensus_queue.cc:260] T be4393dc706f45a89b9b2c9727cd7726 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:24.994318 9427 ts_tablet_manager.cc:1434] T be4393dc706f45a89b9b2c9727cd7726 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:24.998008 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49bba2b78f65470182e1d361eb1272a4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:24.998190 9175 raft_consensus.cc:2468] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:24.999230 9435 tablet_bootstrap.cc:654] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:24.996537 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84477b0a4bd14522908cc28e7015e4f9" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:24.997028 9032 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a29174caad24ebc9d26b4169085dc08" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:25.000774 9029 raft_consensus.cc:2468] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:24.997277 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a71d029bbd88416da1dbcad09dc93115" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.001055 9024 raft_consensus.cc:2468] T a71d029bbd88416da1dbcad09dc93115 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:25.001935 9427 tablet_bootstrap.cc:492] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:25.002238 9314 consensus_meta.cc:287] T 3bd33107c2ed4b27841f3e1ece1df152 P e89303a500544272b601d7c29be802b4: Time spent flushing consensus metadata: real 0.733s user 0.017s sys 0.004s
I20251215 14:55:25.002399 9314 raft_consensus.cc:2468] T 3bd33107c2ed4b27841f3e1ece1df152 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:25.003643 9427 tablet_bootstrap.cc:654] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.012854 11038 consensus_queue.cc:1048] T 566fe9bb8a1849749087d840ef1c082d P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:25.013797 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a71d029bbd88416da1dbcad09dc93115" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:25.014004 9175 raft_consensus.cc:2468] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:25.016060 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fed3b34844e4e5b8518c0165df342d1" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:25.016352 9175 raft_consensus.cc:3060] T 0fed3b34844e4e5b8518c0165df342d1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.017452 9435 tablet_bootstrap.cc:492] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:25.017899 9435 ts_tablet_manager.cc:1403] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.003s
I20251215 14:55:25.019126 9175 raft_consensus.cc:2468] T 0fed3b34844e4e5b8518c0165df342d1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:25.020257 9435 raft_consensus.cc:359] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.020659 9435 raft_consensus.cc:385] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.020541 11098 raft_consensus.cc:493] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.020797 9435 raft_consensus.cc:740] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.021000 11098 raft_consensus.cc:515] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.021615 11098 leader_election.cc:290] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.021795 9435 consensus_queue.cc:260] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.025890 9435 ts_tablet_manager.cc:1434] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20251215 14:55:25.028170 9435 tablet_bootstrap.cc:492] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:25.036764 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84f036eb44a44e0597bc9af88d81a017" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:25.037082 9175 raft_consensus.cc:2468] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
W20251215 14:55:25.042451 9249 leader_election.cc:343] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:25.043144 9249 leader_election.cc:304] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:25.043459 11174 raft_consensus.cc:2804] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:25.043573 11174 raft_consensus.cc:493] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:25.043687 11174 raft_consensus.cc:3060] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.046324 11174 raft_consensus.cc:515] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.046911 11174 leader_election.cc:290] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.047899 11098 raft_consensus.cc:493] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.048079 11098 raft_consensus.cc:515] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.048614 11098 leader_election.cc:290] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:25.048940 9112 leader_election.cc:343] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:25.049176 9112 leader_election.cc:304] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:25.049712 9112 leader_election.cc:304] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:25.049898 11398 raft_consensus.cc:2804] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:25.050007 11398 raft_consensus.cc:493] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:25.050117 11398 raft_consensus.cc:3060] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.053193 11398 raft_consensus.cc:515] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.053822 11398 leader_election.cc:290] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.059973 9435 tablet_bootstrap.cc:654] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.062866 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "52e93348b205408f83efff27fde48e9b" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:25.063252 9314 raft_consensus.cc:2468] T 52e93348b205408f83efff27fde48e9b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:25.065790 9435 tablet_bootstrap.cc:492] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:25.065770 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84477b0a4bd14522908cc28e7015e4f9" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:25.065923 9435 ts_tablet_manager.cc:1403] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.001s
I20251215 14:55:25.065945 9029 raft_consensus.cc:3060] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.066515 11380 raft_consensus.cc:2804] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:25.066620 11380 raft_consensus.cc:493] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:25.066571 9435 raft_consensus.cc:359] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.066700 11380 raft_consensus.cc:3060] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.066715 9435 raft_consensus.cc:385] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.066761 9435 raft_consensus.cc:740] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.066995 9435 consensus_queue.cc:260] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.067471 9435 ts_tablet_manager.cc:1434] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20251215 14:55:25.067729 9435 tablet_bootstrap.cc:492] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:25.068440 9029 raft_consensus.cc:2468] T 84477b0a4bd14522908cc28e7015e4f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:25.074029 9435 tablet_bootstrap.cc:654] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.077381 11380 raft_consensus.cc:515] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.077668 11480 raft_consensus.cc:493] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.077836 11480 raft_consensus.cc:515] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.078850 11480 leader_election.cc:290] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.079361 9249 leader_election.cc:304] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:25.079663 9249 leader_election.cc:304] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:25.080243 11271 raft_consensus.cc:2804] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:25.080456 11473 raft_consensus.cc:2804] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:25.080513 11473 raft_consensus.cc:493] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:25.080569 11473 raft_consensus.cc:3060] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.082989 11473 raft_consensus.cc:515] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.084281 11473 leader_election.cc:290] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.084512 11271 raft_consensus.cc:697] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:25.084797 11271 consensus_queue.cc:237] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:25.089967 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 77811.6us
I20251215 14:55:25.090444 9248 leader_election.cc:304] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:25.091037 11038 consensus_queue.cc:1048] T 92ab40be35344612bdf65839e2637d6d P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:25.095888 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84f036eb44a44e0597bc9af88d81a017" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:25.103433 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82575517299b4e69a0871714dde9aacc" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:25.108256 9312 raft_consensus.cc:3060] T 82575517299b4e69a0871714dde9aacc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.110855 9312 raft_consensus.cc:2468] T 82575517299b4e69a0871714dde9aacc P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:25.104018 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be4393dc706f45a89b9b2c9727cd7726" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:25.104512 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d39e0db04f3c4bd3831c00b2b4825035" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:25.111539 9304 raft_consensus.cc:2393] T d39e0db04f3c4bd3831c00b2b4825035 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:25.106470 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a71d029bbd88416da1dbcad09dc93115" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:25.111999 9315 raft_consensus.cc:2393] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:25.112291 9303 raft_consensus.cc:2468] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:25.112915 9314 raft_consensus.cc:2393] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:25.113585 11174 raft_consensus.cc:2764] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20251215 14:55:25.115542 11473 consensus_queue.cc:1048] T 404cb1888ca2402ab7a41d0d5efeacd8 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:25.116724 11473 consensus_queue.cc:1048] T 0fb37d6a27554a44846e66c3ac2730f0 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:25.098033 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a71d029bbd88416da1dbcad09dc93115" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:25.098569 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6084ebf2a804bfc9d2c2cde3e0cba98" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:25.100485 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d20ffd43dce84ffe8c770053e5705cbd" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:25.101001 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84f036eb44a44e0597bc9af88d81a017" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:25.119714 9172 raft_consensus.cc:3060] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.122861 9172 raft_consensus.cc:2468] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:25.123656 9175 raft_consensus.cc:2468] T d20ffd43dce84ffe8c770053e5705cbd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:25.101768 9112 leader_election.cc:304] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:25.116207 9426 tablet_bootstrap.cc:492] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:25.124392 9426 ts_tablet_manager.cc:1403] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.206s user 0.017s sys 0.039s
I20251215 14:55:25.125150 9426 raft_consensus.cc:359] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.125371 9426 raft_consensus.cc:385] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.125445 9426 raft_consensus.cc:740] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.125676 9426 consensus_queue.cc:260] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.125965 11153 raft_consensus.cc:2804] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:25.126267 9426 ts_tablet_manager.cc:1434] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:25.126588 9426 tablet_bootstrap.cc:492] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:25.126545 11153 raft_consensus.cc:697] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:25.126915 11153 consensus_queue.cc:237] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.128403 9426 tablet_bootstrap.cc:654] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.130678 9180 raft_consensus.cc:2393] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:25.135573 11380 leader_election.cc:290] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.136751 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84477b0a4bd14522908cc28e7015e4f9" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:25.137372 9314 raft_consensus.cc:2468] T 84477b0a4bd14522908cc28e7015e4f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:25.145424 11166 consensus_queue.cc:1048] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:25.153204 9249 leader_election.cc:343] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:25.153475 9249 leader_election.cc:304] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:25.153750 9249 leader_election.cc:304] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:25.154232 11480 raft_consensus.cc:2804] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:25.154398 11480 raft_consensus.cc:697] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:25.154677 11480 consensus_queue.cc:237] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.142213 9426 tablet_bootstrap.cc:492] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:25.156664 9426 ts_tablet_manager.cc:1403] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.030s user 0.006s sys 0.002s
I20251215 14:55:25.157258 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a71d029bbd88416da1dbcad09dc93115" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:25.157431 9029 raft_consensus.cc:3060] T a71d029bbd88416da1dbcad09dc93115 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.157539 9426 raft_consensus.cc:359] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.157697 9426 raft_consensus.cc:385] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.157773 9426 raft_consensus.cc:740] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.158070 9426 consensus_queue.cc:260] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.158563 9426 ts_tablet_manager.cc:1434] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:25.158830 9426 tablet_bootstrap.cc:492] T 10cd2cbd7956444cb125d97310d2b102 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:25.160120 9029 raft_consensus.cc:2468] T a71d029bbd88416da1dbcad09dc93115 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:25.160398 9426 tablet_bootstrap.cc:654] T 10cd2cbd7956444cb125d97310d2b102 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:25.166330 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 47634.9us
I20251215 14:55:25.166723 9427 tablet_bootstrap.cc:492] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.166685 11473 consensus_queue.cc:1048] T cf6e4aa94f79403588dd1916226660fd P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:25.166898 9427 ts_tablet_manager.cc:1403] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.165s user 0.015s sys 0.032s
I20251215 14:55:25.167622 9427 raft_consensus.cc:359] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.167851 9427 raft_consensus.cc:385] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.167948 9427 raft_consensus.cc:740] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.168193 9427 consensus_queue.cc:260] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.168725 9427 ts_tablet_manager.cc:1434] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:25.169015 9427 tablet_bootstrap.cc:492] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:25.169785 9426 tablet_bootstrap.cc:492] T 10cd2cbd7956444cb125d97310d2b102 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:25.170006 9426 ts_tablet_manager.cc:1403] T 10cd2cbd7956444cb125d97310d2b102 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20251215 14:55:25.170815 9426 raft_consensus.cc:359] T 10cd2cbd7956444cb125d97310d2b102 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.171064 9426 raft_consensus.cc:385] T 10cd2cbd7956444cb125d97310d2b102 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.171208 9426 raft_consensus.cc:740] T 10cd2cbd7956444cb125d97310d2b102 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.171253 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a29174caad24ebc9d26b4169085dc08" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:25.171396 9303 raft_consensus.cc:3060] T 7a29174caad24ebc9d26b4169085dc08 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.171466 9426 consensus_queue.cc:260] T 10cd2cbd7956444cb125d97310d2b102 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.171902 9426 ts_tablet_manager.cc:1434] T 10cd2cbd7956444cb125d97310d2b102 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:25.172159 9426 tablet_bootstrap.cc:492] T 10890fcab7204cc7b7468402952f824c P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:25.173664 9426 tablet_bootstrap.cc:654] T 10890fcab7204cc7b7468402952f824c P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.174043 9303 raft_consensus.cc:2468] T 7a29174caad24ebc9d26b4169085dc08 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:25.175503 9112 leader_election.cc:304] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:25.175825 9427 tablet_bootstrap.cc:654] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.176016 11153 raft_consensus.cc:2804] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:25.176265 11153 raft_consensus.cc:697] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:25.176558 11153 consensus_queue.cc:237] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.176710 9435 tablet_bootstrap.cc:492] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:25.177114 9435 ts_tablet_manager.cc:1403] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.109s user 0.015s sys 0.017s
I20251215 14:55:25.177946 9427 tablet_bootstrap.cc:492] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.178059 9427 ts_tablet_manager.cc:1403] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20251215 14:55:25.178618 9427 raft_consensus.cc:359] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.178763 9427 raft_consensus.cc:385] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.178815 9427 raft_consensus.cc:740] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.178984 9427 consensus_queue.cc:260] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.179431 9427 ts_tablet_manager.cc:1434] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251215 14:55:25.179668 9427 tablet_bootstrap.cc:492] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:25.180752 9426 tablet_bootstrap.cc:492] T 10890fcab7204cc7b7468402952f824c P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:25.180896 9426 ts_tablet_manager.cc:1403] T 10890fcab7204cc7b7468402952f824c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251215 14:55:25.181107 9427 tablet_bootstrap.cc:654] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.181644 9426 raft_consensus.cc:359] T 10890fcab7204cc7b7468402952f824c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.181808 9426 raft_consensus.cc:385] T 10890fcab7204cc7b7468402952f824c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.181890 9426 raft_consensus.cc:740] T 10890fcab7204cc7b7468402952f824c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.182076 9426 consensus_queue.cc:260] T 10890fcab7204cc7b7468402952f824c P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.182585 9426 ts_tablet_manager.cc:1434] T 10890fcab7204cc7b7468402952f824c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:25.182845 9426 tablet_bootstrap.cc:492] T 39d0bab4179d4af68d2dbcd3e215873e P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:25.184518 9426 tablet_bootstrap.cc:654] T 39d0bab4179d4af68d2dbcd3e215873e P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.186523 8976 leader_election.cc:304] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:25.186842 11166 raft_consensus.cc:2804] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 14:55:25.186928 11166 raft_consensus.cc:493] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:25.186980 11166 raft_consensus.cc:3060] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:25.189608 11166 raft_consensus.cc:515] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:25.190474 11166 leader_election.cc:290] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:25.192672 9435 raft_consensus.cc:359] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.192884 9435 raft_consensus.cc:385] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.192931 9435 raft_consensus.cc:740] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.193132 9435 consensus_queue.cc:260] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.193437 11473 raft_consensus.cc:2804] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:25.193601 11473 raft_consensus.cc:493] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:25.193665 9435 ts_tablet_manager.cc:1434] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.016s user 0.000s sys 0.000s
I20251215 14:55:25.193830 11473 raft_consensus.cc:3060] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.194070 9435 tablet_bootstrap.cc:492] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:25.196472 9435 tablet_bootstrap.cc:654] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.197652 11473 raft_consensus.cc:515] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.198410 11473 leader_election.cc:290] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.200448 9426 tablet_bootstrap.cc:492] T 39d0bab4179d4af68d2dbcd3e215873e P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:25.200630 9426 ts_tablet_manager.cc:1403] T 39d0bab4179d4af68d2dbcd3e215873e P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.000s
I20251215 14:55:25.201431 9426 raft_consensus.cc:359] T 39d0bab4179d4af68d2dbcd3e215873e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.201637 9426 raft_consensus.cc:385] T 39d0bab4179d4af68d2dbcd3e215873e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.201714 9426 raft_consensus.cc:740] T 39d0bab4179d4af68d2dbcd3e215873e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.201934 9426 consensus_queue.cc:260] T 39d0bab4179d4af68d2dbcd3e215873e P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.202445 9426 ts_tablet_manager.cc:1434] T 39d0bab4179d4af68d2dbcd3e215873e P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:25.202742 9426 tablet_bootstrap.cc:492] T 4e1472ce5a464a12a711d513446abe2a P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:25.204509 9426 tablet_bootstrap.cc:654] T 4e1472ce5a464a12a711d513446abe2a P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.206532 9426 tablet_bootstrap.cc:492] T 4e1472ce5a464a12a711d513446abe2a P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:25.206676 9426 ts_tablet_manager.cc:1403] T 4e1472ce5a464a12a711d513446abe2a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20251215 14:55:25.207415 9426 raft_consensus.cc:359] T 4e1472ce5a464a12a711d513446abe2a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.207578 9426 raft_consensus.cc:385] T 4e1472ce5a464a12a711d513446abe2a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.207659 9426 raft_consensus.cc:740] T 4e1472ce5a464a12a711d513446abe2a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.207856 9426 consensus_queue.cc:260] T 4e1472ce5a464a12a711d513446abe2a P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.208113 10991 consensus_queue.cc:1048] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:25.208515 9426 ts_tablet_manager.cc:1434] T 4e1472ce5a464a12a711d513446abe2a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:25.208817 9426 tablet_bootstrap.cc:492] T 43e9cfdc89b04781b7b5892af07307af P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:25.210736 9426 tablet_bootstrap.cc:654] T 43e9cfdc89b04781b7b5892af07307af P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:25.211975 9248 leader_election.cc:343] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:25.212226 9248 leader_election.cc:304] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:25.212559 11098 raft_consensus.cc:2749] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:25.212812 9248 leader_election.cc:343] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:25.212935 9248 leader_election.cc:304] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
W20251215 14:55:25.213310 9248 leader_election.cc:343] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:25.213414 9248 leader_election.cc:304] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:25.213665 11484 raft_consensus.cc:2749] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:25.213893 11484 raft_consensus.cc:2749] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:25.214365 9435 tablet_bootstrap.cc:492] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:25.214641 9435 ts_tablet_manager.cc:1403] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.009s
I20251215 14:55:25.215984 9435 raft_consensus.cc:359] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.216351 9435 raft_consensus.cc:385] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.216542 9435 raft_consensus.cc:740] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.217206 9435 consensus_queue.cc:260] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.218299 9435 ts_tablet_manager.cc:1434] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:25.218797 9435 tablet_bootstrap.cc:492] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:25.220265 9426 tablet_bootstrap.cc:492] T 43e9cfdc89b04781b7b5892af07307af P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:25.220453 9426 ts_tablet_manager.cc:1403] T 43e9cfdc89b04781b7b5892af07307af P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20251215 14:55:25.221397 9426 raft_consensus.cc:359] T 43e9cfdc89b04781b7b5892af07307af P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.221647 9426 raft_consensus.cc:385] T 43e9cfdc89b04781b7b5892af07307af P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.221747 9426 raft_consensus.cc:740] T 43e9cfdc89b04781b7b5892af07307af P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.221714 9435 tablet_bootstrap.cc:654] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.222008 9426 consensus_queue.cc:260] T 43e9cfdc89b04781b7b5892af07307af P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.222568 9426 ts_tablet_manager.cc:1434] T 43e9cfdc89b04781b7b5892af07307af P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:25.222937 9426 tablet_bootstrap.cc:492] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:25.224721 9426 tablet_bootstrap.cc:654] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.225490 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d20ffd43dce84ffe8c770053e5705cbd" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:25.225760 9175 raft_consensus.cc:3060] T d20ffd43dce84ffe8c770053e5705cbd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:25.227203 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:25.228510 9175 raft_consensus.cc:2468] T d20ffd43dce84ffe8c770053e5705cbd P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:25.240877 9426 tablet_bootstrap.cc:492] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:25.241113 9426 ts_tablet_manager.cc:1403] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.001s
I20251215 14:55:25.242085 9426 raft_consensus.cc:359] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.242267 9426 raft_consensus.cc:385] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.242353 9426 raft_consensus.cc:740] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.242547 9426 consensus_queue.cc:260] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.243081 9426 ts_tablet_manager.cc:1434] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:25.243386 9426 tablet_bootstrap.cc:492] T 1dde4fcdf3104154936f70977e5378bd P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:25.245072 9426 tablet_bootstrap.cc:654] T 1dde4fcdf3104154936f70977e5378bd P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.246798 9426 tablet_bootstrap.cc:492] T 1dde4fcdf3104154936f70977e5378bd P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:25.246960 9426 ts_tablet_manager.cc:1403] T 1dde4fcdf3104154936f70977e5378bd P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20251215 14:55:25.247665 9426 raft_consensus.cc:359] T 1dde4fcdf3104154936f70977e5378bd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.247861 9426 raft_consensus.cc:385] T 1dde4fcdf3104154936f70977e5378bd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.247956 9426 raft_consensus.cc:740] T 1dde4fcdf3104154936f70977e5378bd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.248169 9426 consensus_queue.cc:260] T 1dde4fcdf3104154936f70977e5378bd P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.248637 9426 ts_tablet_manager.cc:1434] T 1dde4fcdf3104154936f70977e5378bd P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:25.248940 9426 tablet_bootstrap.cc:492] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:25.250481 9426 tablet_bootstrap.cc:654] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.251729 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84477b0a4bd14522908cc28e7015e4f9" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:25.251998 9303 raft_consensus.cc:3060] T 84477b0a4bd14522908cc28e7015e4f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.254662 9303 raft_consensus.cc:2468] T 84477b0a4bd14522908cc28e7015e4f9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:25.255400 11038 raft_consensus.cc:493] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.255585 11038 raft_consensus.cc:515] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.256198 11038 leader_election.cc:290] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.258261 9249 leader_election.cc:304] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:25.258653 11271 raft_consensus.cc:2804] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:25.258916 11271 raft_consensus.cc:697] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:25.259254 11271 consensus_queue.cc:237] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.261620 9426 tablet_bootstrap.cc:492] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:25.261772 9426 ts_tablet_manager.cc:1403] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.003s
I20251215 14:55:25.262537 9426 raft_consensus.cc:359] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.262722 9426 raft_consensus.cc:385] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.262805 9426 raft_consensus.cc:740] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.263016 9426 consensus_queue.cc:260] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.263581 9426 ts_tablet_manager.cc:1434] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:25.263978 9426 tablet_bootstrap.cc:492] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:25.265910 9426 tablet_bootstrap.cc:654] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.270756 11153 raft_consensus.cc:493] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.271050 11153 raft_consensus.cc:515] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.271837 11153 leader_election.cc:290] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.274519 9426 tablet_bootstrap.cc:492] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
W20251215 14:55:25.274510 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 11: this message will repeat every 5th retry.
I20251215 14:55:25.274706 9426 ts_tablet_manager.cc:1403] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.001s
I20251215 14:55:25.275393 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "02e391ec04cf44c881f31d0ba53af2e9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:25.275640 9426 raft_consensus.cc:359] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.275837 9426 raft_consensus.cc:385] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.275934 9426 raft_consensus.cc:740] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.276177 9426 consensus_queue.cc:260] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.276611 9426 ts_tablet_manager.cc:1434] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:25.285631 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5b0004e03d4c068419eb00ebadf3f9" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.291721 10991 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.291922 10991 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:55:25.292466 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 79174us
I20251215 14:55:25.292526 10991 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:25.294751 11480 raft_consensus.cc:493] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.295063 11480 raft_consensus.cc:515] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.296348 11480 leader_election.cc:290] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
W20251215 14:55:25.296924 9112 leader_election.cc:343] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:25.293658 9249 leader_election.cc:343] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:25.301714 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ea937af02b447e6a78cda0741cc8570" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:25.302870 9115 leader_election.cc:304] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:25.303508 11398 raft_consensus.cc:2804] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:25.303800 11398 raft_consensus.cc:493] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:25.304064 11398 raft_consensus.cc:3060] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.304764 9115 leader_election.cc:304] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:25.305157 11380 raft_consensus.cc:2804] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:25.305425 11380 raft_consensus.cc:697] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:25.305789 11380 consensus_queue.cc:237] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.308606 11398 raft_consensus.cc:515] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.309921 11398 leader_election.cc:290] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.315889 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "52e93348b205408f83efff27fde48e9b" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
W20251215 14:55:25.323608 9249 leader_election.cc:343] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:25.326318 11153 raft_consensus.cc:493] T 4e1472ce5a464a12a711d513446abe2a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.326566 11153 raft_consensus.cc:515] T 4e1472ce5a464a12a711d513446abe2a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.327275 11153 leader_election.cc:290] T 4e1472ce5a464a12a711d513446abe2a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.333977 9427 tablet_bootstrap.cc:492] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.334323 9427 ts_tablet_manager.cc:1403] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.155s user 0.008s sys 0.026s
I20251215 14:55:25.334841 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e1472ce5a464a12a711d513446abe2a" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.335608 9427 raft_consensus.cc:359] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.335904 9427 raft_consensus.cc:385] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.335994 9427 raft_consensus.cc:740] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.336323 9427 consensus_queue.cc:260] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.337883 9427 ts_tablet_manager.cc:1434] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:25.339021 9427 tablet_bootstrap.cc:492] T 7a29174caad24ebc9d26b4169085dc08 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:25.344820 9115 leader_election.cc:304] T d39e0db04f3c4bd3831c00b2b4825035 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:25.345265 11153 raft_consensus.cc:3060] T d39e0db04f3c4bd3831c00b2b4825035 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.345589 9115 leader_election.cc:304] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:25.345814 10991 raft_consensus.cc:2804] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:25.346261 10991 raft_consensus.cc:493] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:25.346357 10991 raft_consensus.cc:3060] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.346756 9427 tablet_bootstrap.cc:654] T 7a29174caad24ebc9d26b4169085dc08 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.349479 11153 raft_consensus.cc:2749] T d39e0db04f3c4bd3831c00b2b4825035 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:25.350412 10991 raft_consensus.cc:515] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.351012 10991 leader_election.cc:290] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.351871 9426 tablet_bootstrap.cc:492] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:25.353734 9426 tablet_bootstrap.cc:654] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.354630 9115 leader_election.cc:304] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:25.354898 10991 raft_consensus.cc:2749] T 84f036eb44a44e0597bc9af88d81a017 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:25.355456 9115 leader_election.cc:304] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:25.355760 10991 raft_consensus.cc:2804] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:25.355947 10991 raft_consensus.cc:697] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:25.356297 10991 consensus_queue.cc:237] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:25.358227 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:55:25.363468 11153 consensus_queue.cc:1048] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:25.364168 9112 leader_election.cc:343] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:25.366942 9426 tablet_bootstrap.cc:492] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:25.367197 9426 ts_tablet_manager.cc:1403] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.006s
I20251215 14:55:25.367511 9427 tablet_bootstrap.cc:492] T 7a29174caad24ebc9d26b4169085dc08 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.368240 9427 ts_tablet_manager.cc:1403] T 7a29174caad24ebc9d26b4169085dc08 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.007s
I20251215 14:55:25.368852 9426 raft_consensus.cc:359] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.370043 9426 raft_consensus.cc:385] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.370227 9426 raft_consensus.cc:740] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.370214 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be4393dc706f45a89b9b2c9727cd7726" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:25.370370 9024 raft_consensus.cc:3060] T be4393dc706f45a89b9b2c9727cd7726 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.370671 9435 tablet_bootstrap.cc:492] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:25.370632 9427 raft_consensus.cc:359] T 7a29174caad24ebc9d26b4169085dc08 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.370568 9426 consensus_queue.cc:260] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.370771 9427 raft_consensus.cc:385] T 7a29174caad24ebc9d26b4169085dc08 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.370815 9427 raft_consensus.cc:740] T 7a29174caad24ebc9d26b4169085dc08 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.370898 9435 ts_tablet_manager.cc:1403] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.152s user 0.040s sys 0.088s
I20251215 14:55:25.371528 9426 ts_tablet_manager.cc:1434] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20251215 14:55:25.371953 9426 tablet_bootstrap.cc:492] T 90c7925890474a76b35a3ce5e6db8ebf P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:25.372283 9435 raft_consensus.cc:359] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.372548 9435 raft_consensus.cc:385] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.372676 9435 raft_consensus.cc:740] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.372792 9024 raft_consensus.cc:2468] T be4393dc706f45a89b9b2c9727cd7726 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:25.373246 9435 consensus_queue.cc:260] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.374115 9435 ts_tablet_manager.cc:1434] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:25.374596 9435 tablet_bootstrap.cc:492] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:25.375370 9427 consensus_queue.cc:260] T 7a29174caad24ebc9d26b4169085dc08 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.376068 9427 ts_tablet_manager.cc:1434] T 7a29174caad24ebc9d26b4169085dc08 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20251215 14:55:25.376655 9427 tablet_bootstrap.cc:492] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:25.377071 9435 tablet_bootstrap.cc:654] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.378677 9427 tablet_bootstrap.cc:654] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.380601 9426 tablet_bootstrap.cc:654] T 90c7925890474a76b35a3ce5e6db8ebf P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.387557 9427 tablet_bootstrap.cc:492] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.388049 9427 ts_tablet_manager.cc:1403] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.001s
I20251215 14:55:25.389642 11271 raft_consensus.cc:493] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.389760 9427 raft_consensus.cc:359] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.389779 11271 raft_consensus.cc:515] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.389922 9427 raft_consensus.cc:385] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.389972 9427 raft_consensus.cc:740] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.390170 9427 consensus_queue.cc:260] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.390385 11271 leader_election.cc:290] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.390554 9427 ts_tablet_manager.cc:1434] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:25.390808 9427 tablet_bootstrap.cc:492] T 43e9cfdc89b04781b7b5892af07307af P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:25.392416 9427 tablet_bootstrap.cc:654] T 43e9cfdc89b04781b7b5892af07307af P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.396359 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5b0004e03d4c068419eb00ebadf3f9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:25.396555 9175 raft_consensus.cc:2468] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:25.397122 9249 leader_election.cc:304] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:25.397392 11271 raft_consensus.cc:2804] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:25.399211 11271 raft_consensus.cc:493] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:25.399336 9435 tablet_bootstrap.cc:492] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:25.399487 9435 ts_tablet_manager.cc:1403] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.010s
I20251215 14:55:25.399341 11271 raft_consensus.cc:3060] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.399909 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a71d029bbd88416da1dbcad09dc93115" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:25.400108 9315 raft_consensus.cc:2393] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:25.399916 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5b0004e03d4c068419eb00ebadf3f9" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:25.400341 9435 raft_consensus.cc:359] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.400494 9435 raft_consensus.cc:385] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.400583 9435 raft_consensus.cc:740] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.400763 9435 consensus_queue.cc:260] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.401252 9435 ts_tablet_manager.cc:1434] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:25.401391 9112 leader_election.cc:304] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:25.401517 9435 tablet_bootstrap.cc:492] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:25.402098 9427 tablet_bootstrap.cc:492] T 43e9cfdc89b04781b7b5892af07307af P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.402379 9427 ts_tablet_manager.cc:1403] T 43e9cfdc89b04781b7b5892af07307af P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20251215 14:55:25.402356 11271 raft_consensus.cc:515] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.402896 11271 leader_election.cc:290] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.402868 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49bba2b78f65470182e1d361eb1272a4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:25.403055 9303 raft_consensus.cc:2468] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:25.403123 9435 tablet_bootstrap.cc:654] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.404774 11153 raft_consensus.cc:2804] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:25.404649 9427 raft_consensus.cc:359] T 43e9cfdc89b04781b7b5892af07307af P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.404913 11153 raft_consensus.cc:697] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:25.404983 9427 raft_consensus.cc:385] T 43e9cfdc89b04781b7b5892af07307af P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.405071 9427 raft_consensus.cc:740] T 43e9cfdc89b04781b7b5892af07307af P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.405181 9312 raft_consensus.cc:2393] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:25.405174 11153 consensus_queue.cc:237] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.405565 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5b0004e03d4c068419eb00ebadf3f9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:25.405719 9175 raft_consensus.cc:3060] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.405469 9427 consensus_queue.cc:260] T 43e9cfdc89b04781b7b5892af07307af P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.407703 9427 ts_tablet_manager.cc:1434] T 43e9cfdc89b04781b7b5892af07307af P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:25.408351 9175 raft_consensus.cc:2468] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:25.409101 9427 tablet_bootstrap.cc:492] T cd025ffa766d45f8bc6c42c6eaa3418c P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:25.409554 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "52e93348b205408f83efff27fde48e9b" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:25.409722 9304 raft_consensus.cc:3060] T 52e93348b205408f83efff27fde48e9b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.410332 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4e1472ce5a464a12a711d513446abe2a" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:25.410537 9306 raft_consensus.cc:2393] T 4e1472ce5a464a12a711d513446abe2a P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:25.412184 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be4393dc706f45a89b9b2c9727cd7726" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:25.412400 9305 raft_consensus.cc:3060] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.413203 9249 leader_election.cc:304] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:25.414259 11098 raft_consensus.cc:2804] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:25.414625 11098 raft_consensus.cc:697] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:25.414955 11098 consensus_queue.cc:237] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.415300 11473 raft_consensus.cc:493] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.421571 11283 raft_consensus.cc:493] T 7a29174caad24ebc9d26b4169085dc08 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.421717 11283 raft_consensus.cc:515] T 7a29174caad24ebc9d26b4169085dc08 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.422290 11283 leader_election.cc:290] T 7a29174caad24ebc9d26b4169085dc08 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.427892 11153 raft_consensus.cc:493] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.428210 11153 raft_consensus.cc:515] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.429046 11153 leader_election.cc:290] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.429438 11473 raft_consensus.cc:515] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.430115 11473 leader_election.cc:290] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.430742 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9a4c7bd7d0984ef788fe2c0504058c37" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:25.431047 9427 tablet_bootstrap.cc:654] T cd025ffa766d45f8bc6c42c6eaa3418c P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.436137 9305 raft_consensus.cc:2468] T be4393dc706f45a89b9b2c9727cd7726 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:25.436501 9304 raft_consensus.cc:2468] T 52e93348b205408f83efff27fde48e9b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
W20251215 14:55:25.436690 9249 leader_election.cc:343] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:25.440074 9435 tablet_bootstrap.cc:492] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:25.441542 9435 ts_tablet_manager.cc:1403] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.011s
I20251215 14:55:25.442750 9435 raft_consensus.cc:359] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.444945 9435 raft_consensus.cc:385] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.445365 9435 raft_consensus.cc:740] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.445950 9435 consensus_queue.cc:260] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.446575 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a723f46302f34465a214714e98e47de7" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.447532 9435 ts_tablet_manager.cc:1434] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20251215 14:55:25.447836 9435 tablet_bootstrap.cc:492] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:25.448079 11398 consensus_queue.cc:1048] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:25.449470 9435 tablet_bootstrap.cc:654] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.459527 9309 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49bba2b78f65470182e1d361eb1272a4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:25.459771 9309 raft_consensus.cc:3060] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:25.463673 9309 raft_consensus.cc:2468] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 2.
I20251215 14:55:25.464438 11166 raft_consensus.cc:493] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.464614 11166 raft_consensus.cc:515] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.465319 11166 leader_election.cc:290] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.472975 11098 raft_consensus.cc:493] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.473208 11098 raft_consensus.cc:515] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.474502 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a723f46302f34465a214714e98e47de7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:25.474715 9180 raft_consensus.cc:2468] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:25.475363 9249 leader_election.cc:304] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:25.475661 11473 raft_consensus.cc:2804] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:25.475737 11098 leader_election.cc:290] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.475767 11473 raft_consensus.cc:493] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:25.475878 11473 raft_consensus.cc:3060] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.478706 11473 raft_consensus.cc:515] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.479616 11473 leader_election.cc:290] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.480105 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a723f46302f34465a214714e98e47de7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:25.480293 9180 raft_consensus.cc:3060] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.482782 9180 raft_consensus.cc:2468] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:25.483500 9249 leader_election.cc:304] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:25.483880 11473 raft_consensus.cc:2804] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:25.484033 11473 raft_consensus.cc:697] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:25.484339 11473 consensus_queue.cc:237] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:25.504433 9112 leader_election.cc:343] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:25.509512 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "49bba2b78f65470182e1d361eb1272a4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:25.509850 9180 raft_consensus.cc:3060] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:25.519671 9180 raft_consensus.cc:2468] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 2.
I20251215 14:55:25.534114 9309 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a29174caad24ebc9d26b4169085dc08" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:25.534466 9309 raft_consensus.cc:2393] T 7a29174caad24ebc9d26b4169085dc08 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:25.537799 11473 raft_consensus.cc:493] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.538107 11473 raft_consensus.cc:515] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.539335 11473 leader_election.cc:290] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.539660 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d064a85455844115899b3de91a2313f5" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:25.540380 9249 leader_election.cc:343] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:25.549651 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10890fcab7204cc7b7468402952f824c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:25.549871 9315 raft_consensus.cc:2468] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:25.550894 11398 raft_consensus.cc:493] T 10cd2cbd7956444cb125d97310d2b102 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.551132 11398 raft_consensus.cc:515] T 10cd2cbd7956444cb125d97310d2b102 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.552040 11398 leader_election.cc:290] T 10cd2cbd7956444cb125d97310d2b102 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.552434 9427 tablet_bootstrap.cc:492] T cd025ffa766d45f8bc6c42c6eaa3418c P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.552567 9427 ts_tablet_manager.cc:1403] T cd025ffa766d45f8bc6c42c6eaa3418c P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.144s user 0.014s sys 0.032s
I20251215 14:55:25.553373 9427 raft_consensus.cc:359] T cd025ffa766d45f8bc6c42c6eaa3418c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.553524 9427 raft_consensus.cc:385] T cd025ffa766d45f8bc6c42c6eaa3418c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.553570 9427 raft_consensus.cc:740] T cd025ffa766d45f8bc6c42c6eaa3418c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.553799 9427 consensus_queue.cc:260] T cd025ffa766d45f8bc6c42c6eaa3418c P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.554313 9427 ts_tablet_manager.cc:1434] T cd025ffa766d45f8bc6c42c6eaa3418c P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:25.554561 9427 tablet_bootstrap.cc:492] T d20ffd43dce84ffe8c770053e5705cbd P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:25.555523 9426 tablet_bootstrap.cc:492] T 90c7925890474a76b35a3ce5e6db8ebf P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:25.555919 9426 ts_tablet_manager.cc:1403] T 90c7925890474a76b35a3ce5e6db8ebf P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.184s user 0.034s sys 0.032s
I20251215 14:55:25.556178 9427 tablet_bootstrap.cc:654] T d20ffd43dce84ffe8c770053e5705cbd P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.556656 9426 raft_consensus.cc:359] T 90c7925890474a76b35a3ce5e6db8ebf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.556804 9426 raft_consensus.cc:385] T 90c7925890474a76b35a3ce5e6db8ebf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.556915 9426 raft_consensus.cc:740] T 90c7925890474a76b35a3ce5e6db8ebf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.557083 9426 consensus_queue.cc:260] T 90c7925890474a76b35a3ce5e6db8ebf P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.557546 9426 ts_tablet_manager.cc:1434] T 90c7925890474a76b35a3ce5e6db8ebf P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:25.557797 9426 tablet_bootstrap.cc:492] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:25.558231 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10cd2cbd7956444cb125d97310d2b102" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.558566 9029 raft_consensus.cc:2393] T 10cd2cbd7956444cb125d97310d2b102 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:25.559295 9426 tablet_bootstrap.cc:654] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.561004 9427 tablet_bootstrap.cc:492] T d20ffd43dce84ffe8c770053e5705cbd P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.561131 9427 ts_tablet_manager.cc:1403] T d20ffd43dce84ffe8c770053e5705cbd P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20251215 14:55:25.561803 9427 raft_consensus.cc:359] T d20ffd43dce84ffe8c770053e5705cbd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.561949 9427 raft_consensus.cc:385] T d20ffd43dce84ffe8c770053e5705cbd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.562001 9427 raft_consensus.cc:740] T d20ffd43dce84ffe8c770053e5705cbd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.562183 9427 consensus_queue.cc:260] T d20ffd43dce84ffe8c770053e5705cbd P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.562618 9427 ts_tablet_manager.cc:1434] T d20ffd43dce84ffe8c770053e5705cbd P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:25.562858 9427 tablet_bootstrap.cc:492] T 82575517299b4e69a0871714dde9aacc P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:25.564255 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a29174caad24ebc9d26b4169085dc08" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:25.566624 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet d45d6eebc703414fa9028faab9fc993c (table default.Table_fbefdfcff9c24a7387730593f0614c71 [id=3acc29dcf66b4841ba803cfb4eefeec3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d45d6eebc703414fa9028faab9fc993c consensus state has no leader
I20251215 14:55:25.567337 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f45f8b2fbf754d359deb666cb605c789" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.570669 9426 tablet_bootstrap.cc:492] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:25.570726 9427 tablet_bootstrap.cc:654] T 82575517299b4e69a0871714dde9aacc P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.570806 9426 ts_tablet_manager.cc:1403] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.006s
I20251215 14:55:25.571492 9426 raft_consensus.cc:359] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.571584 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10890fcab7204cc7b7468402952f824c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:25.571640 9426 raft_consensus.cc:385] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.571684 9426 raft_consensus.cc:740] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.571709 9172 raft_consensus.cc:2468] T 10890fcab7204cc7b7468402952f824c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:25.571856 9426 consensus_queue.cc:260] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.573468 9426 ts_tablet_manager.cc:1434] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20251215 14:55:25.573748 9426 tablet_bootstrap.cc:492] T 6d6e5f5227974610b686e23da5501f4a P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:25.574741 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a7a401d5386499183b6560411f593b6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:25.574990 9024 raft_consensus.cc:3060] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.576921 9426 tablet_bootstrap.cc:654] T 6d6e5f5227974610b686e23da5501f4a P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.575116 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "90c7925890474a76b35a3ce5e6db8ebf" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.578567 9024 raft_consensus.cc:2468] T 6a7a401d5386499183b6560411f593b6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:25.581245 11552 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.581396 11552 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.581949 11552 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:25.584187 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fed3b34844e4e5b8518c0165df342d1" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:25.583706 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:25.584465 9029 raft_consensus.cc:2468] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:25.584703 11283 raft_consensus.cc:493] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.584779 9427 tablet_bootstrap.cc:492] T 82575517299b4e69a0871714dde9aacc P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.584821 11283 raft_consensus.cc:515] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.584897 9427 ts_tablet_manager.cc:1403] T 82575517299b4e69a0871714dde9aacc P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.001s
I20251215 14:55:25.585181 9426 tablet_bootstrap.cc:492] T 6d6e5f5227974610b686e23da5501f4a P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:25.585294 9426 ts_tablet_manager.cc:1403] T 6d6e5f5227974610b686e23da5501f4a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.004s
I20251215 14:55:25.585382 11283 leader_election.cc:290] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.585633 9427 raft_consensus.cc:359] T 82575517299b4e69a0871714dde9aacc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.585772 9427 raft_consensus.cc:385] T 82575517299b4e69a0871714dde9aacc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.585814 9427 raft_consensus.cc:740] T 82575517299b4e69a0871714dde9aacc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.585887 9426 raft_consensus.cc:359] T 6d6e5f5227974610b686e23da5501f4a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.586419 11473 raft_consensus.cc:493] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.586550 11473 raft_consensus.cc:515] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.587105 11473 leader_election.cc:290] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.587545 9427 consensus_queue.cc:260] T 82575517299b4e69a0871714dde9aacc P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.588021 9427 ts_tablet_manager.cc:1434] T 82575517299b4e69a0871714dde9aacc P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:25.588279 9427 tablet_bootstrap.cc:492] T 2a5b0004e03d4c068419eb00ebadf3f9 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:25.589811 9427 tablet_bootstrap.cc:654] T 2a5b0004e03d4c068419eb00ebadf3f9 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.592272 11292 rpc_server.cc:307] RPC server started. Bound to: 127.8.121.190:44279
I20251215 14:55:25.592842 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bd1578d434047158b6fbce7c24daebb" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:25.586043 9426 raft_consensus.cc:385] T 6d6e5f5227974610b686e23da5501f4a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.594570 9426 raft_consensus.cc:740] T 6d6e5f5227974610b686e23da5501f4a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.594868 11292 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyVdQs_/test-tmp/master-stress-test.1.CatalogManagerConfigurations_MasterStressTest.Test_1.1765810497876655-8678-0/minicluster-data/master-0/data/info.pb
I20251215 14:55:25.594795 9426 consensus_queue.cc:260] T 6d6e5f5227974610b686e23da5501f4a P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
W20251215 14:55:25.594882 9249 leader_election.cc:343] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:25.595346 9426 ts_tablet_manager.cc:1434] T 6d6e5f5227974610b686e23da5501f4a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20251215 14:55:25.595644 9426 tablet_bootstrap.cc:492] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:25.596875 11562 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.8.121.190:44279 every 8 connection(s)
I20251215 14:55:25.597153 8678 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyVdQs_/build/asan/bin/kudu as pid 11292
I20251215 14:55:25.587587 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "265a8937802a4b9cbf0edaf3e2a41ba8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.598201 9024 raft_consensus.cc:2468] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:25.598757 9435 tablet_bootstrap.cc:492] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:25.598917 9435 ts_tablet_manager.cc:1403] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.151s user 0.011s sys 0.045s
I20251215 14:55:25.599694 9435 raft_consensus.cc:359] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.599857 9435 raft_consensus.cc:385] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.599912 9435 raft_consensus.cc:740] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.600107 9435 consensus_queue.cc:260] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.600528 9435 ts_tablet_manager.cc:1434] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:25.599666 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39d0bab4179d4af68d2dbcd3e215873e" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:25.600749 9029 raft_consensus.cc:3060] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.600808 9435 tablet_bootstrap.cc:492] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:25.602330 9435 tablet_bootstrap.cc:654] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.603615 9029 raft_consensus.cc:2468] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:25.605013 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fed3b34844e4e5b8518c0165df342d1" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:25.605363 9175 raft_consensus.cc:2393] T 0fed3b34844e4e5b8518c0165df342d1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:25.611332 9032 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fed3b34844e4e5b8518c0165df342d1" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:25.611506 9032 raft_consensus.cc:3060] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.612478 9427 tablet_bootstrap.cc:492] T 2a5b0004e03d4c068419eb00ebadf3f9 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.612622 9427 ts_tablet_manager.cc:1403] T 2a5b0004e03d4c068419eb00ebadf3f9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.005s
I20251215 14:55:25.613482 9427 raft_consensus.cc:359] T 2a5b0004e03d4c068419eb00ebadf3f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.613662 9427 raft_consensus.cc:385] T 2a5b0004e03d4c068419eb00ebadf3f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.613726 9427 raft_consensus.cc:740] T 2a5b0004e03d4c068419eb00ebadf3f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.613914 9427 consensus_queue.cc:260] T 2a5b0004e03d4c068419eb00ebadf3f9 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.614370 9032 raft_consensus.cc:2468] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:25.614471 9427 ts_tablet_manager.cc:1434] T 2a5b0004e03d4c068419eb00ebadf3f9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:25.614773 9427 tablet_bootstrap.cc:492] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:25.614953 11473 raft_consensus.cc:493] T 8eb90003cf02440e9752af134a3670b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.615089 11473 raft_consensus.cc:515] T 8eb90003cf02440e9752af134a3670b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.615633 11473 leader_election.cc:290] T 8eb90003cf02440e9752af134a3670b6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.616196 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8eb90003cf02440e9752af134a3670b6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:25.619760 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a71d029bbd88416da1dbcad09dc93115" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.620002 9024 raft_consensus.cc:2393] T a71d029bbd88416da1dbcad09dc93115 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
W20251215 14:55:25.620391 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:25.621026 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a723f46302f34465a214714e98e47de7" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:25.623622 9032 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84f036eb44a44e0597bc9af88d81a017" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.628029 9032 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a71d029bbd88416da1dbcad09dc93115" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:25.628123 11563 sys_catalog.cc:263] Verifying existing consensus state
I20251215 14:55:25.628403 9032 raft_consensus.cc:2393] T a71d029bbd88416da1dbcad09dc93115 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:25.629724 9032 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6084ebf2a804bfc9d2c2cde3e0cba98" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.632203 9427 tablet_bootstrap.cc:654] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.634570 9032 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d20ffd43dce84ffe8c770053e5705cbd" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.634802 9032 raft_consensus.cc:2468] T d20ffd43dce84ffe8c770053e5705cbd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:25.635537 9032 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84f036eb44a44e0597bc9af88d81a017" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:25.642277 9427 tablet_bootstrap.cc:492] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.642248 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d20ffd43dce84ffe8c770053e5705cbd" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:25.642472 9427 ts_tablet_manager.cc:1403] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.028s user 0.005s sys 0.000s
I20251215 14:55:25.642484 9028 raft_consensus.cc:3060] T d20ffd43dce84ffe8c770053e5705cbd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.643401 9427 raft_consensus.cc:359] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.643590 9427 raft_consensus.cc:385] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.643657 9427 raft_consensus.cc:740] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.643893 9427 consensus_queue.cc:260] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.644455 9427 ts_tablet_manager.cc:1434] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:25.644763 9427 tablet_bootstrap.cc:492] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:25.645054 9304 raft_consensus.cc:3060] T 8eb90003cf02440e9752af134a3670b6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.645259 9028 raft_consensus.cc:2468] T d20ffd43dce84ffe8c770053e5705cbd P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:25.646850 9427 tablet_bootstrap.cc:654] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.649647 11563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Bootstrap starting.
I20251215 14:55:25.651248 9427 tablet_bootstrap.cc:492] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.651382 9427 ts_tablet_manager.cc:1403] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.001s
I20251215 14:55:25.652170 9427 raft_consensus.cc:359] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.652659 9427 raft_consensus.cc:385] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.652725 9427 raft_consensus.cc:740] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.652915 9427 consensus_queue.cc:260] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.653422 9427 ts_tablet_manager.cc:1434] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:25.653751 9427 tablet_bootstrap.cc:492] T 84f036eb44a44e0597bc9af88d81a017 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:25.655504 9427 tablet_bootstrap.cc:654] T 84f036eb44a44e0597bc9af88d81a017 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.665759 9088 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:25.670953 8976 leader_election.cc:304] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:25.671239 11165 raft_consensus.cc:2804] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 14:55:25.671341 11165 raft_consensus.cc:697] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:25.671547 11165 consensus_queue.cc:237] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:25.672614 9427 tablet_bootstrap.cc:492] T 84f036eb44a44e0597bc9af88d81a017 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.672748 9427 ts_tablet_manager.cc:1403] T 84f036eb44a44e0597bc9af88d81a017 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20251215 14:55:25.673985 9427 raft_consensus.cc:359] T 84f036eb44a44e0597bc9af88d81a017 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.674147 9427 raft_consensus.cc:385] T 84f036eb44a44e0597bc9af88d81a017 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.674201 9427 raft_consensus.cc:740] T 84f036eb44a44e0597bc9af88d81a017 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.674396 9427 consensus_queue.cc:260] T 84f036eb44a44e0597bc9af88d81a017 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.674862 9427 ts_tablet_manager.cc:1434] T 84f036eb44a44e0597bc9af88d81a017 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:25.675132 9427 tablet_bootstrap.cc:492] T 1dde4fcdf3104154936f70977e5378bd P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:25.676872 9427 tablet_bootstrap.cc:654] T 1dde4fcdf3104154936f70977e5378bd P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.678686 9427 tablet_bootstrap.cc:492] T 1dde4fcdf3104154936f70977e5378bd P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.678813 9427 ts_tablet_manager.cc:1403] T 1dde4fcdf3104154936f70977e5378bd P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20251215 14:55:25.679591 9427 raft_consensus.cc:359] T 1dde4fcdf3104154936f70977e5378bd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.679751 9427 raft_consensus.cc:385] T 1dde4fcdf3104154936f70977e5378bd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.679801 9427 raft_consensus.cc:740] T 1dde4fcdf3104154936f70977e5378bd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.680007 9427 consensus_queue.cc:260] T 1dde4fcdf3104154936f70977e5378bd P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.680490 9427 ts_tablet_manager.cc:1434] T 1dde4fcdf3104154936f70977e5378bd P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:25.680855 9427 tablet_bootstrap.cc:492] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:25.682454 9427 tablet_bootstrap.cc:654] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.688594 9226 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:25.702708 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "02e391ec04cf44c881f31d0ba53af2e9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.704062 11473 raft_consensus.cc:493] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.705004 11098 raft_consensus.cc:493] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.704288 11473 raft_consensus.cc:515] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.705109 11098 raft_consensus.cc:515] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.705603 11098 leader_election.cc:290] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.705686 11473 leader_election.cc:290] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.706583 11473 consensus_queue.cc:1048] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:25.706768 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "809257b3929a4c2f91132f9315752130" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:25.706945 9172 raft_consensus.cc:2468] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:25.707329 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43e9cfdc89b04781b7b5892af07307af" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:25.707473 9180 raft_consensus.cc:2468] T 43e9cfdc89b04781b7b5892af07307af P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:25.708091 9249 leader_election.cc:304] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:25.708344 9249 leader_election.cc:304] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:25.708580 11480 raft_consensus.cc:2804] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251215 14:55:25.708647 11480 raft_consensus.cc:493] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:25.708695 11098 raft_consensus.cc:2804] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:25.708756 11098 raft_consensus.cc:493] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:25.708806 11098 raft_consensus.cc:3060] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.708707 11480 raft_consensus.cc:3060] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:25.711890 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10cd2cbd7956444cb125d97310d2b102" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:25.713662 11480 raft_consensus.cc:515] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.714228 11480 leader_election.cc:290] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.715250 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "809257b3929a4c2f91132f9315752130" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:25.715428 9172 raft_consensus.cc:3060] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:25.716712 11098 raft_consensus.cc:515] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.717227 11098 leader_election.cc:290] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.717821 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43e9cfdc89b04781b7b5892af07307af" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:25.717917 9172 raft_consensus.cc:2468] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 2.
I20251215 14:55:25.717964 9170 raft_consensus.cc:3060] T 43e9cfdc89b04781b7b5892af07307af P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.720307 9170 raft_consensus.cc:2468] T 43e9cfdc89b04781b7b5892af07307af P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:25.720546 9226 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:25.721176 9249 leader_election.cc:304] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:25.721535 9249 leader_election.cc:304] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:25.721792 11271 raft_consensus.cc:2804] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 2 FOLLOWER]: Leader election won for term 2
I20251215 14:55:25.721899 11271 raft_consensus.cc:697] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [term 2 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:25.721935 11480 raft_consensus.cc:2804] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:25.722024 11480 raft_consensus.cc:697] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:25.722114 11271 consensus_queue.cc:237] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.722172 11480 consensus_queue.cc:237] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.732370 11283 raft_consensus.cc:493] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.732590 11283 raft_consensus.cc:515] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.733507 11283 leader_election.cc:290] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.739832 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ea937af02b447e6a78cda0741cc8570" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.778230 11398 raft_consensus.cc:493] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.778393 11398 raft_consensus.cc:515] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.778975 11398 leader_election.cc:290] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.804529 11271 raft_consensus.cc:493] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.804859 11271 raft_consensus.cc:515] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.806036 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e5c1626a30444bf987a7d7e09a586f7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:25.806610 9249 leader_election.cc:343] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:25.807046 11271 leader_election.cc:290] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.807679 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6084ebf2a804bfc9d2c2cde3e0cba98" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.808895 11589 raft_consensus.cc:493] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251215 14:55:25.808892 9112 leader_election.cc:343] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:25.809016 11589 raft_consensus.cc:515] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.809643 11589 leader_election.cc:290] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.814221 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5b0004e03d4c068419eb00ebadf3f9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.814575 9027 raft_consensus.cc:2468] T 2a5b0004e03d4c068419eb00ebadf3f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:25.816771 9435 tablet_bootstrap.cc:492] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:25.816927 9435 ts_tablet_manager.cc:1403] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.216s user 0.014s sys 0.016s
I20251215 14:55:25.818499 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9a4c7bd7d0984ef788fe2c0504058c37" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.818904 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a5b0004e03d4c068419eb00ebadf3f9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:25.819103 9024 raft_consensus.cc:3060] T 2a5b0004e03d4c068419eb00ebadf3f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.821523 11380 raft_consensus.cc:493] T 39d0bab4179d4af68d2dbcd3e215873e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.821660 11380 raft_consensus.cc:515] T 39d0bab4179d4af68d2dbcd3e215873e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.822376 11380 leader_election.cc:290] T 39d0bab4179d4af68d2dbcd3e215873e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.825165 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39d0bab4179d4af68d2dbcd3e215873e" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.825369 9028 raft_consensus.cc:2393] T 39d0bab4179d4af68d2dbcd3e215873e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:25.826514 11380 consensus_queue.cc:1048] T 022c9c0d19ac450cb270319004886fe2 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:25.827977 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:55:25.828331 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a723f46302f34465a214714e98e47de7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.828531 9027 raft_consensus.cc:2468] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
W20251215 14:55:25.829149 8976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 67396.4us
I20251215 14:55:25.830143 8976 leader_election.cc:304] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:25.830824 11591 raft_consensus.cc:2804] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:25.830902 11591 raft_consensus.cc:493] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:25.830879 9115 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:25.830961 11591 raft_consensus.cc:3060] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.831084 11380 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:25.831811 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a723f46302f34465a214714e98e47de7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:25.831971 9027 raft_consensus.cc:3060] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.833864 11591 raft_consensus.cc:515] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.834453 11591 leader_election.cc:290] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.834908 9027 raft_consensus.cc:2468] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:25.835542 9115 leader_election.cc:304] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:25.835819 11380 raft_consensus.cc:2749] T 2a5b0004e03d4c068419eb00ebadf3f9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:25.841216 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d064a85455844115899b3de91a2313f5" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.844563 9115 leader_election.cc:304] T 4e1472ce5a464a12a711d513446abe2a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:25.844848 11271 raft_consensus.cc:493] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.844992 11271 raft_consensus.cc:515] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.845520 11271 leader_election.cc:290] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.847404 11038 consensus_queue.cc:1048] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:25.850085 9170 raft_consensus.cc:3060] T d45d6eebc703414fa9028faab9fc993c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.853242 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dde4fcdf3104154936f70977e5378bd" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:25.853534 9175 raft_consensus.cc:2468] T 1dde4fcdf3104154936f70977e5378bd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:25.854187 9249 leader_election.cc:304] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:25.854396 11271 raft_consensus.cc:2804] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:25.854503 11271 raft_consensus.cc:493] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:25.854619 11271 raft_consensus.cc:3060] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.855801 9180 raft_consensus.cc:3060] T 10cd2cbd7956444cb125d97310d2b102 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.858949 11271 raft_consensus.cc:515] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.859630 11271 leader_election.cc:290] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.859987 9435 raft_consensus.cc:359] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.860226 9435 raft_consensus.cc:385] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.860309 9435 raft_consensus.cc:740] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.860558 9435 consensus_queue.cc:260] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.861105 9024 raft_consensus.cc:2468] T 2a5b0004e03d4c068419eb00ebadf3f9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:25.861188 9435 ts_tablet_manager.cc:1434] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.044s user 0.001s sys 0.001s
I20251215 14:55:25.861470 9435 tablet_bootstrap.cc:492] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:25.863137 9435 tablet_bootstrap.cc:654] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.868081 11166 consensus_queue.cc:1048] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:25.870956 11380 raft_consensus.cc:3060] T 4e1472ce5a464a12a711d513446abe2a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.873801 11380 raft_consensus.cc:2749] T 4e1472ce5a464a12a711d513446abe2a P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:25.879257 11552 raft_consensus.cc:493] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.879402 11552 raft_consensus.cc:515] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.879956 11552 leader_election.cc:290] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.880162 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dde4fcdf3104154936f70977e5378bd" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:25.880306 9175 raft_consensus.cc:3060] T 1dde4fcdf3104154936f70977e5378bd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.882699 9175 raft_consensus.cc:2468] T 1dde4fcdf3104154936f70977e5378bd P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:25.884626 9426 tablet_bootstrap.cc:654] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.886492 9249 leader_election.cc:304] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:25.887073 11480 raft_consensus.cc:2804] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:25.887207 11480 raft_consensus.cc:697] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
W20251215 14:55:25.887461 8975 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.8.121.190:44279, user_credentials={real_user=slave}} blocked reactor thread for 46578.4us
I20251215 14:55:25.887434 11480 consensus_queue.cc:237] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.892757 11380 consensus_queue.cc:1048] T 3bd33107c2ed4b27841f3e1ece1df152 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:25.899621 11166 consensus_queue.cc:1048] T 66249f9be0334affb4f4b0e7dd9212ea P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:25.900933 9115 leader_election.cc:304] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:25.901292 11380 raft_consensus.cc:2804] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:25.901871 11380 raft_consensus.cc:697] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:25.902354 9427 tablet_bootstrap.cc:492] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.902238 11380 consensus_queue.cc:237] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.902527 9427 ts_tablet_manager.cc:1403] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.222s user 0.023s sys 0.075s
I20251215 14:55:25.903271 9427 raft_consensus.cc:359] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.903462 9427 raft_consensus.cc:385] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.903537 9427 raft_consensus.cc:740] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.903762 9427 consensus_queue.cc:260] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.904247 9427 ts_tablet_manager.cc:1434] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:25.904532 9427 tablet_bootstrap.cc:492] T f45f8b2fbf754d359deb666cb605c789 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:25.906121 9427 tablet_bootstrap.cc:654] T f45f8b2fbf754d359deb666cb605c789 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.907927 11590 raft_consensus.cc:493] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.908175 11590 raft_consensus.cc:515] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.909268 11590 leader_election.cc:290] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:25.921427 9427 tablet_bootstrap.cc:492] T f45f8b2fbf754d359deb666cb605c789 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.921588 9427 ts_tablet_manager.cc:1403] T f45f8b2fbf754d359deb666cb605c789 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.002s
I20251215 14:55:25.922739 9427 raft_consensus.cc:359] T f45f8b2fbf754d359deb666cb605c789 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.922919 9427 raft_consensus.cc:385] T f45f8b2fbf754d359deb666cb605c789 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.923009 9427 raft_consensus.cc:740] T f45f8b2fbf754d359deb666cb605c789 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.923234 9427 consensus_queue.cc:260] T f45f8b2fbf754d359deb666cb605c789 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.923707 9427 ts_tablet_manager.cc:1434] T f45f8b2fbf754d359deb666cb605c789 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:25.929507 11563 log.cc:826] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Log is configured to *not* fsync() on all Append() calls
I20251215 14:55:25.931020 9435 tablet_bootstrap.cc:492] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:25.931823 9435 ts_tablet_manager.cc:1403] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.070s user 0.009s sys 0.004s
I20251215 14:55:25.932714 11166 consensus_queue.cc:1048] T d39e0db04f3c4bd3831c00b2b4825035 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:25.934172 9427 tablet_bootstrap.cc:492] T 52e93348b205408f83efff27fde48e9b P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:25.935838 9427 tablet_bootstrap.cc:654] T 52e93348b205408f83efff27fde48e9b P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.937714 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bd1578d434047158b6fbce7c24daebb" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.939345 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8eb90003cf02440e9752af134a3670b6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.940040 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43e9cfdc89b04781b7b5892af07307af" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.940282 9027 raft_consensus.cc:2468] T 43e9cfdc89b04781b7b5892af07307af P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:25.940740 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "809257b3929a4c2f91132f9315752130" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:25.940963 9027 raft_consensus.cc:3060] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Advancing to term 2
I20251215 14:55:25.943717 9027 raft_consensus.cc:2468] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 2.
I20251215 14:55:25.945938 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e5c1626a30444bf987a7d7e09a586f7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.946384 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43e9cfdc89b04781b7b5892af07307af" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:25.946635 9027 raft_consensus.cc:3060] T 43e9cfdc89b04781b7b5892af07307af P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.947393 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "809257b3929a4c2f91132f9315752130" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.947624 9024 raft_consensus.cc:2376] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e89303a500544272b601d7c29be802b4 in term 2. Re-sending same reply.
I20251215 14:55:25.945410 9435 raft_consensus.cc:359] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.949414 9435 raft_consensus.cc:385] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.949839 9435 raft_consensus.cc:740] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.950328 9027 raft_consensus.cc:2468] T 43e9cfdc89b04781b7b5892af07307af P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:25.951421 9435 consensus_queue.cc:260] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.952767 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dde4fcdf3104154936f70977e5378bd" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:25.953042 9024 raft_consensus.cc:2468] T 1dde4fcdf3104154936f70977e5378bd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:25.954054 9427 tablet_bootstrap.cc:492] T 52e93348b205408f83efff27fde48e9b P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:25.954684 9427 ts_tablet_manager.cc:1403] T 52e93348b205408f83efff27fde48e9b P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.009s
I20251215 14:55:25.955488 9427 raft_consensus.cc:359] T 52e93348b205408f83efff27fde48e9b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.955689 9427 raft_consensus.cc:385] T 52e93348b205408f83efff27fde48e9b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.955770 9427 raft_consensus.cc:740] T 52e93348b205408f83efff27fde48e9b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.955997 9427 consensus_queue.cc:260] T 52e93348b205408f83efff27fde48e9b P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:25.956079 8978 leader_election.cc:304] T 7a29174caad24ebc9d26b4169085dc08 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:25.956429 11588 raft_consensus.cc:3060] T 7a29174caad24ebc9d26b4169085dc08 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.960475 11588 raft_consensus.cc:2749] T 7a29174caad24ebc9d26b4169085dc08 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:25.964644 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dde4fcdf3104154936f70977e5378bd" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:25.964855 9025 raft_consensus.cc:3060] T 1dde4fcdf3104154936f70977e5378bd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:25.967703 9025 raft_consensus.cc:2468] T 1dde4fcdf3104154936f70977e5378bd P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:25.975303 11271 raft_consensus.cc:493] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:25.975441 11271 raft_consensus.cc:515] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.975664 9435 ts_tablet_manager.cc:1434] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.044s user 0.002s sys 0.000s
I20251215 14:55:25.975942 11271 leader_election.cc:290] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:25.975944 9435 tablet_bootstrap.cc:492] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:25.977504 9435 tablet_bootstrap.cc:654] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:25.986948 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fed3b34844e4e5b8518c0165df342d1" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:25.988297 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "809257b3929a4c2f91132f9315752130" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:25.989599 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a723f46302f34465a214714e98e47de7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:25.994284 9435 tablet_bootstrap.cc:492] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:25.994594 9435 ts_tablet_manager.cc:1403] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.003s
I20251215 14:55:25.996311 9435 raft_consensus.cc:359] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.996661 9435 raft_consensus.cc:385] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:25.996783 9435 raft_consensus.cc:740] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:25.997184 9435 consensus_queue.cc:260] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:25.999341 9435 ts_tablet_manager.cc:1434] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20251215 14:55:26.000427 9435 tablet_bootstrap.cc:492] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:26.004158 9427 ts_tablet_manager.cc:1434] T 52e93348b205408f83efff27fde48e9b P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.049s user 0.019s sys 0.003s
I20251215 14:55:26.004442 9427 tablet_bootstrap.cc:492] T 2b686ad43973448c8e24230d7d1d7250 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:26.005720 9248 leader_election.cc:343] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.005793 9427 tablet_bootstrap.cc:654] T 2b686ad43973448c8e24230d7d1d7250 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.005947 9248 leader_election.cc:304] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.006225 11271 raft_consensus.cc:2749] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.007632 9115 leader_election.cc:304] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
W20251215 14:55:26.007812 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:55:26.007771 9435 tablet_bootstrap.cc:654] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.007916 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.013173 11271 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 14:55:26.024595 11552 raft_consensus.cc:2749] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:26.025063 9115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 113476us
I20251215 14:55:26.025415 9435 tablet_bootstrap.cc:492] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:26.025815 9435 ts_tablet_manager.cc:1403] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.026s user 0.005s sys 0.002s
I20251215 14:55:26.026134 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6d6e5f5227974610b686e23da5501f4a" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.026329 9175 raft_consensus.cc:2468] T 6d6e5f5227974610b686e23da5501f4a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:26.037329 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "265a8937802a4b9cbf0edaf3e2a41ba8" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.037618 9024 raft_consensus.cc:2468] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:26.060878 9426 tablet_bootstrap.cc:492] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:26.061142 9426 ts_tablet_manager.cc:1403] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.466s user 0.014s sys 0.015s
I20251215 14:55:26.061956 9426 raft_consensus.cc:359] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.062216 9426 raft_consensus.cc:385] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.062326 9426 raft_consensus.cc:740] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.062582 9426 consensus_queue.cc:260] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.063060 9426 ts_tablet_manager.cc:1434] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:26.063392 10991 consensus_queue.cc:1048] T 8eb90003cf02440e9752af134a3670b6 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.064940 9427 tablet_bootstrap.cc:492] T 2b686ad43973448c8e24230d7d1d7250 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.065083 9427 ts_tablet_manager.cc:1403] T 2b686ad43973448c8e24230d7d1d7250 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.061s user 0.019s sys 0.011s
I20251215 14:55:26.065536 9115 leader_election.cc:304] T 10cd2cbd7956444cb125d97310d2b102 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:26.065742 9427 raft_consensus.cc:359] T 2b686ad43973448c8e24230d7d1d7250 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.065918 9427 raft_consensus.cc:385] T 2b686ad43973448c8e24230d7d1d7250 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.065971 9427 raft_consensus.cc:740] T 2b686ad43973448c8e24230d7d1d7250 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.066157 9427 consensus_queue.cc:260] T 2b686ad43973448c8e24230d7d1d7250 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.066776 9427 ts_tablet_manager.cc:1434] T 2b686ad43973448c8e24230d7d1d7250 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:26.067040 9427 tablet_bootstrap.cc:492] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.069069 9435 raft_consensus.cc:359] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.069265 9435 raft_consensus.cc:385] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.069321 9435 raft_consensus.cc:740] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.069406 9249 leader_election.cc:304] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:26.069514 9435 consensus_queue.cc:260] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.070636 11480 raft_consensus.cc:2804] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.070720 11480 raft_consensus.cc:493] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.070780 11480 raft_consensus.cc:3060] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.073647 11480 raft_consensus.cc:515] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.074218 11480 leader_election.cc:290] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.075513 9427 tablet_bootstrap.cc:654] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.063392 9426 tablet_bootstrap.cc:492] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:26.077564 9435 ts_tablet_manager.cc:1434] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.051s user 0.003s sys 0.003s
I20251215 14:55:26.077673 9426 tablet_bootstrap.cc:654] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.078251 9435 tablet_bootstrap.cc:492] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:26.079021 9427 tablet_bootstrap.cc:492] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.079147 9427 ts_tablet_manager.cc:1403] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20251215 14:55:26.079805 9427 raft_consensus.cc:359] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.079968 9427 raft_consensus.cc:385] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.080017 9427 raft_consensus.cc:740] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.080173 9427 consensus_queue.cc:260] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.080613 9427 ts_tablet_manager.cc:1434] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:26.080859 9427 tablet_bootstrap.cc:492] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.082607 9427 tablet_bootstrap.cc:654] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:26.083374 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:26.083745 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:26.084194 11398 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.086684 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6084ebf2a804bfc9d2c2cde3e0cba98" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.086872 9304 raft_consensus.cc:2468] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:26.089124 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "39d0bab4179d4af68d2dbcd3e215873e" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
W20251215 14:55:26.089188 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:26.089298 9304 raft_consensus.cc:2393] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:26.092962 11380 raft_consensus.cc:2749] T 10cd2cbd7956444cb125d97310d2b102 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.096954 9435 tablet_bootstrap.cc:654] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.098284 9427 tablet_bootstrap.cc:492] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.098410 9427 ts_tablet_manager.cc:1403] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.002s
I20251215 14:55:26.099064 9427 raft_consensus.cc:359] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.099215 11380 raft_consensus.cc:493] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.099246 9427 raft_consensus.cc:385] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.099584 9427 raft_consensus.cc:740] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.099788 9427 consensus_queue.cc:260] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.100255 9427 ts_tablet_manager.cc:1434] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:26.099514 11380 raft_consensus.cc:515] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.100494 9427 tablet_bootstrap.cc:492] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.101922 9427 tablet_bootstrap.cc:654] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.102512 11380 leader_election.cc:290] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.105827 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "265a8937802a4b9cbf0edaf3e2a41ba8" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.105995 9303 raft_consensus.cc:2468] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
W20251215 14:55:26.118016 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 91245.3us
W20251215 14:55:26.118337 9248 leader_election.cc:343] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.133457 9435 tablet_bootstrap.cc:492] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:26.134915 9248 leader_election.cc:304] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.135134 9435 ts_tablet_manager.cc:1403] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.057s user 0.005s sys 0.001s
I20251215 14:55:26.135558 11271 raft_consensus.cc:2749] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.138733 11608 raft_consensus.cc:493] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.138978 11608 raft_consensus.cc:515] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.139950 11608 leader_election.cc:290] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:26.150429 11380 raft_consensus.cc:493] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.150640 11380 raft_consensus.cc:515] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.151350 11380 leader_election.cc:290] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.151639 9427 tablet_bootstrap.cc:492] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.151775 9427 ts_tablet_manager.cc:1403] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.051s user 0.010s sys 0.013s
I20251215 14:55:26.152426 9427 raft_consensus.cc:359] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.152582 9427 raft_consensus.cc:385] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.152635 9427 raft_consensus.cc:740] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.152830 9427 consensus_queue.cc:260] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.153298 9427 ts_tablet_manager.cc:1434] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:26.153577 9427 tablet_bootstrap.cc:492] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.154474 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd025ffa766d45f8bc6c42c6eaa3418c" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.154631 9025 raft_consensus.cc:2468] T cd025ffa766d45f8bc6c42c6eaa3418c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:26.155076 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f45f8b2fbf754d359deb666cb605c789" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.155226 9427 tablet_bootstrap.cc:654] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.155246 9025 raft_consensus.cc:2468] T f45f8b2fbf754d359deb666cb605c789 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:26.156476 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86f18ff40af547da85de8966b12f76f4" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.156634 9025 raft_consensus.cc:2468] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:26.158203 9435 raft_consensus.cc:359] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.158360 9435 raft_consensus.cc:385] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.158406 9435 raft_consensus.cc:740] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.158563 9435 consensus_queue.cc:260] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.159037 9435 ts_tablet_manager.cc:1434] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.024s user 0.000s sys 0.002s
I20251215 14:55:26.159313 9435 tablet_bootstrap.cc:492] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:26.160948 9435 tablet_bootstrap.cc:654] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.170753 9427 tablet_bootstrap.cc:492] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.170897 9427 ts_tablet_manager.cc:1403] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.004s
I20251215 14:55:26.171618 9427 raft_consensus.cc:359] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.172099 9427 raft_consensus.cc:385] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.172151 9427 raft_consensus.cc:740] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.172314 9427 consensus_queue.cc:260] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.172766 9427 ts_tablet_manager.cc:1434] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:26.173017 9427 tablet_bootstrap.cc:492] T 96a1de7ce5f64f348585926ac05ddb87 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.174423 11166 raft_consensus.cc:493] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.174544 9427 tablet_bootstrap.cc:654] T 96a1de7ce5f64f348585926ac05ddb87 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.174546 11166 raft_consensus.cc:515] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.175107 11166 leader_election.cc:290] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:26.176661 9435 tablet_bootstrap.cc:492] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:26.176931 9435 ts_tablet_manager.cc:1403] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.003s
I20251215 14:55:26.177275 9248 leader_election.cc:304] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:26.187420 9427 tablet_bootstrap.cc:492] T 96a1de7ce5f64f348585926ac05ddb87 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.187572 9427 ts_tablet_manager.cc:1403] T 96a1de7ce5f64f348585926ac05ddb87 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.003s
I20251215 14:55:26.188306 9427 raft_consensus.cc:359] T 96a1de7ce5f64f348585926ac05ddb87 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.188474 9427 raft_consensus.cc:385] T 96a1de7ce5f64f348585926ac05ddb87 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.188529 9427 raft_consensus.cc:740] T 96a1de7ce5f64f348585926ac05ddb87 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.188704 9427 consensus_queue.cc:260] T 96a1de7ce5f64f348585926ac05ddb87 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.189175 9427 ts_tablet_manager.cc:1434] T 96a1de7ce5f64f348585926ac05ddb87 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:26.190315 9427 tablet_bootstrap.cc:492] T 41e0d694b1af46b19138ccbffea96f28 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.191902 9427 tablet_bootstrap.cc:654] T 41e0d694b1af46b19138ccbffea96f28 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:26.191900 9249 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 122568us
I20251215 14:55:26.194844 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "809257b3929a4c2f91132f9315752130" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.195063 9170 raft_consensus.cc:2393] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 2: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:26.197906 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a723f46302f34465a214714e98e47de7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.198148 9170 raft_consensus.cc:2393] T a723f46302f34465a214714e98e47de7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:26.199880 11271 raft_consensus.cc:2804] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.200030 11271 raft_consensus.cc:697] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:26.200270 11271 consensus_queue.cc:237] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.203649 9435 raft_consensus.cc:359] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.203835 9435 raft_consensus.cc:385] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.203888 9435 raft_consensus.cc:740] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.204072 9435 consensus_queue.cc:260] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.204566 9435 ts_tablet_manager.cc:1434] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.027s user 0.000s sys 0.000s
I20251215 14:55:26.204836 9435 tablet_bootstrap.cc:492] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:26.206524 9435 tablet_bootstrap.cc:654] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.207957 9427 tablet_bootstrap.cc:492] T 41e0d694b1af46b19138ccbffea96f28 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.208091 9427 ts_tablet_manager.cc:1403] T 41e0d694b1af46b19138ccbffea96f28 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.000s
I20251215 14:55:26.208781 9427 raft_consensus.cc:359] T 41e0d694b1af46b19138ccbffea96f28 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.208936 9427 raft_consensus.cc:385] T 41e0d694b1af46b19138ccbffea96f28 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.208987 9427 raft_consensus.cc:740] T 41e0d694b1af46b19138ccbffea96f28 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.209172 9427 consensus_queue.cc:260] T 41e0d694b1af46b19138ccbffea96f28 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.209631 9427 ts_tablet_manager.cc:1434] T 41e0d694b1af46b19138ccbffea96f28 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:26.209879 9427 tablet_bootstrap.cc:492] T d064a85455844115899b3de91a2313f5 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.210868 9248 leader_election.cc:304] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:26.211418 9427 tablet_bootstrap.cc:654] T d064a85455844115899b3de91a2313f5 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.216585 11038 consensus_queue.cc:1048] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.219367 11038 raft_consensus.cc:2804] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.219467 11038 raft_consensus.cc:493] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.219530 11038 raft_consensus.cc:3060] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.222379 11038 raft_consensus.cc:515] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.223023 11038 leader_election.cc:290] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:26.224150 9112 leader_election.cc:304] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:26.224278 9427 tablet_bootstrap.cc:492] T d064a85455844115899b3de91a2313f5 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.224392 9427 ts_tablet_manager.cc:1403] T d064a85455844115899b3de91a2313f5 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251215 14:55:26.224568 11608 raft_consensus.cc:2804] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.224687 11608 raft_consensus.cc:493] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.224802 11608 raft_consensus.cc:3060] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.227845 11380 consensus_queue.cc:1048] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.228389 9427 raft_consensus.cc:359] T d064a85455844115899b3de91a2313f5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.228543 9427 raft_consensus.cc:385] T d064a85455844115899b3de91a2313f5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.228591 9427 raft_consensus.cc:740] T d064a85455844115899b3de91a2313f5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.228744 9427 consensus_queue.cc:260] T d064a85455844115899b3de91a2313f5 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.229207 9427 ts_tablet_manager.cc:1434] T d064a85455844115899b3de91a2313f5 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251215 14:55:26.229454 9427 tablet_bootstrap.cc:492] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.231388 9427 tablet_bootstrap.cc:654] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:26.232957 9248 leader_election.cc:343] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.246255 11166 raft_consensus.cc:493] T 52e93348b205408f83efff27fde48e9b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.246443 11166 raft_consensus.cc:515] T 52e93348b205408f83efff27fde48e9b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.247087 11166 leader_election.cc:290] T 52e93348b205408f83efff27fde48e9b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:26.247087 11590 raft_consensus.cc:493] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.247347 11590 raft_consensus.cc:515] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.248003 11590 leader_election.cc:290] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:26.252290 9427 tablet_bootstrap.cc:492] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.252427 9427 ts_tablet_manager.cc:1403] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.007s
I20251215 14:55:26.253167 9427 raft_consensus.cc:359] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.253347 9427 raft_consensus.cc:385] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.253396 9427 raft_consensus.cc:740] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.253556 9427 consensus_queue.cc:260] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.254020 9427 ts_tablet_manager.cc:1434] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:26.254282 9427 tablet_bootstrap.cc:492] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.256145 9427 tablet_bootstrap.cc:654] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.256805 9248 leader_election.cc:304] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.257948 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6d6e5f5227974610b686e23da5501f4a" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:26.258244 9172 raft_consensus.cc:3060] T 6d6e5f5227974610b686e23da5501f4a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.259943 9427 tablet_bootstrap.cc:492] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.260062 9427 ts_tablet_manager.cc:1403] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20251215 14:55:26.260821 9427 raft_consensus.cc:359] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.260970 9427 raft_consensus.cc:385] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.261029 9427 raft_consensus.cc:740] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.261206 9427 consensus_queue.cc:260] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.261438 9172 raft_consensus.cc:2468] T 6d6e5f5227974610b686e23da5501f4a P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:26.261658 9427 ts_tablet_manager.cc:1434] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:26.261917 9427 tablet_bootstrap.cc:492] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.261977 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10890fcab7204cc7b7468402952f824c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:26.262126 9170 raft_consensus.cc:3060] T 10890fcab7204cc7b7468402952f824c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.263576 9427 tablet_bootstrap.cc:654] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.264497 9170 raft_consensus.cc:2468] T 10890fcab7204cc7b7468402952f824c P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:26.266517 9112 leader_election.cc:304] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:26.266969 10991 raft_consensus.cc:2804] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.267045 10991 raft_consensus.cc:493] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.267108 10991 raft_consensus.cc:3060] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.269567 10991 raft_consensus.cc:515] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.270157 10991 leader_election.cc:290] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.272929 11380 raft_consensus.cc:493] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.273190 11380 raft_consensus.cc:515] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.273994 11380 leader_election.cc:290] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.276160 9112 leader_election.cc:304] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:26.276377 9427 tablet_bootstrap.cc:492] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.276504 9427 ts_tablet_manager.cc:1403] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.001s
I20251215 14:55:26.276846 10991 raft_consensus.cc:2804] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.276928 10991 raft_consensus.cc:493] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.276986 10991 raft_consensus.cc:3060] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.277248 9427 raft_consensus.cc:359] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.277392 9427 raft_consensus.cc:385] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.277437 9427 raft_consensus.cc:740] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.277647 9427 consensus_queue.cc:260] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.278246 9427 ts_tablet_manager.cc:1434] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:26.278502 9427 tablet_bootstrap.cc:492] T c4929bdb04914251b75a11d6936f1ee0 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.279551 9435 tablet_bootstrap.cc:492] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:26.279683 9435 ts_tablet_manager.cc:1403] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.075s user 0.002s sys 0.006s
I20251215 14:55:26.280171 9427 tablet_bootstrap.cc:654] T c4929bdb04914251b75a11d6936f1ee0 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.281190 10991 raft_consensus.cc:515] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.282433 10991 leader_election.cc:290] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:26.297688 11038 raft_consensus.cc:2749] T a71d029bbd88416da1dbcad09dc93115 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.298386 9435 raft_consensus.cc:359] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.298585 9435 raft_consensus.cc:385] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.298638 9435 raft_consensus.cc:740] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.298470 9112 leader_election.cc:304] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:26.298805 9435 consensus_queue.cc:260] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.299412 9435 ts_tablet_manager.cc:1434] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.020s user 0.000s sys 0.002s
I20251215 14:55:26.299419 10991 raft_consensus.cc:2804] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.299736 9435 tablet_bootstrap.cc:492] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:26.299862 10991 raft_consensus.cc:493] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.299995 10991 raft_consensus.cc:3060] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.301466 9435 tablet_bootstrap.cc:654] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.302654 10991 raft_consensus.cc:515] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.303669 10991 leader_election.cc:290] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
W20251215 14:55:26.304164 9248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 47412.3us
W20251215 14:55:26.304425 9248 leader_election.cc:343] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.304594 9248 leader_election.cc:304] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.305006 11038 raft_consensus.cc:2749] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.308140 11608 raft_consensus.cc:515] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.320192 9435 tablet_bootstrap.cc:492] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:26.320555 9435 ts_tablet_manager.cc:1403] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.002s
I20251215 14:55:26.322180 11590 raft_consensus.cc:493] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.322324 11590 raft_consensus.cc:515] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.322408 9435 raft_consensus.cc:359] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.322765 9435 raft_consensus.cc:385] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.322898 11590 leader_election.cc:290] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:26.322901 9435 raft_consensus.cc:740] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.323334 9435 consensus_queue.cc:260] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.326058 11590 raft_consensus.cc:493] T 82575517299b4e69a0871714dde9aacc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.326174 11590 raft_consensus.cc:515] T 82575517299b4e69a0871714dde9aacc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.326668 11590 leader_election.cc:290] T 82575517299b4e69a0871714dde9aacc P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:26.326766 9435 ts_tablet_manager.cc:1434] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20251215 14:55:26.330251 11590 raft_consensus.cc:493] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.330471 11590 raft_consensus.cc:515] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.332144 11590 leader_election.cc:290] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:26.332196 9435 tablet_bootstrap.cc:492] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4: Bootstrap starting.
W20251215 14:55:26.334164 9248 leader_election.cc:343] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.334564 9427 tablet_bootstrap.cc:492] T c4929bdb04914251b75a11d6936f1ee0 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.334692 9427 ts_tablet_manager.cc:1403] T c4929bdb04914251b75a11d6936f1ee0 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.056s user 0.009s sys 0.013s
I20251215 14:55:26.335438 9427 raft_consensus.cc:359] T c4929bdb04914251b75a11d6936f1ee0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.335594 9427 raft_consensus.cc:385] T c4929bdb04914251b75a11d6936f1ee0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.335641 9427 raft_consensus.cc:740] T c4929bdb04914251b75a11d6936f1ee0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.335819 9427 consensus_queue.cc:260] T c4929bdb04914251b75a11d6936f1ee0 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.336164 9427 ts_tablet_manager.cc:1434] T c4929bdb04914251b75a11d6936f1ee0 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251215 14:55:26.336443 9427 tablet_bootstrap.cc:492] T 4f49d57104554c91a13229d3940cd4d2 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.320889 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86f18ff40af547da85de8966b12f76f4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.336742 9172 raft_consensus.cc:2393] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:26.322937 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "265a8937802a4b9cbf0edaf3e2a41ba8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:26.337369 9177 raft_consensus.cc:2393] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:26.338400 9427 tablet_bootstrap.cc:654] T 4f49d57104554c91a13229d3940cd4d2 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.340111 11038 raft_consensus.cc:493] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.342945 11038 raft_consensus.cc:515] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.343704 11038 leader_election.cc:290] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.344537 9426 tablet_bootstrap.cc:492] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:26.344686 9426 ts_tablet_manager.cc:1403] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.281s user 0.043s sys 0.027s
I20251215 14:55:26.345495 9426 raft_consensus.cc:359] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.345681 9426 raft_consensus.cc:385] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.345743 9426 raft_consensus.cc:740] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.345923 9426 consensus_queue.cc:260] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.346413 9426 ts_tablet_manager.cc:1434] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:26.346731 9426 tablet_bootstrap.cc:492] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:26.347687 9435 tablet_bootstrap.cc:654] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.348456 9426 tablet_bootstrap.cc:654] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.351326 11608 leader_election.cc:290] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.351779 11484 raft_consensus.cc:493] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.351956 11484 raft_consensus.cc:515] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.352568 11484 leader_election.cc:290] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.355429 11098 raft_consensus.cc:493] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.355490 9088 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:26.355573 11098 raft_consensus.cc:515] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.356137 11098 leader_election.cc:290] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.356534 11098 raft_consensus.cc:493] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.356645 11098 raft_consensus.cc:515] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.357157 11098 leader_election.cc:290] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.357479 9427 tablet_bootstrap.cc:492] T 4f49d57104554c91a13229d3940cd4d2 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.357597 9427 ts_tablet_manager.cc:1403] T 4f49d57104554c91a13229d3940cd4d2 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.004s
I20251215 14:55:26.357617 9426 tablet_bootstrap.cc:492] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:26.357754 9426 ts_tablet_manager.cc:1403] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.000s
I20251215 14:55:26.358569 9426 raft_consensus.cc:359] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.358636 9427 raft_consensus.cc:359] T 4f49d57104554c91a13229d3940cd4d2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.358752 9426 raft_consensus.cc:385] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.358793 9427 raft_consensus.cc:385] T 4f49d57104554c91a13229d3940cd4d2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.358806 9426 raft_consensus.cc:740] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.358839 9427 raft_consensus.cc:740] T 4f49d57104554c91a13229d3940cd4d2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.358997 9427 consensus_queue.cc:260] T 4f49d57104554c91a13229d3940cd4d2 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.358990 9426 consensus_queue.cc:260] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.359473 9427 ts_tablet_manager.cc:1434] T 4f49d57104554c91a13229d3940cd4d2 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:26.359530 9426 ts_tablet_manager.cc:1434] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:26.359822 9426 tablet_bootstrap.cc:492] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:26.361593 9426 tablet_bootstrap.cc:654] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.367487 11590 raft_consensus.cc:493] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.367666 11590 raft_consensus.cc:515] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.368286 11590 leader_election.cc:290] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:26.368696 9427 tablet_bootstrap.cc:492] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.370472 9427 tablet_bootstrap.cc:654] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.372275 9435 tablet_bootstrap.cc:492] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:26.372635 9435 ts_tablet_manager.cc:1403] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.044s user 0.008s sys 0.000s
I20251215 14:55:26.375690 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd025ffa766d45f8bc6c42c6eaa3418c" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.375909 9025 raft_consensus.cc:3060] T cd025ffa766d45f8bc6c42c6eaa3418c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.376951 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f49d57104554c91a13229d3940cd4d2" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.378482 9025 raft_consensus.cc:2468] T cd025ffa766d45f8bc6c42c6eaa3418c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:26.382266 9426 tablet_bootstrap.cc:492] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:26.382396 9426 ts_tablet_manager.cc:1403] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.001s
I20251215 14:55:26.383203 9426 raft_consensus.cc:359] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.383370 9426 raft_consensus.cc:385] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.383435 9426 raft_consensus.cc:740] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.383615 9426 consensus_queue.cc:260] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.384119 9426 ts_tablet_manager.cc:1434] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:26.385197 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96a1de7ce5f64f348585926ac05ddb87" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.385357 9024 raft_consensus.cc:2468] T 96a1de7ce5f64f348585926ac05ddb87 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
W20251215 14:55:26.387430 9248 leader_election.cc:343] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.387866 9248 leader_election.cc:304] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.388134 11038 raft_consensus.cc:2749] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.389637 9427 tablet_bootstrap.cc:492] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.389776 9427 ts_tablet_manager.cc:1403] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.007s
I20251215 14:55:26.390377 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4929bdb04914251b75a11d6936f1ee0" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.390482 9427 raft_consensus.cc:359] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.390618 9427 raft_consensus.cc:385] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.390667 9427 raft_consensus.cc:740] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.390856 9427 consensus_queue.cc:260] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.391276 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f45f8b2fbf754d359deb666cb605c789" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.391343 9427 ts_tablet_manager.cc:1434] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:26.391443 9024 raft_consensus.cc:3060] T f45f8b2fbf754d359deb666cb605c789 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.391633 9427 tablet_bootstrap.cc:492] T 78c65aae2561484ebbd68d0a0475b27d P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.393271 9427 tablet_bootstrap.cc:654] T 78c65aae2561484ebbd68d0a0475b27d P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.394052 9024 raft_consensus.cc:2468] T f45f8b2fbf754d359deb666cb605c789 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:26.393761 9435 raft_consensus.cc:359] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.394572 9435 raft_consensus.cc:385] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.394865 9435 raft_consensus.cc:740] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.395955 9435 consensus_queue.cc:260] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.397083 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bd1578d434047158b6fbce7c24daebb" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.398671 9426 tablet_bootstrap.cc:492] T cf18d0368ee948a38d35ec47b732f6cc P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:26.398975 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf18d0368ee948a38d35ec47b732f6cc" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.399909 9435 ts_tablet_manager.cc:1434] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.027s user 0.003s sys 0.000s
I20251215 14:55:26.402179 9435 tablet_bootstrap.cc:492] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:26.407804 10991 raft_consensus.cc:493] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.408010 10991 raft_consensus.cc:515] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.408900 10991 leader_election.cc:290] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.409950 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96a1de7ce5f64f348585926ac05ddb87" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.410154 9179 raft_consensus.cc:2468] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:26.410949 9426 tablet_bootstrap.cc:654] T cf18d0368ee948a38d35ec47b732f6cc P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:26.412765 9248 leader_election.cc:343] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.413066 9248 leader_election.cc:304] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.413520 9435 tablet_bootstrap.cc:654] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.413908 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86f18ff40af547da85de8966b12f76f4" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.414137 9024 raft_consensus.cc:3060] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.416810 9024 raft_consensus.cc:2468] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:26.413522 11271 raft_consensus.cc:2749] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.419369 9249 leader_election.cc:304] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:26.419986 11038 raft_consensus.cc:2804] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.420169 11038 raft_consensus.cc:697] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:26.420464 11038 consensus_queue.cc:237] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.421739 9427 tablet_bootstrap.cc:492] T 78c65aae2561484ebbd68d0a0475b27d P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.421887 9427 ts_tablet_manager.cc:1403] T 78c65aae2561484ebbd68d0a0475b27d P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.003s
I20251215 14:55:26.422652 9427 raft_consensus.cc:359] T 78c65aae2561484ebbd68d0a0475b27d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.422860 9427 raft_consensus.cc:385] T 78c65aae2561484ebbd68d0a0475b27d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.422930 9427 raft_consensus.cc:740] T 78c65aae2561484ebbd68d0a0475b27d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.423147 9427 consensus_queue.cc:260] T 78c65aae2561484ebbd68d0a0475b27d P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.423794 9427 ts_tablet_manager.cc:1434] T 78c65aae2561484ebbd68d0a0475b27d P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:26.424101 9427 tablet_bootstrap.cc:492] T cf18d0368ee948a38d35ec47b732f6cc P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.425979 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b686ad43973448c8e24230d7d1d7250" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.426215 9027 raft_consensus.cc:2468] T 2b686ad43973448c8e24230d7d1d7250 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:26.426504 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "265a8937802a4b9cbf0edaf3e2a41ba8" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.426715 9024 raft_consensus.cc:3060] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.429190 9024 raft_consensus.cc:2468] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:26.430426 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "52e93348b205408f83efff27fde48e9b" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.431028 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6084ebf2a804bfc9d2c2cde3e0cba98" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.431228 9177 raft_consensus.cc:2468] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:26.431475 9427 tablet_bootstrap.cc:654] T cf18d0368ee948a38d35ec47b732f6cc P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.433596 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9a4c7bd7d0984ef788fe2c0504058c37" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.434653 11271 consensus_queue.cc:1048] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.438092 11380 consensus_queue.cc:1048] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.439000 11380 consensus_queue.cc:1048] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.440882 11174 consensus_queue.cc:1048] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.442623 9435 tablet_bootstrap.cc:492] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:26.442759 11174 consensus_queue.cc:1048] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.443091 9435 ts_tablet_manager.cc:1403] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.006s
W20251215 14:55:26.445730 9248 leader_election.cc:343] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.446892 9427 tablet_bootstrap.cc:492] T cf18d0368ee948a38d35ec47b732f6cc P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.447041 9427 ts_tablet_manager.cc:1403] T cf18d0368ee948a38d35ec47b732f6cc P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.002s
I20251215 14:55:26.447669 10991 consensus_queue.cc:1048] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.447824 9427 raft_consensus.cc:359] T cf18d0368ee948a38d35ec47b732f6cc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.447985 9427 raft_consensus.cc:385] T cf18d0368ee948a38d35ec47b732f6cc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.448050 9427 raft_consensus.cc:740] T cf18d0368ee948a38d35ec47b732f6cc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.448233 9427 consensus_queue.cc:260] T cf18d0368ee948a38d35ec47b732f6cc P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.448956 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82575517299b4e69a0871714dde9aacc" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.449262 9427 ts_tablet_manager.cc:1434] T cf18d0368ee948a38d35ec47b732f6cc P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:26.449569 9427 tablet_bootstrap.cc:492] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.450325 9248 leader_election.cc:304] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.450645 9426 tablet_bootstrap.cc:492] T cf18d0368ee948a38d35ec47b732f6cc P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:26.450762 9426 ts_tablet_manager.cc:1403] T cf18d0368ee948a38d35ec47b732f6cc P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.053s user 0.002s sys 0.006s
I20251215 14:55:26.451261 9427 tablet_bootstrap.cc:654] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.451514 9426 raft_consensus.cc:359] T cf18d0368ee948a38d35ec47b732f6cc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.451668 9426 raft_consensus.cc:385] T cf18d0368ee948a38d35ec47b732f6cc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.451719 9426 raft_consensus.cc:740] T cf18d0368ee948a38d35ec47b732f6cc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.451910 9426 consensus_queue.cc:260] T cf18d0368ee948a38d35ec47b732f6cc P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.452348 9426 ts_tablet_manager.cc:1434] T cf18d0368ee948a38d35ec47b732f6cc P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:26.447688 9435 raft_consensus.cc:359] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.452461 9435 raft_consensus.cc:385] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.452533 9435 raft_consensus.cc:740] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.452504 11271 raft_consensus.cc:2749] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.452715 9435 consensus_queue.cc:260] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.453202 9435 ts_tablet_manager.cc:1434] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20251215 14:55:26.453470 9435 tablet_bootstrap.cc:492] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:26.453833 9112 leader_election.cc:304] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:26.454110 10991 raft_consensus.cc:2804] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.454218 10991 raft_consensus.cc:697] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:26.454455 10991 consensus_queue.cc:237] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:26.454268 9249 leader_election.cc:343] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.455020 9435 tablet_bootstrap.cc:654] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.460278 9426 tablet_bootstrap.cc:492] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:26.461885 9112 leader_election.cc:304] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:26.462437 11380 raft_consensus.cc:2804] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.462564 11380 raft_consensus.cc:493] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.462661 11380 raft_consensus.cc:3060] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.463603 11271 consensus_queue.cc:1048] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.465657 11380 raft_consensus.cc:515] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.465893 9427 tablet_bootstrap.cc:492] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.466044 9427 ts_tablet_manager.cc:1403] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.004s
W20251215 14:55:26.465646 9249 leader_election.cc:343] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.466686 11380 leader_election.cc:290] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.466856 9427 raft_consensus.cc:359] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.467020 9427 raft_consensus.cc:385] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.467083 9427 raft_consensus.cc:740] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.461898 9426 tablet_bootstrap.cc:654] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.467346 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "90c7925890474a76b35a3ce5e6db8ebf" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.467341 9427 consensus_queue.cc:260] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
W20251215 14:55:26.467089 9249 leader_election.cc:343] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.467514 9177 raft_consensus.cc:2468] T 90c7925890474a76b35a3ce5e6db8ebf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:26.467947 9427 ts_tablet_manager.cc:1434] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:26.468144 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6d6e5f5227974610b686e23da5501f4a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.468459 9177 raft_consensus.cc:2393] T 6d6e5f5227974610b686e23da5501f4a P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:26.469626 9112 leader_election.cc:304] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:26.470075 11608 raft_consensus.cc:2804] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.470340 11608 raft_consensus.cc:697] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:26.470683 11608 consensus_queue.cc:237] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.470700 9249 leader_election.cc:304] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:26.470644 9248 leader_election.cc:343] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.472430 11038 raft_consensus.cc:2804] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.472611 11038 raft_consensus.cc:493] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.472759 11038 raft_consensus.cc:3060] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.471936 9248 leader_election.cc:304] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.478562 11174 raft_consensus.cc:2749] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:26.486243 9248 leader_election.cc:343] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.488700 9248 leader_election.cc:304] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.488440 11038 raft_consensus.cc:515] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.494036 11174 raft_consensus.cc:2749] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.495157 11174 raft_consensus.cc:493] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.495289 11174 raft_consensus.cc:515] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.495783 11174 leader_election.cc:290] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.496609 11174 raft_consensus.cc:493] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.496716 11174 raft_consensus.cc:515] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.496946 9426 tablet_bootstrap.cc:492] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:26.497112 9426 ts_tablet_manager.cc:1403] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.037s user 0.007s sys 0.007s
I20251215 14:55:26.497134 11174 leader_election.cc:290] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.497872 9426 raft_consensus.cc:359] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.498062 9426 raft_consensus.cc:385] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.498140 9426 raft_consensus.cc:740] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.498360 9426 consensus_queue.cc:260] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.499050 9426 ts_tablet_manager.cc:1434] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:26.499379 9426 tablet_bootstrap.cc:492] T c4929bdb04914251b75a11d6936f1ee0 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:26.501284 9426 tablet_bootstrap.cc:654] T c4929bdb04914251b75a11d6936f1ee0 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.503914 11038 leader_election.cc:290] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.503796 9248 leader_election.cc:304] T 8eb90003cf02440e9752af134a3670b6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.505271 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7bacba021777416e9c547469aa08bd9c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.506904 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20f30d23a43f43749f6f9054a18a84a8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.507468 9112 leader_election.cc:304] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:26.507788 11609 consensus_queue.cc:1048] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.508312 11609 raft_consensus.cc:2804] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.506269 11038 raft_consensus.cc:2749] T 8eb90003cf02440e9752af134a3670b6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.508556 11609 raft_consensus.cc:697] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:26.508785 11609 consensus_queue.cc:237] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.509407 11398 raft_consensus.cc:493] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.509531 11398 raft_consensus.cc:515] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.509992 11398 leader_election.cc:290] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.511390 9426 tablet_bootstrap.cc:492] T c4929bdb04914251b75a11d6936f1ee0 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:26.511543 9426 ts_tablet_manager.cc:1403] T c4929bdb04914251b75a11d6936f1ee0 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.001s
I20251215 14:55:26.512298 9426 raft_consensus.cc:359] T c4929bdb04914251b75a11d6936f1ee0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.512465 9426 raft_consensus.cc:385] T c4929bdb04914251b75a11d6936f1ee0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.512562 9426 raft_consensus.cc:740] T c4929bdb04914251b75a11d6936f1ee0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.512753 9426 consensus_queue.cc:260] T c4929bdb04914251b75a11d6936f1ee0 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.513263 9426 ts_tablet_manager.cc:1434] T c4929bdb04914251b75a11d6936f1ee0 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:26.513548 9426 tablet_bootstrap.cc:492] T 3a4767a5965244afac42190f97f0a113 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:26.514216 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96a1de7ce5f64f348585926ac05ddb87" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:26.514808 9179 raft_consensus.cc:2393] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:26.517946 9112 leader_election.cc:304] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:26.518189 11398 raft_consensus.cc:2804] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.518258 9112 leader_election.cc:304] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:26.518357 11398 raft_consensus.cc:493] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.518438 11398 raft_consensus.cc:3060] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.519277 9426 tablet_bootstrap.cc:654] T 3a4767a5965244afac42190f97f0a113 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.521317 11552 raft_consensus.cc:2804] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.521461 11552 raft_consensus.cc:697] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:26.521646 9426 tablet_bootstrap.cc:492] T 3a4767a5965244afac42190f97f0a113 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:26.521793 9426 ts_tablet_manager.cc:1403] T 3a4767a5965244afac42190f97f0a113 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20251215 14:55:26.521718 11552 consensus_queue.cc:237] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.522473 9426 raft_consensus.cc:359] T 3a4767a5965244afac42190f97f0a113 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.522652 9426 raft_consensus.cc:385] T 3a4767a5965244afac42190f97f0a113 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.522720 9426 raft_consensus.cc:740] T 3a4767a5965244afac42190f97f0a113 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.522943 9426 consensus_queue.cc:260] T 3a4767a5965244afac42190f97f0a113 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.523607 11398 raft_consensus.cc:515] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.524466 11398 leader_election.cc:290] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.525689 9426 ts_tablet_manager.cc:1434] T 3a4767a5965244afac42190f97f0a113 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20251215 14:55:26.525986 9426 tablet_bootstrap.cc:492] T 4f49d57104554c91a13229d3940cd4d2 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:26.525947 11271 consensus_queue.cc:1048] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:26.527529 9248 leader_election.cc:343] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.527613 9426 tablet_bootstrap.cc:654] T 4f49d57104554c91a13229d3940cd4d2 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.527945 9248 leader_election.cc:304] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.544314 9301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "265a8937802a4b9cbf0edaf3e2a41ba8" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:26.544559 9301 raft_consensus.cc:2393] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:26.545359 11174 consensus_queue.cc:1048] T 8d4d6163853448ceaff5c1954cfc64e7 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.546373 11098 raft_consensus.cc:2749] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.546236 9298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b686ad43973448c8e24230d7d1d7250" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
W20251215 14:55:26.529956 9249 leader_election.cc:343] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.537948 9309 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f45f8b2fbf754d359deb666cb605c789" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.538038 9307 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86f18ff40af547da85de8966b12f76f4" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.547926 9309 raft_consensus.cc:2468] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:26.548147 9307 raft_consensus.cc:2468] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:26.541662 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd025ffa766d45f8bc6c42c6eaa3418c" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.542855 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96a1de7ce5f64f348585926ac05ddb87" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.543088 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f45f8b2fbf754d359deb666cb605c789" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:26.543562 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86f18ff40af547da85de8966b12f76f4" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:26.543646 11610 raft_consensus.cc:493] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.553105 9426 tablet_bootstrap.cc:492] T 4f49d57104554c91a13229d3940cd4d2 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:26.553305 9426 ts_tablet_manager.cc:1403] T 4f49d57104554c91a13229d3940cd4d2 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.001s
W20251215 14:55:26.553840 9249 leader_election.cc:343] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.555646 9298 raft_consensus.cc:2468] T 2b686ad43973448c8e24230d7d1d7250 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:26.555855 9305 raft_consensus.cc:2393] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:26.555971 11610 raft_consensus.cc:515] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.556064 9308 raft_consensus.cc:3060] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.557370 9313 raft_consensus.cc:2468] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:26.557405 9306 raft_consensus.cc:3060] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.557623 11174 consensus_queue.cc:1048] T fc3bcd441f1948a5a79d20e2e205d7f2 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20251215 14:55:26.558583 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6d6e5f5227974610b686e23da5501f4a" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.558779 9029 raft_consensus.cc:2468] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:26.560642 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6d6e5f5227974610b686e23da5501f4a" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.560781 9029 raft_consensus.cc:3060] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.560968 9426 raft_consensus.cc:359] T 4f49d57104554c91a13229d3940cd4d2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.561141 9426 raft_consensus.cc:385] T 4f49d57104554c91a13229d3940cd4d2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.561218 9426 raft_consensus.cc:740] T 4f49d57104554c91a13229d3940cd4d2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.561429 9426 consensus_queue.cc:260] T 4f49d57104554c91a13229d3940cd4d2 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.561925 9426 ts_tablet_manager.cc:1434] T 4f49d57104554c91a13229d3940cd4d2 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s
I20251215 14:55:26.562184 9426 tablet_bootstrap.cc:492] T 9a4c7bd7d0984ef788fe2c0504058c37 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:26.563238 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:26.563383 9029 raft_consensus.cc:2468] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:26.560266 9306 raft_consensus.cc:2468] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:26.563756 9426 tablet_bootstrap.cc:654] T 9a4c7bd7d0984ef788fe2c0504058c37 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.567384 9310 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd025ffa766d45f8bc6c42c6eaa3418c" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:26.567620 9310 raft_consensus.cc:3060] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.570714 9310 raft_consensus.cc:2468] T cd025ffa766d45f8bc6c42c6eaa3418c P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:26.573071 9308 raft_consensus.cc:2468] T f45f8b2fbf754d359deb666cb605c789 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:26.575371 9170 raft_consensus.cc:1275] T 809257b3929a4c2f91132f9315752130 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 FOLLOWER]: Refusing update from remote peer e89303a500544272b601d7c29be802b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 14:55:26.576129 11473 raft_consensus.cc:493] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.577385 11473 raft_consensus.cc:515] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.584496 11610 leader_election.cc:290] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.585635 9029 raft_consensus.cc:3060] T 84f036eb44a44e0597bc9af88d81a017 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.585846 9028 raft_consensus.cc:3060] T 82575517299b4e69a0871714dde9aacc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.589037 11473 leader_election.cc:290] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.589538 9032 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "265a8937802a4b9cbf0edaf3e2a41ba8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.589749 9032 raft_consensus.cc:2393] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:26.590128 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96a1de7ce5f64f348585926ac05ddb87" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.590327 9029 raft_consensus.cc:3060] T 96a1de7ce5f64f348585926ac05ddb87 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.592643 9032 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f49d57104554c91a13229d3940cd4d2" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.592796 9032 raft_consensus.cc:2468] T 4f49d57104554c91a13229d3940cd4d2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:26.600739 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4929bdb04914251b75a11d6936f1ee0" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.600936 9037 raft_consensus.cc:2468] T c4929bdb04914251b75a11d6936f1ee0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:26.603626 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf18d0368ee948a38d35ec47b732f6cc" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.603803 9030 raft_consensus.cc:2468] T cf18d0368ee948a38d35ec47b732f6cc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:26.605347 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96a1de7ce5f64f348585926ac05ddb87" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.610334 11611 consensus_queue.cc:1048] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.611033 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18c0b2442bcd4fb69d7d9a4f5fb46061" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.611907 9029 raft_consensus.cc:2468] T 96a1de7ce5f64f348585926ac05ddb87 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:26.612560 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "caefb83a990e4ad2baf621cd83265f96" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.613135 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7bacba021777416e9c547469aa08bd9c" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.613886 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20f30d23a43f43749f6f9054a18a84a8" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.614580 9033 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78c65aae2561484ebbd68d0a0475b27d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.614710 9033 raft_consensus.cc:2468] T 78c65aae2561484ebbd68d0a0475b27d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:26.615142 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b686ad43973448c8e24230d7d1d7250" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.615389 9030 raft_consensus.cc:3060] T 2b686ad43973448c8e24230d7d1d7250 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.618192 9030 raft_consensus.cc:2468] T 2b686ad43973448c8e24230d7d1d7250 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:26.618486 9033 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96a1de7ce5f64f348585926ac05ddb87" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.618716 9033 raft_consensus.cc:2393] T 96a1de7ce5f64f348585926ac05ddb87 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:26.620059 9112 leader_election.cc:304] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:26.620354 9112 leader_election.cc:304] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:26.620743 11283 raft_consensus.cc:493] T 84f036eb44a44e0597bc9af88d81a017 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.620852 11283 raft_consensus.cc:515] T 84f036eb44a44e0597bc9af88d81a017 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.621315 11283 leader_election.cc:290] T 84f036eb44a44e0597bc9af88d81a017 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:26.621729 11609 consensus_queue.cc:1048] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.621887 9112 leader_election.cc:304] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:26.622148 11664 raft_consensus.cc:2804] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.622242 11664 raft_consensus.cc:493] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.622349 11664 raft_consensus.cc:3060] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.622437 11552 raft_consensus.cc:2804] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.622555 11552 raft_consensus.cc:697] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:26.622813 11552 consensus_queue.cc:237] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.625180 11664 raft_consensus.cc:515] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.625752 11664 leader_election.cc:290] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.628407 11380 raft_consensus.cc:2804] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.629030 11380 raft_consensus.cc:697] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:26.629948 9435 tablet_bootstrap.cc:492] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:26.630151 9435 ts_tablet_manager.cc:1403] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.177s user 0.017s sys 0.027s
I20251215 14:55:26.630995 9435 raft_consensus.cc:359] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.631104 9427 tablet_bootstrap.cc:492] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.631234 9435 raft_consensus.cc:385] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.631385 9435 raft_consensus.cc:740] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.631650 9435 consensus_queue.cc:260] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.629961 11380 consensus_queue.cc:237] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.632171 9435 ts_tablet_manager.cc:1434] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:26.632499 9435 tablet_bootstrap.cc:492] T 37554f8c1a90462095c511f00df6dece P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:26.633224 9427 tablet_bootstrap.cc:654] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.634873 11480 raft_consensus.cc:493] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.635041 11480 raft_consensus.cc:515] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.635644 11480 leader_election.cc:290] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.636503 11611 raft_consensus.cc:493] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.636559 11480 raft_consensus.cc:493] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.636665 11480 raft_consensus.cc:515] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.636669 11611 raft_consensus.cc:515] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.637106 10991 raft_consensus.cc:493] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.637372 10991 raft_consensus.cc:515] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.637423 11611 leader_election.cc:290] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.637424 11480 leader_election.cc:290] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.638182 9306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10890fcab7204cc7b7468402952f824c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:26.638406 9306 raft_consensus.cc:3060] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.638892 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86f18ff40af547da85de8966b12f76f4" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.639108 9305 raft_consensus.cc:2393] T 86f18ff40af547da85de8966b12f76f4 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:26.640244 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bd1578d434047158b6fbce7c24daebb" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.640424 9311 raft_consensus.cc:2468] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:26.641649 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78c65aae2561484ebbd68d0a0475b27d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.641903 9177 raft_consensus.cc:2393] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:26.643661 9306 raft_consensus.cc:2468] T 10890fcab7204cc7b7468402952f824c P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:26.643800 9426 tablet_bootstrap.cc:492] T 9a4c7bd7d0984ef788fe2c0504058c37 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:26.643958 9426 ts_tablet_manager.cc:1403] T 9a4c7bd7d0984ef788fe2c0504058c37 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.082s user 0.006s sys 0.006s
I20251215 14:55:26.644691 9426 raft_consensus.cc:359] T 9a4c7bd7d0984ef788fe2c0504058c37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.644891 9426 raft_consensus.cc:385] T 9a4c7bd7d0984ef788fe2c0504058c37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.644972 9426 raft_consensus.cc:740] T 9a4c7bd7d0984ef788fe2c0504058c37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.645195 9426 consensus_queue.cc:260] T 9a4c7bd7d0984ef788fe2c0504058c37 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.645730 9426 ts_tablet_manager.cc:1434] T 9a4c7bd7d0984ef788fe2c0504058c37 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20251215 14:55:26.645776 9249 leader_election.cc:343] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.645989 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "21437c9162f1435485dde5fca3522be1" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.646178 11166 raft_consensus.cc:493] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.646303 11166 raft_consensus.cc:515] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.646539 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "41e0d694b1af46b19138ccbffea96f28" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.646752 9170 raft_consensus.cc:2468] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:26.646829 11166 leader_election.cc:290] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:26.659252 9249 leader_election.cc:343] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.659446 9310 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "96a1de7ce5f64f348585926ac05ddb87" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:26.659756 9435 tablet_bootstrap.cc:654] T 37554f8c1a90462095c511f00df6dece P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.660683 9310 raft_consensus.cc:2393] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:26.661317 9298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "52e93348b205408f83efff27fde48e9b" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.661583 9298 raft_consensus.cc:2393] T 52e93348b205408f83efff27fde48e9b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:26.661917 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9a4c7bd7d0984ef788fe2c0504058c37" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.662108 9314 raft_consensus.cc:2468] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:26.662181 9296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "90c7925890474a76b35a3ce5e6db8ebf" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.662377 9296 raft_consensus.cc:2468] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:26.662477 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6d6e5f5227974610b686e23da5501f4a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.662927 9302 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82575517299b4e69a0871714dde9aacc" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.663236 9302 raft_consensus.cc:2393] T 82575517299b4e69a0871714dde9aacc P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
W20251215 14:55:26.663305 9249 leader_election.cc:343] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.663717 9249 leader_election.cc:304] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:26.664242 9309 raft_consensus.cc:1275] T 49bba2b78f65470182e1d361eb1272a4 P e89303a500544272b601d7c29be802b4 [term 2 FOLLOWER]: Refusing update from remote peer 67978ac4539d4b289e53f4eedd9a8156: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 14:55:26.664283 11038 raft_consensus.cc:2804] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.664426 11038 raft_consensus.cc:493] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.664541 11038 raft_consensus.cc:3060] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.667088 9310 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6084ebf2a804bfc9d2c2cde3e0cba98" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.667403 9310 raft_consensus.cc:2468] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:26.667832 9427 tablet_bootstrap.cc:492] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.667994 9427 ts_tablet_manager.cc:1403] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.009s
I20251215 14:55:26.668949 9427 raft_consensus.cc:359] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.669131 9427 raft_consensus.cc:385] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.669188 9427 raft_consensus.cc:740] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.669400 9427 consensus_queue.cc:260] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.669945 9427 ts_tablet_manager.cc:1434] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:26.670245 9427 tablet_bootstrap.cc:492] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.675259 11552 consensus_queue.cc:1048] T 5c025355716a43569a1bebb46de7dd93 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:26.676563 8976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 136174us
I20251215 14:55:26.681607 8976 leader_election.cc:304] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:26.685683 11038 raft_consensus.cc:515] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.686342 11038 leader_election.cc:290] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.687055 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "41e0d694b1af46b19138ccbffea96f28" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:26.687381 9180 raft_consensus.cc:3060] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.690275 9426 tablet_bootstrap.cc:492] T 5e5c1626a30444bf987a7d7e09a586f7 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:26.690290 9435 tablet_bootstrap.cc:492] T 37554f8c1a90462095c511f00df6dece P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:26.690420 9435 ts_tablet_manager.cc:1403] T 37554f8c1a90462095c511f00df6dece P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.058s user 0.006s sys 0.003s
I20251215 14:55:26.691135 9435 raft_consensus.cc:359] T 37554f8c1a90462095c511f00df6dece P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.691354 9435 raft_consensus.cc:385] T 37554f8c1a90462095c511f00df6dece P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.691443 9435 raft_consensus.cc:740] T 37554f8c1a90462095c511f00df6dece P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.691635 9435 consensus_queue.cc:260] T 37554f8c1a90462095c511f00df6dece P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.691975 9426 tablet_bootstrap.cc:654] T 5e5c1626a30444bf987a7d7e09a586f7 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.692166 9435 ts_tablet_manager.cc:1434] T 37554f8c1a90462095c511f00df6dece P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251215 14:55:26.692505 9435 tablet_bootstrap.cc:492] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:26.694176 9435 tablet_bootstrap.cc:654] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.694697 10991 leader_election.cc:290] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.700785 9180 raft_consensus.cc:2468] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:26.707669 9249 leader_election.cc:304] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:26.708091 11038 raft_consensus.cc:2804] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.708357 11038 raft_consensus.cc:697] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:26.708894 11038 consensus_queue.cc:237] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.709431 9426 tablet_bootstrap.cc:492] T 5e5c1626a30444bf987a7d7e09a586f7 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:26.709597 9426 ts_tablet_manager.cc:1403] T 5e5c1626a30444bf987a7d7e09a586f7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.010s
I20251215 14:55:26.710345 9426 raft_consensus.cc:359] T 5e5c1626a30444bf987a7d7e09a586f7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.710538 9426 raft_consensus.cc:385] T 5e5c1626a30444bf987a7d7e09a586f7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.710640 9426 raft_consensus.cc:740] T 5e5c1626a30444bf987a7d7e09a586f7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.711220 9426 consensus_queue.cc:260] T 5e5c1626a30444bf987a7d7e09a586f7 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.712078 9426 ts_tablet_manager.cc:1434] T 5e5c1626a30444bf987a7d7e09a586f7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:26.712378 9426 tablet_bootstrap.cc:492] T 5bd1578d434047158b6fbce7c24daebb P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:26.713284 9435 tablet_bootstrap.cc:492] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:26.714133 9426 tablet_bootstrap.cc:654] T 5bd1578d434047158b6fbce7c24daebb P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.714551 9435 ts_tablet_manager.cc:1403] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.002s
I20251215 14:55:26.715823 9435 raft_consensus.cc:359] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
W20251215 14:55:26.718611 9115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 44528.9us
I20251215 14:55:26.718905 9115 leader_election.cc:304] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters: 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.720119 11552 raft_consensus.cc:2804] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.720288 11552 raft_consensus.cc:493] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.720459 11552 raft_consensus.cc:3060] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.722841 11590 raft_consensus.cc:2804] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.722957 11590 raft_consensus.cc:697] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:26.723224 11590 consensus_queue.cc:237] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.716969 11473 raft_consensus.cc:493] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.727264 9435 raft_consensus.cc:385] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.727353 9435 raft_consensus.cc:740] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.727332 11473 raft_consensus.cc:515] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.727891 11473 leader_election.cc:290] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.722667 11484 consensus_queue.cc:1048] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.689028 9427 tablet_bootstrap.cc:654] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.699121 9033 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "caefb83a990e4ad2baf621cd83265f96" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.699820 9032 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18c0b2442bcd4fb69d7d9a4f5fb46061" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.699851 11588 raft_consensus.cc:493] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.710947 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78c65aae2561484ebbd68d0a0475b27d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.728365 9032 raft_consensus.cc:2468] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:26.728399 9435 consensus_queue.cc:260] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.728466 9028 raft_consensus.cc:2468] T 78c65aae2561484ebbd68d0a0475b27d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:26.728379 11588 raft_consensus.cc:515] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.725783 11610 consensus_queue.cc:1048] T 2a5b0004e03d4c068419eb00ebadf3f9 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.728924 9435 ts_tablet_manager.cc:1434] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20251215 14:55:26.726118 11480 consensus_queue.cc:1048] T 0fed3b34844e4e5b8518c0165df342d1 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.729158 11588 leader_election.cc:290] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:26.729209 9435 tablet_bootstrap.cc:492] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:26.711138 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "21437c9162f1435485dde5fca3522be1" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.729372 9025 raft_consensus.cc:2468] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:26.711215 9026 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "41e0d694b1af46b19138ccbffea96f28" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.729578 9026 raft_consensus.cc:2468] T 41e0d694b1af46b19138ccbffea96f28 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:26.726401 9248 leader_election.cc:304] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.715288 9029 raft_consensus.cc:1275] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Refusing update from remote peer e89303a500544272b601d7c29be802b4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 14:55:26.716490 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "41e0d694b1af46b19138ccbffea96f28" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.729862 9030 raft_consensus.cc:3060] T 41e0d694b1af46b19138ccbffea96f28 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.731861 11552 raft_consensus.cc:515] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.732256 9030 raft_consensus.cc:2468] T 41e0d694b1af46b19138ccbffea96f28 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:26.732407 11552 leader_election.cc:290] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.732712 11480 raft_consensus.cc:2749] T 265a8937802a4b9cbf0edaf3e2a41ba8 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.732882 9248 leader_election.cc:304] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:26.733112 11480 raft_consensus.cc:2804] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.733215 11480 raft_consensus.cc:493] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.733253 9248 leader_election.cc:304] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:26.733305 11480 raft_consensus.cc:3060] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.733485 11610 raft_consensus.cc:2804] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.733561 11610 raft_consensus.cc:493] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.733652 11610 raft_consensus.cc:3060] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.726517 11271 consensus_queue.cc:1048] T 84f036eb44a44e0597bc9af88d81a017 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.735178 8978 leader_election.cc:304] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:26.735750 11588 raft_consensus.cc:2749] T 0fed3b34844e4e5b8518c0165df342d1 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.735948 11480 raft_consensus.cc:515] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.736268 8978 leader_election.cc:304] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:26.736495 11480 leader_election.cc:290] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.735993 11610 raft_consensus.cc:515] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.737219 11588 raft_consensus.cc:2749] T 809257b3929a4c2f91132f9315752130 P 67978ac4539d4b289e53f4eedd9a8156 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 14:55:26.737267 11610 leader_election.cc:290] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.730739 9435 tablet_bootstrap.cc:654] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.736452 9248 leader_election.cc:304] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:26.738461 11610 raft_consensus.cc:2804] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.738631 11610 raft_consensus.cc:493] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.738766 11610 raft_consensus.cc:3060] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.739480 9115 leader_election.cc:304] T 39d0bab4179d4af68d2dbcd3e215873e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:26.740355 11398 raft_consensus.cc:3060] T 39d0bab4179d4af68d2dbcd3e215873e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.740581 11380 consensus_queue.cc:1048] T 84477b0a4bd14522908cc28e7015e4f9 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.742257 11610 raft_consensus.cc:515] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.742698 8978 leader_election.cc:304] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:26.742895 11610 leader_election.cc:290] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.744611 11480 consensus_queue.cc:1048] T d20ffd43dce84ffe8c770053e5705cbd P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.745385 11588 raft_consensus.cc:2749] T a723f46302f34465a214714e98e47de7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:26.745929 9248 leader_election.cc:343] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.746294 9248 leader_election.cc:304] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.746616 11480 raft_consensus.cc:2749] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:26.746979 9248 leader_election.cc:343] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.747187 9248 leader_election.cc:304] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.747188 11588 consensus_queue.cc:1048] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.747505 11480 raft_consensus.cc:2749] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.747864 9248 leader_election.cc:304] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.748114 11480 raft_consensus.cc:2749] T 96a1de7ce5f64f348585926ac05ddb87 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.748234 8978 leader_election.cc:304] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:26.748939 9427 tablet_bootstrap.cc:492] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.749218 9427 ts_tablet_manager.cc:1403] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.079s user 0.005s sys 0.001s
I20251215 14:55:26.749779 11588 raft_consensus.cc:2804] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.749845 11588 raft_consensus.cc:493] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.749894 11588 raft_consensus.cc:3060] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.750401 11480 consensus_queue.cc:1048] T 43e9cfdc89b04781b7b5892af07307af P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.752470 11588 raft_consensus.cc:515] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.753065 11588 leader_election.cc:290] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:26.753741 9427 raft_consensus.cc:359] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.753779 11480 consensus_queue.cc:1048] T 6a7a401d5386499183b6560411f593b6 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.753988 9427 raft_consensus.cc:385] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.754055 9427 raft_consensus.cc:740] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.754253 9427 consensus_queue.cc:260] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.754937 9427 ts_tablet_manager.cc:1434] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20251215 14:55:26.755247 9427 tablet_bootstrap.cc:492] T 7e8bf1cdbf2a48f59945268887cc5a2b P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:26.756263 9248 leader_election.cc:343] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.756773 9248 leader_election.cc:304] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:26.757299 11480 raft_consensus.cc:2749] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.757761 9248 leader_election.cc:304] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:26.759117 11480 raft_consensus.cc:2804] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.759284 11480 raft_consensus.cc:493] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.759428 11480 raft_consensus.cc:3060] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.760625 9427 tablet_bootstrap.cc:654] T 7e8bf1cdbf2a48f59945268887cc5a2b P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.761603 9426 tablet_bootstrap.cc:492] T 5bd1578d434047158b6fbce7c24daebb P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
W20251215 14:55:26.762954 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet eb309f7c439740c89470da5636523a69 (table default.Table_1b528fe70b3e4803a17a4755e2a7cc86 [id=40b600a183744fa992c73142cd90120b], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet eb309f7c439740c89470da5636523a69 consensus state has no leader
I20251215 14:55:26.763218 11608 raft_consensus.cc:493] T c4929bdb04914251b75a11d6936f1ee0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.763759 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a4767a5965244afac42190f97f0a113" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.763935 11480 raft_consensus.cc:515] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.764693 11480 leader_election.cc:290] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.764987 11398 raft_consensus.cc:2749] T 39d0bab4179d4af68d2dbcd3e215873e P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.765404 9248 leader_election.cc:304] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:26.766700 9248 leader_election.cc:304] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:26.767645 8976 leader_election.cc:304] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:26.766917 11480 raft_consensus.cc:2804] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.768657 11588 raft_consensus.cc:2749] T 86f18ff40af547da85de8966b12f76f4 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.768419 9435 tablet_bootstrap.cc:492] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:26.769295 9435 ts_tablet_manager.cc:1403] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.001s
I20251215 14:55:26.769896 11480 raft_consensus.cc:493] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.770082 11480 raft_consensus.cc:3060] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.771397 9427 tablet_bootstrap.cc:492] T 7e8bf1cdbf2a48f59945268887cc5a2b P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.771757 9427 ts_tablet_manager.cc:1403] T 7e8bf1cdbf2a48f59945268887cc5a2b P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.000s
I20251215 14:55:26.772797 11480 raft_consensus.cc:515] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.774401 9180 raft_consensus.cc:2468] T 3a4767a5965244afac42190f97f0a113 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:26.774739 9426 ts_tablet_manager.cc:1403] T 5bd1578d434047158b6fbce7c24daebb P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.001s
I20251215 14:55:26.775815 9426 raft_consensus.cc:359] T 5bd1578d434047158b6fbce7c24daebb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.773801 11174 raft_consensus.cc:2804] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.778225 11174 raft_consensus.cc:493] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.778380 11174 raft_consensus.cc:3060] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.780656 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a4767a5965244afac42190f97f0a113" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.780844 9025 raft_consensus.cc:2468] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:26.781183 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4929bdb04914251b75a11d6936f1ee0" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.781318 9037 raft_consensus.cc:3060] T c4929bdb04914251b75a11d6936f1ee0 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.782341 9038 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18c0b2442bcd4fb69d7d9a4f5fb46061" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.782488 9038 raft_consensus.cc:3060] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.783347 9035 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf18d0368ee948a38d35ec47b732f6cc" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.784282 9035 raft_consensus.cc:3060] T cf18d0368ee948a38d35ec47b732f6cc P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.784916 9038 raft_consensus.cc:2468] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:26.786142 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f49d57104554c91a13229d3940cd4d2" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.786307 9027 raft_consensus.cc:3060] T 4f49d57104554c91a13229d3940cd4d2 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.789438 9027 raft_consensus.cc:2468] T 4f49d57104554c91a13229d3940cd4d2 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:26.792865 11174 raft_consensus.cc:515] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.793674 11174 leader_election.cc:290] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.776221 11610 consensus_queue.cc:1048] T 809257b3929a4c2f91132f9315752130 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.776871 9249 leader_election.cc:304] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:26.778101 9361 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:26.795228 11610 raft_consensus.cc:2804] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.795342 11610 raft_consensus.cc:493] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.795428 11610 raft_consensus.cc:3060] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.797909 11610 raft_consensus.cc:515] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.798779 11610 leader_election.cc:290] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.774196 9435 raft_consensus.cc:359] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.799233 9435 raft_consensus.cc:385] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.799386 9435 raft_consensus.cc:740] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.799652 9435 consensus_queue.cc:260] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.800148 9435 ts_tablet_manager.cc:1434] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.031s user 0.002s sys 0.000s
I20251215 14:55:26.800504 9435 tablet_bootstrap.cc:492] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:26.802387 9435 tablet_bootstrap.cc:654] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.792762 9037 raft_consensus.cc:2468] T c4929bdb04914251b75a11d6936f1ee0 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:26.793035 9035 raft_consensus.cc:2468] T cf18d0368ee948a38d35ec47b732f6cc P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:26.802932 11590 raft_consensus.cc:493] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.806282 11590 raft_consensus.cc:515] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.806514 11480 leader_election.cc:290] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.806880 11590 leader_election.cc:290] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:26.808583 9035 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "21437c9162f1435485dde5fca3522be1" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.808775 9035 raft_consensus.cc:3060] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.809616 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a4767a5965244afac42190f97f0a113" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.809819 9027 raft_consensus.cc:3060] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.811815 9035 raft_consensus.cc:2468] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:26.812913 9027 raft_consensus.cc:2468] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:26.815536 11271 raft_consensus.cc:493] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.815714 11271 raft_consensus.cc:515] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.815821 9035 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78c65aae2561484ebbd68d0a0475b27d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.816078 9035 raft_consensus.cc:3060] T 78c65aae2561484ebbd68d0a0475b27d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.816309 11271 leader_election.cc:290] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.816462 11271 raft_consensus.cc:493] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.816620 11271 raft_consensus.cc:515] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.817142 11271 leader_election.cc:290] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
W20251215 14:55:26.818709 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 49111.9us
W20251215 14:55:26.820106 8976 leader_election.cc:343] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.822958 11174 raft_consensus.cc:493] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.823110 11174 raft_consensus.cc:515] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.823913 11174 leader_election.cc:290] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.824185 8978 leader_election.cc:304] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:26.824687 11669 raft_consensus.cc:2804] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.824782 11669 raft_consensus.cc:493] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.824916 11669 raft_consensus.cc:3060] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.824990 9248 leader_election.cc:304] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:26.824889 8978 leader_election.cc:304] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:26.825403 11708 raft_consensus.cc:2804] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.825524 11708 raft_consensus.cc:493] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.825650 11708 raft_consensus.cc:3060] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.826836 11679 consensus_queue.cc:1048] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.827613 11271 raft_consensus.cc:2804] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.827767 11271 raft_consensus.cc:697] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:26.827497 11669 raft_consensus.cc:515] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.828047 11271 consensus_queue.cc:237] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.828559 11669 leader_election.cc:290] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:26.830246 8978 leader_election.cc:304] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:26.831435 9035 raft_consensus.cc:2468] T 78c65aae2561484ebbd68d0a0475b27d P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:26.832731 11679 raft_consensus.cc:2804] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:26.833021 11679 raft_consensus.cc:493] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:26.833231 11679 raft_consensus.cc:3060] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.838115 11588 consensus_queue.cc:1048] T 4e1472ce5a464a12a711d513446abe2a P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.838434 9427 raft_consensus.cc:359] T 7e8bf1cdbf2a48f59945268887cc5a2b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.838603 9427 raft_consensus.cc:385] T 7e8bf1cdbf2a48f59945268887cc5a2b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.838703 9427 raft_consensus.cc:740] T 7e8bf1cdbf2a48f59945268887cc5a2b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.838901 9427 consensus_queue.cc:260] T 7e8bf1cdbf2a48f59945268887cc5a2b P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.840121 9427 ts_tablet_manager.cc:1434] T 7e8bf1cdbf2a48f59945268887cc5a2b P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.068s user 0.001s sys 0.001s
I20251215 14:55:26.840430 9427 tablet_bootstrap.cc:492] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.841305 8976 leader_election.cc:304] T 52e93348b205408f83efff27fde48e9b P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:26.843283 11669 raft_consensus.cc:3060] T 52e93348b205408f83efff27fde48e9b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:26.854722 8976 leader_election.cc:343] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.858111 8976 leader_election.cc:304] T 82575517299b4e69a0871714dde9aacc P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:26.859958 11174 consensus_queue.cc:1048] T a723f46302f34465a214714e98e47de7 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:26.860481 11174 raft_consensus.cc:493] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.860630 11174 raft_consensus.cc:515] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.861248 11174 leader_election.cc:290] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.861521 9248 leader_election.cc:304] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:26.861783 9248 leader_election.cc:304] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:26.862021 11271 raft_consensus.cc:2804] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.862166 11271 raft_consensus.cc:697] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:26.862438 11271 consensus_queue.cc:237] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.862190 8976 leader_election.cc:304] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:26.863646 11706 raft_consensus.cc:2749] T 6d6e5f5227974610b686e23da5501f4a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.864266 11484 raft_consensus.cc:2804] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.864414 11484 raft_consensus.cc:697] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:26.864652 11484 consensus_queue.cc:237] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.872798 9435 tablet_bootstrap.cc:492] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:26.872998 9435 ts_tablet_manager.cc:1403] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.073s user 0.005s sys 0.000s
I20251215 14:55:26.873808 9435 raft_consensus.cc:359] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.874121 9435 raft_consensus.cc:385] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.874203 9435 raft_consensus.cc:740] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.874403 9435 consensus_queue.cc:260] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.877604 11669 raft_consensus.cc:2749] T 52e93348b205408f83efff27fde48e9b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.877722 11679 raft_consensus.cc:515] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.878311 11679 leader_election.cc:290] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:26.880491 9248 leader_election.cc:304] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:26.883250 11707 raft_consensus.cc:2749] T 82575517299b4e69a0871714dde9aacc P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:26.884572 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78c65aae2561484ebbd68d0a0475b27d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.884811 9028 raft_consensus.cc:2393] T 78c65aae2561484ebbd68d0a0475b27d P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:26.886059 9427 tablet_bootstrap.cc:654] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.888214 9426 raft_consensus.cc:385] T 5bd1578d434047158b6fbce7c24daebb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.888365 9426 raft_consensus.cc:740] T 5bd1578d434047158b6fbce7c24daebb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.888386 11664 raft_consensus.cc:493] T cf18d0368ee948a38d35ec47b732f6cc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.888554 11664 raft_consensus.cc:515] T cf18d0368ee948a38d35ec47b732f6cc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.888592 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4929bdb04914251b75a11d6936f1ee0" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:26.888626 9426 consensus_queue.cc:260] T 5bd1578d434047158b6fbce7c24daebb P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.888700 11398 raft_consensus.cc:493] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.888396 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18c0b2442bcd4fb69d7d9a4f5fb46061" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:26.903679 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf18d0368ee948a38d35ec47b732f6cc" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:26.903971 9171 raft_consensus.cc:3060] T cf18d0368ee948a38d35ec47b732f6cc P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.906322 9037 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "41e0d694b1af46b19138ccbffea96f28" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.906562 9037 raft_consensus.cc:2393] T 41e0d694b1af46b19138ccbffea96f28 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:26.906536 9171 raft_consensus.cc:2468] T cf18d0368ee948a38d35ec47b732f6cc P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:26.906716 11708 raft_consensus.cc:515] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:26.906898 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f49d57104554c91a13229d3940cd4d2" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:26.907862 11708 leader_election.cc:290] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:26.907922 11608 raft_consensus.cc:515] T c4929bdb04914251b75a11d6936f1ee0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.909389 11398 raft_consensus.cc:515] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.916031 9248 leader_election.cc:304] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:26.916147 11610 raft_consensus.cc:2804] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.916332 11610 raft_consensus.cc:697] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:26.916713 9170 raft_consensus.cc:3060] T 4f49d57104554c91a13229d3940cd4d2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.916659 11610 consensus_queue.cc:237] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.918138 11610 raft_consensus.cc:2804] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.918334 11610 raft_consensus.cc:697] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:26.918604 11610 consensus_queue.cc:237] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.919245 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "21437c9162f1435485dde5fca3522be1" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:26.919605 11664 leader_election.cc:290] T cf18d0368ee948a38d35ec47b732f6cc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.919992 9248 leader_election.cc:304] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:26.920257 11610 raft_consensus.cc:2804] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.920372 11610 raft_consensus.cc:697] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:26.920507 9175 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "666af680888c4b3c81187d0195684bc7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.920727 11610 consensus_queue.cc:237] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.922518 9248 leader_election.cc:304] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:26.922842 11174 raft_consensus.cc:2804] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:26.923084 11174 raft_consensus.cc:697] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:26.923396 11174 consensus_queue.cc:237] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.929694 9435 ts_tablet_manager.cc:1434] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.057s user 0.003s sys 0.000s
I20251215 14:55:26.930078 9435 tablet_bootstrap.cc:492] T 95b78c1518f1481794948f2db1055f38 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:26.931905 9435 tablet_bootstrap.cc:654] T 95b78c1518f1481794948f2db1055f38 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:26.932226 9180 raft_consensus.cc:3060] T c4929bdb04914251b75a11d6936f1ee0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.912334 9032 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6084ebf2a804bfc9d2c2cde3e0cba98" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:26.938407 9032 raft_consensus.cc:2393] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:26.932862 9033 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ca89ec0fe3647ad9c3e62d16640bb20" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.938903 9033 raft_consensus.cc:2468] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:26.939647 9033 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e8bf1cdbf2a48f59945268887cc5a2b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.940047 9033 raft_consensus.cc:2468] T 7e8bf1cdbf2a48f59945268887cc5a2b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:26.940945 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "666af680888c4b3c81187d0195684bc7" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.946125 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de5ba7f2b5c84ac39e4019a0b9532176" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:26.951639 11398 leader_election.cc:290] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.952324 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a4767a5965244afac42190f97f0a113" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:26.952951 11590 raft_consensus.cc:493] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:26.953284 9170 raft_consensus.cc:2468] T 4f49d57104554c91a13229d3940cd4d2 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:26.953262 11590 raft_consensus.cc:515] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.953857 11590 leader_election.cc:290] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:26.953938 9427 tablet_bootstrap.cc:492] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:26.954157 9427 ts_tablet_manager.cc:1403] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.114s user 0.002s sys 0.002s
I20251215 14:55:26.954697 9178 raft_consensus.cc:3060] T 3a4767a5965244afac42190f97f0a113 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.957075 9178 raft_consensus.cc:2468] T 3a4767a5965244afac42190f97f0a113 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:26.953526 11608 leader_election.cc:290] T c4929bdb04914251b75a11d6936f1ee0 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:26.965018 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e8bf1cdbf2a48f59945268887cc5a2b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.965152 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78c65aae2561484ebbd68d0a0475b27d" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:26.958423 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ca89ec0fe3647ad9c3e62d16640bb20" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:26.966636 9177 raft_consensus.cc:2393] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:26.979123 9426 ts_tablet_manager.cc:1434] T 5bd1578d434047158b6fbce7c24daebb P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.192s user 0.000s sys 0.011s
I20251215 14:55:26.981001 9427 raft_consensus.cc:359] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.981307 9427 raft_consensus.cc:385] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:26.981410 9427 raft_consensus.cc:740] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:26.981688 9427 consensus_queue.cc:260] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:26.982221 9427 ts_tablet_manager.cc:1434] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s
I20251215 14:55:26.982538 9427 tablet_bootstrap.cc:492] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:26.987818 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de5ba7f2b5c84ac39e4019a0b9532176" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:26.971312 9249 leader_election.cc:343] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.974170 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84f036eb44a44e0597bc9af88d81a017" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.974411 9298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a4767a5965244afac42190f97f0a113" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.975175 9315 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9a4c7bd7d0984ef788fe2c0504058c37" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:26.975224 9305 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bd1578d434047158b6fbce7c24daebb" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
W20251215 14:55:26.988655 9249 leader_election.cc:343] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.988705 9305 raft_consensus.cc:3060] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.988667 9315 raft_consensus.cc:3060] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:26.989004 9249 leader_election.cc:343] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:26.989773 9249 leader_election.cc:343] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:26.990059 9249 leader_election.cc:343] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:26.991838 9305 raft_consensus.cc:2468] T 5bd1578d434047158b6fbce7c24daebb P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:26.975696 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ea937af02b447e6a78cda0741cc8570" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.992141 9313 raft_consensus.cc:2468] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:26.992337 9315 raft_consensus.cc:2468] T 9a4c7bd7d0984ef788fe2c0504058c37 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:26.977728 9314 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "90c7925890474a76b35a3ce5e6db8ebf" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:26.993057 9314 raft_consensus.cc:3060] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.995812 9314 raft_consensus.cc:2468] T 90c7925890474a76b35a3ce5e6db8ebf P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:26.977895 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "21437c9162f1435485dde5fca3522be1" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:26.976497 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6084ebf2a804bfc9d2c2cde3e0cba98" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:26.996325 9312 raft_consensus.cc:3060] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:26.999142 9312 raft_consensus.cc:2468] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:27.001154 9180 raft_consensus.cc:2468] T c4929bdb04914251b75a11d6936f1ee0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:27.008173 9426 tablet_bootstrap.cc:492] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:27.008790 9427 tablet_bootstrap.cc:654] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:27.009794 9112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.129:35891, user_credentials={real_user=slave}} blocked reactor thread for 111977us
I20251215 14:55:27.011970 9033 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4929bdb04914251b75a11d6936f1ee0" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:27.012434 9034 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf18d0368ee948a38d35ec47b732f6cc" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:27.012593 9033 raft_consensus.cc:2393] T c4929bdb04914251b75a11d6936f1ee0 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:27.012701 9034 raft_consensus.cc:2393] T cf18d0368ee948a38d35ec47b732f6cc P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:27.012303 9035 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d064a85455844115899b3de91a2313f5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:27.013569 9035 raft_consensus.cc:2468] T d064a85455844115899b3de91a2313f5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:27.021432 9427 tablet_bootstrap.cc:492] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
W20251215 14:55:27.021411 9249 leader_election.cc:343] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.021620 9427 ts_tablet_manager.cc:1403] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.039s user 0.003s sys 0.000s
I20251215 14:55:27.022493 9427 raft_consensus.cc:359] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.022714 9427 raft_consensus.cc:385] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.022823 9427 raft_consensus.cc:740] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.023092 9427 consensus_queue.cc:260] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.023874 9435 tablet_bootstrap.cc:492] T 95b78c1518f1481794948f2db1055f38 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:27.024014 9435 ts_tablet_manager.cc:1403] T 95b78c1518f1481794948f2db1055f38 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.094s user 0.004s sys 0.000s
I20251215 14:55:27.024775 9435 raft_consensus.cc:359] T 95b78c1518f1481794948f2db1055f38 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.024976 9435 raft_consensus.cc:385] T 95b78c1518f1481794948f2db1055f38 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.025061 9435 raft_consensus.cc:740] T 95b78c1518f1481794948f2db1055f38 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
W20251215 14:55:27.025561 9115 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 252783us
I20251215 14:55:27.026731 9427 ts_tablet_manager.cc:1434] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:27.029196 9427 tablet_bootstrap.cc:492] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.030009 11608 consensus_queue.cc:1048] T be4393dc706f45a89b9b2c9727cd7726 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 14:55:27.031064 11380 consensus_queue.cc:1048] T a71d029bbd88416da1dbcad09dc93115 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.032306 11738 consensus_queue.cc:1048] T 82575517299b4e69a0871714dde9aacc P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251215 14:55:27.035790 11699 consensus_queue.cc:1048] T 7a29174caad24ebc9d26b4169085dc08 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.037595 9427 tablet_bootstrap.cc:654] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.039876 9312 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e5c1626a30444bf987a7d7e09a586f7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:27.040130 9312 raft_consensus.cc:2468] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:27.041314 11271 consensus_queue.cc:1048] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.042169 9112 leader_election.cc:304] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:27.042395 9435 consensus_queue.cc:260] T 95b78c1518f1481794948f2db1055f38 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.042892 11699 raft_consensus.cc:2804] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:27.043007 11699 raft_consensus.cc:493] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:27.043110 11699 raft_consensus.cc:3060] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.043237 9435 ts_tablet_manager.cc:1434] T 95b78c1518f1481794948f2db1055f38 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s
I20251215 14:55:27.043515 9435 tablet_bootstrap.cc:492] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:27.045037 9435 tablet_bootstrap.cc:654] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.046136 11699 raft_consensus.cc:515] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.046712 11699 leader_election.cc:290] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:27.061648 11283 raft_consensus.cc:493] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.062592 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d064a85455844115899b3de91a2313f5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:27.062599 11283 raft_consensus.cc:515] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.062932 9028 raft_consensus.cc:3060] T d064a85455844115899b3de91a2313f5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.063268 11283 leader_election.cc:290] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.066069 9028 raft_consensus.cc:2468] T d064a85455844115899b3de91a2313f5 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:27.071091 9299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78c65aae2561484ebbd68d0a0475b27d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:27.072631 11611 consensus_queue.cc:1048] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.074993 9301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "78c65aae2561484ebbd68d0a0475b27d" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:27.076725 9313 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "41e0d694b1af46b19138ccbffea96f28" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:27.077986 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6084ebf2a804bfc9d2c2cde3e0cba98" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:27.078166 9303 raft_consensus.cc:2393] T e6084ebf2a804bfc9d2c2cde3e0cba98 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:27.078955 9297 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf18d0368ee948a38d35ec47b732f6cc" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:27.079452 9310 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c4929bdb04914251b75a11d6936f1ee0" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:27.079752 9309 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d064a85455844115899b3de91a2313f5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:27.079890 9309 raft_consensus.cc:2468] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:27.081418 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2b686ad43973448c8e24230d7d1d7250" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:27.081559 9308 raft_consensus.cc:3060] T 2b686ad43973448c8e24230d7d1d7250 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.084156 9308 raft_consensus.cc:2468] T 2b686ad43973448c8e24230d7d1d7250 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:27.086248 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d064a85455844115899b3de91a2313f5" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:27.103226 9304 raft_consensus.cc:3060] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.105249 9435 tablet_bootstrap.cc:492] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:27.105392 9435 ts_tablet_manager.cc:1403] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.062s user 0.004s sys 0.000s
I20251215 14:55:27.106096 9435 raft_consensus.cc:359] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.106276 9435 raft_consensus.cc:385] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.106325 9435 raft_consensus.cc:740] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.106112 9304 raft_consensus.cc:2468] T d064a85455844115899b3de91a2313f5 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:27.106516 9435 consensus_queue.cc:260] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.107458 9435 ts_tablet_manager.cc:1434] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:27.107741 9435 tablet_bootstrap.cc:492] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:27.109419 9435 tablet_bootstrap.cc:654] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:27.112979 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 55700.6us
I20251215 14:55:27.117586 9426 tablet_bootstrap.cc:654] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:27.119321 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:27.119608 9112 leader_election.cc:304] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:27.120745 11552 raft_consensus.cc:2804] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.131278 11552 raft_consensus.cc:697] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:27.131654 11552 consensus_queue.cc:237] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.132930 11735 consensus_queue.cc:1048] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.142519 9435 tablet_bootstrap.cc:492] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:27.142674 9435 ts_tablet_manager.cc:1403] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.035s user 0.004s sys 0.002s
I20251215 14:55:27.149155 9435 raft_consensus.cc:359] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.149338 9435 raft_consensus.cc:385] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.149389 9435 raft_consensus.cc:740] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.149560 9435 consensus_queue.cc:260] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.150027 9435 ts_tablet_manager.cc:1434] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20251215 14:55:27.150292 9435 tablet_bootstrap.cc:492] T b34a860bf4244586948ae9eafe35103a P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:27.155227 9427 tablet_bootstrap.cc:492] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.155365 9427 ts_tablet_manager.cc:1403] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.128s user 0.002s sys 0.011s
I20251215 14:55:27.156090 9427 raft_consensus.cc:359] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.156277 9427 raft_consensus.cc:385] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.156316 11283 raft_consensus.cc:493] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.156337 9427 raft_consensus.cc:740] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.156406 11283 raft_consensus.cc:515] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.156535 9427 consensus_queue.cc:260] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.156925 11283 leader_election.cc:290] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.156985 9427 ts_tablet_manager.cc:1434] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251215 14:55:27.157227 9427 tablet_bootstrap.cc:492] T 5875cdedb77841359158f7f185ee30f6 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.158788 9427 tablet_bootstrap.cc:654] T 5875cdedb77841359158f7f185ee30f6 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.162230 9435 tablet_bootstrap.cc:654] T b34a860bf4244586948ae9eafe35103a P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.166939 8978 leader_election.cc:304] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.172230 11745 raft_consensus.cc:2804] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.172472 11745 raft_consensus.cc:697] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:27.172768 11745 consensus_queue.cc:237] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.176008 9426 tablet_bootstrap.cc:492] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:27.176183 9426 ts_tablet_manager.cc:1403] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.196s user 0.003s sys 0.001s
I20251215 14:55:27.176963 9426 raft_consensus.cc:359] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.177452 9426 raft_consensus.cc:385] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.177523 9426 raft_consensus.cc:740] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.177697 9426 consensus_queue.cc:260] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.178987 8978 leader_election.cc:304] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.178853 9426 ts_tablet_manager.cc:1434] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20251215 14:55:27.179522 11283 raft_consensus.cc:2804] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:27.179602 11283 raft_consensus.cc:493] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:27.179661 11283 raft_consensus.cc:3060] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.182480 11283 raft_consensus.cc:515] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.183449 11283 leader_election.cc:290] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.184603 8978 leader_election.cc:304] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.184859 11283 raft_consensus.cc:2804] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.185074 11283 raft_consensus.cc:697] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:27.185333 11283 consensus_queue.cc:237] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.190475 9435 tablet_bootstrap.cc:492] T b34a860bf4244586948ae9eafe35103a P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:27.190605 9435 ts_tablet_manager.cc:1403] T b34a860bf4244586948ae9eafe35103a P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20251215 14:55:27.191273 9435 raft_consensus.cc:359] T b34a860bf4244586948ae9eafe35103a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.191413 9435 raft_consensus.cc:385] T b34a860bf4244586948ae9eafe35103a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.191452 9435 raft_consensus.cc:740] T b34a860bf4244586948ae9eafe35103a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.191588 9435 consensus_queue.cc:260] T b34a860bf4244586948ae9eafe35103a P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.192286 9435 ts_tablet_manager.cc:1434] T b34a860bf4244586948ae9eafe35103a P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:27.192536 9435 tablet_bootstrap.cc:492] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:27.194240 9435 tablet_bootstrap.cc:654] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.189500 9248 leader_election.cc:304] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:27.195107 11038 raft_consensus.cc:2804] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:27.195196 11038 raft_consensus.cc:493] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:27.195257 11038 raft_consensus.cc:3060] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.195433 8978 leader_election.cc:304] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.195883 11706 raft_consensus.cc:2804] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.196000 11706 raft_consensus.cc:697] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:27.196219 11706 consensus_queue.cc:237] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:27.197712 11038 raft_consensus.cc:515] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.200577 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ca89ec0fe3647ad9c3e62d16640bb20" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:27.201117 9249 leader_election.cc:343] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.201440 11038 leader_election.cc:290] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:27.201846 9248 leader_election.cc:304] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:27.202379 11174 raft_consensus.cc:2804] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:27.202476 11174 raft_consensus.cc:493] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:27.202541 11174 raft_consensus.cc:3060] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.204968 11174 raft_consensus.cc:515] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.205534 11174 leader_election.cc:290] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:27.206367 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e8bf1cdbf2a48f59945268887cc5a2b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:27.206615 8978 leader_election.cc:304] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:27.206851 9249 leader_election.cc:343] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.206902 11166 raft_consensus.cc:2804] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.207011 11166 raft_consensus.cc:697] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:27.207266 11166 consensus_queue.cc:237] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:55:27.207738 9248 leader_election.cc:343] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.207835 9248 leader_election.cc:304] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:27.208057 11610 raft_consensus.cc:2749] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:27.213696 9248 leader_election.cc:343] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.213867 9248 leader_election.cc:304] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:27.214100 11610 raft_consensus.cc:2749] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:27.226934 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e8bf1cdbf2a48f59945268887cc5a2b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:27.227130 9042 raft_consensus.cc:3060] T 7e8bf1cdbf2a48f59945268887cc5a2b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.227380 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ca89ec0fe3647ad9c3e62d16640bb20" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:27.227558 9025 raft_consensus.cc:3060] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.228916 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "84f036eb44a44e0597bc9af88d81a017" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:27.229514 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3a4767a5965244afac42190f97f0a113" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:27.229679 9179 raft_consensus.cc:2393] T 3a4767a5965244afac42190f97f0a113 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:27.229738 9042 raft_consensus.cc:2468] T 7e8bf1cdbf2a48f59945268887cc5a2b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:27.230101 9025 raft_consensus.cc:2468] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:27.230225 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "21437c9162f1435485dde5fca3522be1" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:27.231441 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bd1578d434047158b6fbce7c24daebb" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:27.231585 9179 raft_consensus.cc:3060] T 5bd1578d434047158b6fbce7c24daebb P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.237757 9179 raft_consensus.cc:2468] T 5bd1578d434047158b6fbce7c24daebb P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:27.243233 11699 raft_consensus.cc:493] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.243449 11699 raft_consensus.cc:515] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.242101 9296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7bacba021777416e9c547469aa08bd9c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:27.242269 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "02e391ec04cf44c881f31d0ba53af2e9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:27.243700 9296 raft_consensus.cc:2468] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:27.243706 9300 raft_consensus.cc:2468] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:27.244202 11699 leader_election.cc:290] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:27.250878 11610 consensus_queue.cc:1048] T 39d0bab4179d4af68d2dbcd3e215873e P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.253123 11610 consensus_queue.cc:1048] T 1dde4fcdf3104154936f70977e5378bd P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.253731 9248 leader_election.cc:304] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:27.254022 11610 raft_consensus.cc:2804] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.254173 11610 raft_consensus.cc:697] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:27.254443 11610 consensus_queue.cc:237] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.258854 9248 leader_election.cc:304] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:27.260026 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ea937af02b447e6a78cda0741cc8570" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:27.260207 9170 raft_consensus.cc:2468] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:27.260906 11038 raft_consensus.cc:2804] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.261020 11038 raft_consensus.cc:697] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:27.261243 11038 consensus_queue.cc:237] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.261835 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9a4c7bd7d0984ef788fe2c0504058c37" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:27.261967 9170 raft_consensus.cc:3060] T 9a4c7bd7d0984ef788fe2c0504058c37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.264484 9170 raft_consensus.cc:2468] T 9a4c7bd7d0984ef788fe2c0504058c37 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:27.268512 8978 leader_election.cc:304] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.268738 11588 raft_consensus.cc:2804] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:27.268800 11588 raft_consensus.cc:493] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:27.268862 11588 raft_consensus.cc:3060] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.268941 11691 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.269069 11691 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:27.269842 11691 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.271579 11588 raft_consensus.cc:515] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.272445 11588 leader_election.cc:290] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.284651 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6084ebf2a804bfc9d2c2cde3e0cba98" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:27.284901 9180 raft_consensus.cc:2393] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate 3ea5306c36594ef4a62211f2bd6669a3 in this term.
I20251215 14:55:27.289646 9170 raft_consensus.cc:1275] T 49bba2b78f65470182e1d361eb1272a4 P 3ea5306c36594ef4a62211f2bd6669a3 [term 2 FOLLOWER]: Refusing update from remote peer 67978ac4539d4b289e53f4eedd9a8156: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20251215 14:55:27.290225 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "90c7925890474a76b35a3ce5e6db8ebf" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:27.290381 9180 raft_consensus.cc:3060] T 90c7925890474a76b35a3ce5e6db8ebf P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.292800 9180 raft_consensus.cc:2468] T 90c7925890474a76b35a3ce5e6db8ebf P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:27.296748 8978 leader_election.cc:304] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.297096 8978 leader_election.cc:304] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.297837 11283 raft_consensus.cc:2804] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:27.297961 11283 raft_consensus.cc:493] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:27.298156 11283 raft_consensus.cc:3060] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.300799 11283 raft_consensus.cc:515] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.301594 11706 raft_consensus.cc:2804] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:27.301709 11706 raft_consensus.cc:493] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:27.301829 11706 raft_consensus.cc:3060] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.304402 11706 raft_consensus.cc:515] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.305243 11706 leader_election.cc:290] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.306625 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e5c1626a30444bf987a7d7e09a586f7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:27.306820 9179 raft_consensus.cc:2468] T 5e5c1626a30444bf987a7d7e09a586f7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:27.308279 9427 tablet_bootstrap.cc:492] T 5875cdedb77841359158f7f185ee30f6 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.308408 9427 ts_tablet_manager.cc:1403] T 5875cdedb77841359158f7f185ee30f6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.151s user 0.020s sys 0.029s
I20251215 14:55:27.309401 9427 raft_consensus.cc:359] T 5875cdedb77841359158f7f185ee30f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.309562 9427 raft_consensus.cc:385] T 5875cdedb77841359158f7f185ee30f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.309772 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ea937af02b447e6a78cda0741cc8570" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:27.309927 9300 raft_consensus.cc:3060] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.312387 11283 leader_election.cc:290] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.312399 9300 raft_consensus.cc:2468] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:27.309617 9427 raft_consensus.cc:740] T 5875cdedb77841359158f7f185ee30f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.313423 9427 consensus_queue.cc:260] T 5875cdedb77841359158f7f185ee30f6 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.314404 9427 ts_tablet_manager.cc:1434] T 5875cdedb77841359158f7f185ee30f6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20251215 14:55:27.314708 9427 tablet_bootstrap.cc:492] T 18802b48f9c04eccb369de25dd113c3f P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.315351 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ea937af02b447e6a78cda0741cc8570" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:27.315999 9025 raft_consensus.cc:2393] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:27.321163 9298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e5c1626a30444bf987a7d7e09a586f7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:27.321346 9298 raft_consensus.cc:3060] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.322947 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7bacba021777416e9c547469aa08bd9c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:27.324081 9298 raft_consensus.cc:2468] T 5e5c1626a30444bf987a7d7e09a586f7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:27.324771 9427 tablet_bootstrap.cc:654] T 18802b48f9c04eccb369de25dd113c3f P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.325330 9435 tablet_bootstrap.cc:492] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:27.325459 9435 ts_tablet_manager.cc:1403] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.133s user 0.004s sys 0.001s
I20251215 14:55:27.326124 9435 raft_consensus.cc:359] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.326298 9435 raft_consensus.cc:385] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.326355 9435 raft_consensus.cc:740] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.326529 9435 consensus_queue.cc:260] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.326999 9435 ts_tablet_manager.cc:1434] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:27.328687 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "02e391ec04cf44c881f31d0ba53af2e9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:27.328802 11038 consensus_queue.cc:1048] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:27.328933 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:55:27.329627 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ea937af02b447e6a78cda0741cc8570" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:27.329756 9180 raft_consensus.cc:3060] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.329773 11552 consensus_queue.cc:1048] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.330588 8978 leader_election.cc:304] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.331560 11166 raft_consensus.cc:2804] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.331689 11166 raft_consensus.cc:697] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:27.331923 11166 consensus_queue.cc:237] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.332226 9298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "02e391ec04cf44c881f31d0ba53af2e9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:27.332428 9298 raft_consensus.cc:3060] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.335108 9298 raft_consensus.cc:2468] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:27.339509 8978 leader_election.cc:304] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.339759 11679 raft_consensus.cc:2804] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.339864 11679 raft_consensus.cc:697] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:27.340134 11679 consensus_queue.cc:237] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.342763 9298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7bacba021777416e9c547469aa08bd9c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:27.342976 9298 raft_consensus.cc:3060] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.348011 9298 raft_consensus.cc:2468] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:27.348013 8978 leader_election.cc:304] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.348265 11166 raft_consensus.cc:2804] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.348448 11166 raft_consensus.cc:697] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:27.348675 11166 consensus_queue.cc:237] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.353508 9435 tablet_bootstrap.cc:492] T 4d809129224b4a74b42c0f7e370233f6 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:27.354691 9427 tablet_bootstrap.cc:492] T 18802b48f9c04eccb369de25dd113c3f P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.354869 9427 ts_tablet_manager.cc:1403] T 18802b48f9c04eccb369de25dd113c3f P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.040s user 0.004s sys 0.000s
I20251215 14:55:27.355772 9427 raft_consensus.cc:359] T 18802b48f9c04eccb369de25dd113c3f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.355998 9427 raft_consensus.cc:385] T 18802b48f9c04eccb369de25dd113c3f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.356097 9427 raft_consensus.cc:740] T 18802b48f9c04eccb369de25dd113c3f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.356359 9427 consensus_queue.cc:260] T 18802b48f9c04eccb369de25dd113c3f P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.356734 11610 consensus_queue.cc:1048] T 6d6e5f5227974610b686e23da5501f4a P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.356806 9180 raft_consensus.cc:2468] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:27.356999 9427 ts_tablet_manager.cc:1434] T 18802b48f9c04eccb369de25dd113c3f P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:27.357137 8978 leader_election.cc:304] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.357355 11706 raft_consensus.cc:2804] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.357360 9427 tablet_bootstrap.cc:492] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.357466 11706 raft_consensus.cc:697] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:27.357764 11706 consensus_queue.cc:237] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.359042 9427 tablet_bootstrap.cc:654] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.364670 11610 raft_consensus.cc:493] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.364812 11610 raft_consensus.cc:515] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.360460 11166 raft_consensus.cc:493] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.365365 11610 leader_election.cc:290] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:27.365330 11166 raft_consensus.cc:515] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.366150 11166 leader_election.cc:290] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.366585 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5875cdedb77841359158f7f185ee30f6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:27.367131 9249 leader_election.cc:343] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.367799 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5875cdedb77841359158f7f185ee30f6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:27.368062 9027 raft_consensus.cc:2468] T 5875cdedb77841359158f7f185ee30f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:27.368484 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e5c1626a30444bf987a7d7e09a586f7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:27.369287 9180 raft_consensus.cc:3060] T 5e5c1626a30444bf987a7d7e09a586f7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.370121 9298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20f30d23a43f43749f6f9054a18a84a8" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:27.370293 9248 leader_election.cc:304] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:27.370504 9298 raft_consensus.cc:2468] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:27.371096 11038 raft_consensus.cc:2804] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:27.371379 11038 raft_consensus.cc:493] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:27.371457 11038 raft_consensus.cc:3060] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.372622 9180 raft_consensus.cc:2468] T 5e5c1626a30444bf987a7d7e09a586f7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:27.373714 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7bacba021777416e9c547469aa08bd9c" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:27.373840 11038 raft_consensus.cc:515] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.374177 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "02e391ec04cf44c881f31d0ba53af2e9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:27.374383 11038 leader_election.cc:290] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:27.375680 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5875cdedb77841359158f7f185ee30f6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:27.375509 8978 leader_election.cc:304] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.376605 9028 raft_consensus.cc:3060] T 5875cdedb77841359158f7f185ee30f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.377008 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5875cdedb77841359158f7f185ee30f6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:27.377674 9427 tablet_bootstrap.cc:492] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.377777 9427 ts_tablet_manager.cc:1403] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
W20251215 14:55:27.377763 9249 leader_election.cc:343] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.378468 9426 tablet_bootstrap.cc:492] T 02e391ec04cf44c881f31d0ba53af2e9 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:27.378484 9427 raft_consensus.cc:359] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.378609 9427 raft_consensus.cc:385] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.378647 9427 raft_consensus.cc:740] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.378804 9427 consensus_queue.cc:260] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.379070 9028 raft_consensus.cc:2468] T 5875cdedb77841359158f7f185ee30f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:27.379302 9427 ts_tablet_manager.cc:1434] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251215 14:55:27.379379 11679 raft_consensus.cc:2804] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:27.379433 11679 raft_consensus.cc:493] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:27.379490 11679 raft_consensus.cc:3060] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.379542 9427 tablet_bootstrap.cc:492] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.379866 9426 tablet_bootstrap.cc:654] T 02e391ec04cf44c881f31d0ba53af2e9 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.380757 9427 tablet_bootstrap.cc:654] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.381865 11679 raft_consensus.cc:515] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.382472 11679 leader_election.cc:290] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.382665 11679 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.382754 11679 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:27.384343 11679 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.384542 9248 leader_election.cc:304] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:27.384966 11473 raft_consensus.cc:2804] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.385092 11473 raft_consensus.cc:697] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:27.385313 11473 consensus_queue.cc:237] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.391337 9298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20f30d23a43f43749f6f9054a18a84a8" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:27.391527 9298 raft_consensus.cc:3060] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.391485 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20f30d23a43f43749f6f9054a18a84a8" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:27.392725 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20f30d23a43f43749f6f9054a18a84a8" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:27.394013 9298 raft_consensus.cc:2468] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:27.395252 9426 tablet_bootstrap.cc:492] T 02e391ec04cf44c881f31d0ba53af2e9 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:27.395439 9426 ts_tablet_manager.cc:1403] T 02e391ec04cf44c881f31d0ba53af2e9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.000s
I20251215 14:55:27.396525 8978 leader_election.cc:304] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.397137 11706 raft_consensus.cc:2804] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.397257 11706 raft_consensus.cc:697] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:27.396128 9426 raft_consensus.cc:359] T 02e391ec04cf44c881f31d0ba53af2e9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.397852 9426 raft_consensus.cc:385] T 02e391ec04cf44c881f31d0ba53af2e9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.397955 9426 raft_consensus.cc:740] T 02e391ec04cf44c881f31d0ba53af2e9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.397469 11706 consensus_queue.cc:237] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.398201 9426 consensus_queue.cc:260] T 02e391ec04cf44c881f31d0ba53af2e9 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.398701 9426 ts_tablet_manager.cc:1434] T 02e391ec04cf44c881f31d0ba53af2e9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251215 14:55:27.398957 9426 tablet_bootstrap.cc:492] T 20f30d23a43f43749f6f9054a18a84a8 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:27.399811 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:55:27.400483 9426 tablet_bootstrap.cc:654] T 20f30d23a43f43749f6f9054a18a84a8 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.403129 9427 tablet_bootstrap.cc:492] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.403298 9427 ts_tablet_manager.cc:1403] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.001s
I20251215 14:55:27.404251 9427 raft_consensus.cc:359] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.404428 9427 raft_consensus.cc:385] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.404476 9427 raft_consensus.cc:740] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.404675 9427 consensus_queue.cc:260] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.405063 9427 ts_tablet_manager.cc:1434] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:27.404987 11038 raft_consensus.cc:493] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.405230 11038 raft_consensus.cc:515] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.405812 11038 leader_election.cc:290] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:27.407230 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6f6324610f44cefb0ce67fd76e0e001" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:27.407961 9249 leader_election.cc:343] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.412197 9427 tablet_bootstrap.cc:492] T 23ace8d6e2bb42de9368a06190a07431 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.414106 9427 tablet_bootstrap.cc:654] T 23ace8d6e2bb42de9368a06190a07431 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.414719 9435 tablet_bootstrap.cc:654] T 4d809129224b4a74b42c0f7e370233f6 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.420217 9427 tablet_bootstrap.cc:492] T 23ace8d6e2bb42de9368a06190a07431 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.420380 9427 ts_tablet_manager.cc:1403] T 23ace8d6e2bb42de9368a06190a07431 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.002s
I20251215 14:55:27.421216 9427 raft_consensus.cc:359] T 23ace8d6e2bb42de9368a06190a07431 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.421396 9427 raft_consensus.cc:385] T 23ace8d6e2bb42de9368a06190a07431 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.421453 9427 raft_consensus.cc:740] T 23ace8d6e2bb42de9368a06190a07431 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.421654 9427 consensus_queue.cc:260] T 23ace8d6e2bb42de9368a06190a07431 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.422098 9427 ts_tablet_manager.cc:1434] T 23ace8d6e2bb42de9368a06190a07431 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:27.422286 8976 leader_election.cc:304] T 84f036eb44a44e0597bc9af88d81a017 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:27.422391 9427 tablet_bootstrap.cc:492] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.422698 11166 raft_consensus.cc:2749] T 84f036eb44a44e0597bc9af88d81a017 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251215 14:55:27.423272 8976 leader_election.cc:304] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:27.423712 11166 raft_consensus.cc:2749] T 3a4767a5965244afac42190f97f0a113 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:27.424122 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6f6324610f44cefb0ce67fd76e0e001" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
W20251215 14:55:27.424186 8976 leader_election.cc:343] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.424396 8976 leader_election.cc:304] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:27.424698 11166 raft_consensus.cc:2749] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:27.424908 9248 leader_election.cc:343] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.425045 9248 leader_election.cc:304] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:27.425583 11473 raft_consensus.cc:2749] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:27.426905 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ea937af02b447e6a78cda0741cc8570" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:27.427106 9300 raft_consensus.cc:2393] T 0ea937af02b447e6a78cda0741cc8570 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:27.434191 9427 tablet_bootstrap.cc:654] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.450953 11669 raft_consensus.cc:493] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.451094 11669 raft_consensus.cc:515] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.451282 9426 tablet_bootstrap.cc:492] T 20f30d23a43f43749f6f9054a18a84a8 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:27.451551 9427 tablet_bootstrap.cc:492] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.451548 9426 ts_tablet_manager.cc:1403] T 20f30d23a43f43749f6f9054a18a84a8 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.053s user 0.008s sys 0.002s
I20251215 14:55:27.451654 11669 leader_election.cc:290] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.451683 9427 ts_tablet_manager.cc:1403] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.003s
I20251215 14:55:27.452339 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b34a860bf4244586948ae9eafe35103a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:27.452522 9300 raft_consensus.cc:2468] T b34a860bf4244586948ae9eafe35103a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:27.452929 8978 leader_election.cc:304] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.453220 11166 raft_consensus.cc:2804] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:27.453351 11166 raft_consensus.cc:493] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:27.453475 11166 raft_consensus.cc:3060] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.453524 9426 raft_consensus.cc:359] T 20f30d23a43f43749f6f9054a18a84a8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.453859 9426 raft_consensus.cc:385] T 20f30d23a43f43749f6f9054a18a84a8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.454005 9426 raft_consensus.cc:740] T 20f30d23a43f43749f6f9054a18a84a8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.455632 9427 raft_consensus.cc:359] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.455808 9427 raft_consensus.cc:385] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.455866 9427 raft_consensus.cc:740] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.454463 9426 consensus_queue.cc:260] T 20f30d23a43f43749f6f9054a18a84a8 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.456414 11166 raft_consensus.cc:515] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.457094 11166 leader_election.cc:290] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.457185 9427 consensus_queue.cc:260] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.457543 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b34a860bf4244586948ae9eafe35103a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:27.457696 9300 raft_consensus.cc:3060] T b34a860bf4244586948ae9eafe35103a P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.457729 9427 ts_tablet_manager.cc:1434] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20251215 14:55:27.458024 9427 tablet_bootstrap.cc:492] T 4dd3af2da2c5445b962903d4475b0d58 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.458043 9426 ts_tablet_manager.cc:1434] T 20f30d23a43f43749f6f9054a18a84a8 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20251215 14:55:27.458675 9426 tablet_bootstrap.cc:492] T 7bacba021777416e9c547469aa08bd9c P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:27.459208 9226 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:27.459810 11706 consensus_queue.cc:1048] T 49bba2b78f65470182e1d361eb1272a4 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.463199 9426 tablet_bootstrap.cc:654] T 7bacba021777416e9c547469aa08bd9c P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.463616 9300 raft_consensus.cc:2468] T b34a860bf4244586948ae9eafe35103a P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:27.464082 8978 leader_election.cc:304] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.464414 11706 raft_consensus.cc:2804] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.464623 11706 raft_consensus.cc:697] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:27.464910 11706 consensus_queue.cc:237] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.463828 9427 tablet_bootstrap.cc:654] T 4dd3af2da2c5445b962903d4475b0d58 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.478961 11706 raft_consensus.cc:493] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.479242 11706 raft_consensus.cc:515] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.482125 11706 leader_election.cc:290] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.482699 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37554f8c1a90462095c511f00df6dece" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:27.482949 9300 raft_consensus.cc:2468] T 37554f8c1a90462095c511f00df6dece P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:27.483410 8978 leader_election.cc:304] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.483613 9426 tablet_bootstrap.cc:492] T 7bacba021777416e9c547469aa08bd9c P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:27.483898 9426 ts_tablet_manager.cc:1403] T 7bacba021777416e9c547469aa08bd9c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.025s user 0.010s sys 0.001s
I20251215 14:55:27.484303 9435 tablet_bootstrap.cc:492] T 4d809129224b4a74b42c0f7e370233f6 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:27.484469 9435 ts_tablet_manager.cc:1403] T 4d809129224b4a74b42c0f7e370233f6 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.131s user 0.007s sys 0.001s
I20251215 14:55:27.485212 9435 raft_consensus.cc:359] T 4d809129224b4a74b42c0f7e370233f6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.485584 9426 raft_consensus.cc:359] T 7bacba021777416e9c547469aa08bd9c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.485930 9426 raft_consensus.cc:385] T 7bacba021777416e9c547469aa08bd9c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.486070 9426 raft_consensus.cc:740] T 7bacba021777416e9c547469aa08bd9c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.486485 9426 consensus_queue.cc:260] T 7bacba021777416e9c547469aa08bd9c P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.487154 11669 raft_consensus.cc:2804] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:27.487246 11669 raft_consensus.cc:493] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:27.487303 11669 raft_consensus.cc:3060] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.488125 9426 ts_tablet_manager.cc:1434] T 7bacba021777416e9c547469aa08bd9c P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20251215 14:55:27.488670 9426 tablet_bootstrap.cc:492] T caefb83a990e4ad2baf621cd83265f96 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:27.489694 11669 raft_consensus.cc:515] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.485443 9435 raft_consensus.cc:385] T 4d809129224b4a74b42c0f7e370233f6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.490620 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37554f8c1a90462095c511f00df6dece" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:27.490259 11669 leader_election.cc:290] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.490836 9311 raft_consensus.cc:3060] T 37554f8c1a90462095c511f00df6dece P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.490933 9435 raft_consensus.cc:740] T 4d809129224b4a74b42c0f7e370233f6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.491147 9435 consensus_queue.cc:260] T 4d809129224b4a74b42c0f7e370233f6 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.493546 9311 raft_consensus.cc:2468] T 37554f8c1a90462095c511f00df6dece P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:27.493673 9435 ts_tablet_manager.cc:1434] T 4d809129224b4a74b42c0f7e370233f6 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s
I20251215 14:55:27.494278 8978 leader_election.cc:304] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.490237 9427 tablet_bootstrap.cc:492] T 4dd3af2da2c5445b962903d4475b0d58 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.494653 9427 ts_tablet_manager.cc:1403] T 4dd3af2da2c5445b962903d4475b0d58 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.003s
I20251215 14:55:27.494696 11706 raft_consensus.cc:2804] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.495002 11706 raft_consensus.cc:697] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:27.495304 11706 consensus_queue.cc:237] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.496838 9427 raft_consensus.cc:359] T 4dd3af2da2c5445b962903d4475b0d58 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.496980 9427 raft_consensus.cc:385] T 4dd3af2da2c5445b962903d4475b0d58 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.497025 9427 raft_consensus.cc:740] T 4dd3af2da2c5445b962903d4475b0d58 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.497221 9427 consensus_queue.cc:260] T 4dd3af2da2c5445b962903d4475b0d58 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.497664 9427 ts_tablet_manager.cc:1434] T 4dd3af2da2c5445b962903d4475b0d58 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251215 14:55:27.497912 9427 tablet_bootstrap.cc:492] T d6fd306fb2544afa8a60d5e7a093d76b P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.498828 9435 tablet_bootstrap.cc:492] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:27.499545 9426 tablet_bootstrap.cc:654] T caefb83a990e4ad2baf621cd83265f96 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.500865 9427 tablet_bootstrap.cc:654] T d6fd306fb2544afa8a60d5e7a093d76b P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.501420 9435 tablet_bootstrap.cc:654] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:27.512409 8976 leader_election.cc:343] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:27.515858 8976 leader_election.cc:343] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:27.524724 8976 leader_election.cc:343] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:27.525537 8976 leader_election.cc:343] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:27.527230 8976 leader_election.cc:343] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:27.528151 8976 leader_election.cc:343] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:27.529263 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:55:27.529414 8976 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:27.529681 11669 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:27.532795 9435 tablet_bootstrap.cc:492] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:27.536553 9435 ts_tablet_manager.cc:1403] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.002s
I20251215 14:55:27.537325 9435 raft_consensus.cc:359] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.537478 9435 raft_consensus.cc:385] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.537526 9435 raft_consensus.cc:740] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.537688 9435 consensus_queue.cc:260] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.538165 9435 ts_tablet_manager.cc:1434] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:27.538429 9435 tablet_bootstrap.cc:492] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:27.540091 9435 tablet_bootstrap.cc:654] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.540371 11699 consensus_queue.cc:1048] T 52e93348b205408f83efff27fde48e9b P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.543292 11735 consensus_queue.cc:1048] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.549437 9115 leader_election.cc:304] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:27.551643 9427 tablet_bootstrap.cc:492] T d6fd306fb2544afa8a60d5e7a093d76b P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.551786 9427 ts_tablet_manager.cc:1403] T d6fd306fb2544afa8a60d5e7a093d76b P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.004s
I20251215 14:55:27.552386 11552 raft_consensus.cc:2749] T 78c65aae2561484ebbd68d0a0475b27d P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:27.552553 9427 raft_consensus.cc:359] T d6fd306fb2544afa8a60d5e7a093d76b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.552731 9427 raft_consensus.cc:385] T d6fd306fb2544afa8a60d5e7a093d76b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.552783 9427 raft_consensus.cc:740] T d6fd306fb2544afa8a60d5e7a093d76b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.552987 9427 consensus_queue.cc:260] T d6fd306fb2544afa8a60d5e7a093d76b P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.553498 9427 ts_tablet_manager.cc:1434] T d6fd306fb2544afa8a60d5e7a093d76b P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:27.553725 9427 tablet_bootstrap.cc:492] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:27.555155 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 11: this message will repeat every 5th retry.
I20251215 14:55:27.558432 11699 consensus_queue.cc:1048] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.558841 9115 leader_election.cc:304] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:27.559139 11699 raft_consensus.cc:2749] T 41e0d694b1af46b19138ccbffea96f28 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:27.559969 9427 tablet_bootstrap.cc:654] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.570160 11611 raft_consensus.cc:493] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.571921 9115 leader_election.cc:304] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:27.572495 11699 raft_consensus.cc:2749] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:27.573776 9115 leader_election.cc:304] T cf18d0368ee948a38d35ec47b732f6cc P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:27.576231 11611 raft_consensus.cc:515] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.576831 11611 leader_election.cc:290] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:27.577116 11699 raft_consensus.cc:2749] T cf18d0368ee948a38d35ec47b732f6cc P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:27.577384 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ace8d6e2bb42de9368a06190a07431" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:27.577903 9249 leader_election.cc:343] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.577925 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ace8d6e2bb42de9368a06190a07431" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:27.578181 9028 raft_consensus.cc:2468] T 23ace8d6e2bb42de9368a06190a07431 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:27.578538 9248 leader_election.cc:304] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:27.578773 11611 raft_consensus.cc:2804] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:27.578845 11611 raft_consensus.cc:493] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:27.578908 11611 raft_consensus.cc:3060] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.580981 9115 leader_election.cc:304] T c4929bdb04914251b75a11d6936f1ee0 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:27.581292 11611 raft_consensus.cc:515] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.582033 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ace8d6e2bb42de9368a06190a07431" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:27.582698 9249 leader_election.cc:343] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.582779 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23ace8d6e2bb42de9368a06190a07431" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:27.582924 9025 raft_consensus.cc:3060] T 23ace8d6e2bb42de9368a06190a07431 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.583066 11699 raft_consensus.cc:2749] T c4929bdb04914251b75a11d6936f1ee0 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:27.585413 9025 raft_consensus.cc:2468] T 23ace8d6e2bb42de9368a06190a07431 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:27.585866 9248 leader_election.cc:304] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:27.586124 11174 raft_consensus.cc:2804] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.586220 11174 raft_consensus.cc:697] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:27.586419 11174 consensus_queue.cc:237] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.587908 11611 leader_election.cc:290] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
W20251215 14:55:27.600291 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 6: this message will repeat every 5th retry.
I20251215 14:55:27.602807 9435 tablet_bootstrap.cc:492] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:27.602950 9435 ts_tablet_manager.cc:1403] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.065s user 0.001s sys 0.005s
I20251215 14:55:27.603688 9435 raft_consensus.cc:359] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.603847 9435 raft_consensus.cc:385] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.603902 9435 raft_consensus.cc:740] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.604084 9435 consensus_queue.cc:260] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.604439 9435 ts_tablet_manager.cc:1434] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20251215 14:55:27.604719 9435 tablet_bootstrap.cc:492] T 266937328422421ab6880d7f7410683e P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:27.606609 9435 tablet_bootstrap.cc:654] T 266937328422421ab6880d7f7410683e P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.607807 9115 leader_election.cc:304] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:27.608071 9427 tablet_bootstrap.cc:492] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.608215 9427 ts_tablet_manager.cc:1403] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.002s
I20251215 14:55:27.608954 9427 raft_consensus.cc:359] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.609118 9427 raft_consensus.cc:385] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.609174 9427 raft_consensus.cc:740] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.609383 11738 raft_consensus.cc:2749] T 0ea937af02b447e6a78cda0741cc8570 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:27.609400 9427 consensus_queue.cc:260] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.609670 11611 raft_consensus.cc:493] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.609793 11611 raft_consensus.cc:515] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.610649 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18802b48f9c04eccb369de25dd113c3f" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:27.611124 9249 leader_election.cc:343] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.612950 11611 leader_election.cc:290] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:27.612823 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18802b48f9c04eccb369de25dd113c3f" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:27.613245 9025 raft_consensus.cc:2468] T 18802b48f9c04eccb369de25dd113c3f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
W20251215 14:55:27.613437 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:55:27.613590 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:27.613580 9248 leader_election.cc:304] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:27.613871 11738 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:27.613968 11611 raft_consensus.cc:2804] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:27.614032 11611 raft_consensus.cc:493] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:27.614084 11611 raft_consensus.cc:3060] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.616485 11611 raft_consensus.cc:515] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.617316 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18802b48f9c04eccb369de25dd113c3f" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:27.617513 11738 consensus_queue.cc:1048] T 265a8937802a4b9cbf0edaf3e2a41ba8 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:27.617754 9249 leader_election.cc:343] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.618304 9427 ts_tablet_manager.cc:1434] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20251215 14:55:27.618607 9427 tablet_bootstrap.cc:492] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.620916 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18802b48f9c04eccb369de25dd113c3f" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:27.621126 9025 raft_consensus.cc:3060] T 18802b48f9c04eccb369de25dd113c3f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:27.623255 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:27.623735 9025 raft_consensus.cc:2468] T 18802b48f9c04eccb369de25dd113c3f P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:27.624169 11611 leader_election.cc:290] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:27.624729 9248 leader_election.cc:304] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:27.624923 9426 tablet_bootstrap.cc:492] T caefb83a990e4ad2baf621cd83265f96 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:27.625061 9426 ts_tablet_manager.cc:1403] T caefb83a990e4ad2baf621cd83265f96 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.137s user 0.015s sys 0.021s
I20251215 14:55:27.625092 11174 raft_consensus.cc:2804] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.625216 11174 raft_consensus.cc:697] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:27.625497 11174 consensus_queue.cc:237] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.625754 9426 raft_consensus.cc:359] T caefb83a990e4ad2baf621cd83265f96 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.625921 9426 raft_consensus.cc:385] T caefb83a990e4ad2baf621cd83265f96 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.625996 9426 raft_consensus.cc:740] T caefb83a990e4ad2baf621cd83265f96 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.626109 11038 consensus_queue.cc:1048] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.626770 9427 tablet_bootstrap.cc:654] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.635154 9426 consensus_queue.cc:260] T caefb83a990e4ad2baf621cd83265f96 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.635814 9426 ts_tablet_manager.cc:1434] T caefb83a990e4ad2baf621cd83265f96 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20251215 14:55:27.647476 11611 raft_consensus.cc:493] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.647612 11611 raft_consensus.cc:515] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.648502 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3dca27f234054f9582a2ca6c5e6f5cad" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:27.649025 9249 leader_election.cc:343] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.650075 11738 raft_consensus.cc:493] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.650051 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3dca27f234054f9582a2ca6c5e6f5cad" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:27.650195 11738 raft_consensus.cc:515] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
W20251215 14:55:27.650472 9248 leader_election.cc:343] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.650560 9248 leader_election.cc:304] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:27.650733 11738 leader_election.cc:290] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:27.650784 11038 raft_consensus.cc:2749] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:27.651085 9426 tablet_bootstrap.cc:492] T 21437c9162f1435485dde5fca3522be1 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:27.651140 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18c0b2442bcd4fb69d7d9a4f5fb46061" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:27.651321 9028 raft_consensus.cc:2393] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:27.652259 9427 tablet_bootstrap.cc:492] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.652439 9427 ts_tablet_manager.cc:1403] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.034s user 0.005s sys 0.000s
I20251215 14:55:27.652704 9426 tablet_bootstrap.cc:654] T 21437c9162f1435485dde5fca3522be1 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.653306 9427 raft_consensus.cc:359] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.653510 9427 raft_consensus.cc:385] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.653571 11611 leader_election.cc:290] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:27.653602 9427 raft_consensus.cc:740] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.653895 9427 consensus_queue.cc:260] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.655217 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b34a860bf4244586948ae9eafe35103a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:27.656024 9427 ts_tablet_manager.cc:1434] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:27.656324 9427 tablet_bootstrap.cc:492] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.658769 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b34a860bf4244586948ae9eafe35103a" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:27.664172 11174 consensus_queue.cc:1048] T 41e0d694b1af46b19138ccbffea96f28 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.664908 9427 tablet_bootstrap.cc:654] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:27.674463 11563 log.cc:927] Time spent T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Append to log took a long time: real 0.054s user 0.002s sys 0.000s
I20251215 14:55:27.676574 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37554f8c1a90462095c511f00df6dece" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:27.676862 9435 tablet_bootstrap.cc:492] T 266937328422421ab6880d7f7410683e P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:27.676990 9435 ts_tablet_manager.cc:1403] T 266937328422421ab6880d7f7410683e P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.072s user 0.001s sys 0.006s
I20251215 14:55:27.678092 9435 raft_consensus.cc:359] T 266937328422421ab6880d7f7410683e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.678346 9435 raft_consensus.cc:385] T 266937328422421ab6880d7f7410683e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.678400 9435 raft_consensus.cc:740] T 266937328422421ab6880d7f7410683e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.678606 9435 consensus_queue.cc:260] T 266937328422421ab6880d7f7410683e P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.679308 9435 ts_tablet_manager.cc:1434] T 266937328422421ab6880d7f7410683e P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:27.680428 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37554f8c1a90462095c511f00df6dece" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:27.680946 9435 tablet_bootstrap.cc:492] T e512c231686948619d338fa0fc8aae03 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:27.691890 11738 consensus_queue.cc:1048] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.693048 9427 tablet_bootstrap.cc:492] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.693188 9427 ts_tablet_manager.cc:1403] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.003s
I20251215 14:55:27.699429 9427 raft_consensus.cc:359] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.699622 9427 raft_consensus.cc:385] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.699672 9427 raft_consensus.cc:740] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.701498 9427 consensus_queue.cc:260] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.701949 9427 ts_tablet_manager.cc:1434] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20251215 14:55:27.702229 9427 tablet_bootstrap.cc:492] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.710492 9427 tablet_bootstrap.cc:654] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.720229 9435 tablet_bootstrap.cc:654] T e512c231686948619d338fa0fc8aae03 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.731712 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18c0b2442bcd4fb69d7d9a4f5fb46061" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
W20251215 14:55:27.733245 8976 leader_election.cc:343] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:27.733861 8976 leader_election.cc:343] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:27.736181 8976 leader_election.cc:343] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:27.737504 8976 leader_election.cc:343] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.741873 11038 consensus_queue.cc:1048] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:27.742987 9249 consensus_peers.cc:597] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:27.743835 11669 consensus_queue.cc:1048] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.754887 11679 raft_consensus.cc:493] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.755033 11679 raft_consensus.cc:515] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.755589 11679 leader_election.cc:290] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.756357 11738 consensus_queue.cc:1048] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.757020 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95b78c1518f1481794948f2db1055f38" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:27.757237 9300 raft_consensus.cc:2468] T 95b78c1518f1481794948f2db1055f38 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:27.758337 8978 leader_election.cc:304] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.758597 9426 tablet_bootstrap.cc:492] T 21437c9162f1435485dde5fca3522be1 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:27.758672 9427 tablet_bootstrap.cc:492] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.758769 9426 ts_tablet_manager.cc:1403] T 21437c9162f1435485dde5fca3522be1 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.108s user 0.023s sys 0.033s
I20251215 14:55:27.759045 11679 raft_consensus.cc:2804] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:27.759976 11679 raft_consensus.cc:493] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:27.760063 11679 raft_consensus.cc:3060] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.761894 11679 raft_consensus.cc:515] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.762326 11679 leader_election.cc:290] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.762874 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95b78c1518f1481794948f2db1055f38" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:27.763034 9300 raft_consensus.cc:3060] T 95b78c1518f1481794948f2db1055f38 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.763310 9427 ts_tablet_manager.cc:1403] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.061s user 0.003s sys 0.001s
I20251215 14:55:27.764405 9427 raft_consensus.cc:359] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.764598 9427 raft_consensus.cc:385] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.764680 9427 raft_consensus.cc:740] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.764925 9427 consensus_queue.cc:260] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.766523 9300 raft_consensus.cc:2468] T 95b78c1518f1481794948f2db1055f38 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:27.767912 9427 ts_tablet_manager.cc:1434] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:27.768184 9427 tablet_bootstrap.cc:492] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.768400 8978 leader_election.cc:304] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.768621 11166 raft_consensus.cc:2804] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.768740 11166 raft_consensus.cc:697] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:27.768949 11166 consensus_queue.cc:237] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.769569 11738 consensus_queue.cc:1048] T f45f8b2fbf754d359deb666cb605c789 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.770120 11699 consensus_queue.cc:1048] T 86f18ff40af547da85de8966b12f76f4 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.770550 9426 raft_consensus.cc:359] T 21437c9162f1435485dde5fca3522be1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.770645 11699 consensus_queue.cc:1048] T 96a1de7ce5f64f348585926ac05ddb87 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.770941 11038 consensus_queue.cc:1048] T 78c65aae2561484ebbd68d0a0475b27d P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.770709 9426 raft_consensus.cc:385] T 21437c9162f1435485dde5fca3522be1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.771267 9426 raft_consensus.cc:740] T 21437c9162f1435485dde5fca3522be1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.771457 9426 consensus_queue.cc:260] T 21437c9162f1435485dde5fca3522be1 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.772012 9426 ts_tablet_manager.cc:1434] T 21437c9162f1435485dde5fca3522be1 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.013s user 0.002s sys 0.000s
I20251215 14:55:27.772279 9426 tablet_bootstrap.cc:492] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:27.774413 8775 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 682cafa003a64138a01024be2573fe34 (table default.Table_d1bbae49dd2d4213b53635ea46c07990 [id=527d4e360777473fa1c70305b2ddebef], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 682cafa003a64138a01024be2573fe34 consensus state has no leader
I20251215 14:55:27.777809 9426 tablet_bootstrap.cc:654] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.781209 9435 tablet_bootstrap.cc:492] T e512c231686948619d338fa0fc8aae03 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:27.781332 9435 ts_tablet_manager.cc:1403] T e512c231686948619d338fa0fc8aae03 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.102s user 0.007s sys 0.001s
I20251215 14:55:27.782014 9435 raft_consensus.cc:359] T e512c231686948619d338fa0fc8aae03 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.782163 9435 raft_consensus.cc:385] T e512c231686948619d338fa0fc8aae03 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.782212 9435 raft_consensus.cc:740] T e512c231686948619d338fa0fc8aae03 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.782462 9115 leader_election.cc:304] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:27.782753 11699 raft_consensus.cc:3060] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.782568 9435 consensus_queue.cc:260] T e512c231686948619d338fa0fc8aae03 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.783638 9435 ts_tablet_manager.cc:1434] T e512c231686948619d338fa0fc8aae03 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:27.784335 9435 tablet_bootstrap.cc:492] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:27.785135 11699 raft_consensus.cc:2749] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:27.789402 9435 tablet_bootstrap.cc:654] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.793907 9427 tablet_bootstrap.cc:654] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.796036 11699 consensus_queue.cc:1048] T cd025ffa766d45f8bc6c42c6eaa3418c P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.802302 11679 consensus_queue.cc:1048] T 10890fcab7204cc7b7468402952f824c P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.829356 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95b78c1518f1481794948f2db1055f38" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:27.829860 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95b78c1518f1481794948f2db1055f38" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:27.839923 9427 tablet_bootstrap.cc:492] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.840075 9427 ts_tablet_manager.cc:1403] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.072s user 0.003s sys 0.003s
I20251215 14:55:27.840845 9427 raft_consensus.cc:359] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.841005 9427 raft_consensus.cc:385] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.841058 9427 raft_consensus.cc:740] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.841252 9427 consensus_queue.cc:260] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.841388 11166 raft_consensus.cc:493] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.841579 11166 raft_consensus.cc:515] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.842268 11166 leader_election.cc:290] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.842389 9426 tablet_bootstrap.cc:492] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:27.846804 9426 ts_tablet_manager.cc:1403] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.075s user 0.003s sys 0.006s
I20251215 14:55:27.847597 9426 raft_consensus.cc:359] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.847769 9426 raft_consensus.cc:385] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.847812 9426 raft_consensus.cc:740] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.847958 9426 consensus_queue.cc:260] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.848417 9426 ts_tablet_manager.cc:1434] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:27.849828 9088 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
W20251215 14:55:27.850608 8976 leader_election.cc:343] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.850631 11699 consensus_queue.cc:1048] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:27.850924 8976 leader_election.cc:343] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:27.851922 9427 ts_tablet_manager.cc:1434] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20251215 14:55:27.852164 9427 tablet_bootstrap.cc:492] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.853775 9426 tablet_bootstrap.cc:492] T 666af680888c4b3c81187d0195684bc7 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:27.860309 9427 tablet_bootstrap.cc:654] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.861861 9296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d809129224b4a74b42c0f7e370233f6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:27.862221 9426 tablet_bootstrap.cc:654] T 666af680888c4b3c81187d0195684bc7 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.862246 9296 raft_consensus.cc:2468] T 4d809129224b4a74b42c0f7e370233f6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:27.863795 11611 consensus_queue.cc:1048] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.867305 8978 leader_election.cc:304] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.867631 11166 raft_consensus.cc:2804] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:27.867712 11166 raft_consensus.cc:493] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:27.867772 11166 raft_consensus.cc:3060] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.868201 9426 tablet_bootstrap.cc:492] T 666af680888c4b3c81187d0195684bc7 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:27.868316 9426 ts_tablet_manager.cc:1403] T 666af680888c4b3c81187d0195684bc7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20251215 14:55:27.869010 9426 raft_consensus.cc:359] T 666af680888c4b3c81187d0195684bc7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.869155 9426 raft_consensus.cc:385] T 666af680888c4b3c81187d0195684bc7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.869196 9426 raft_consensus.cc:740] T 666af680888c4b3c81187d0195684bc7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.869365 9426 consensus_queue.cc:260] T 666af680888c4b3c81187d0195684bc7 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.869832 9426 ts_tablet_manager.cc:1434] T 666af680888c4b3c81187d0195684bc7 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:27.870066 9426 tablet_bootstrap.cc:492] T 18802b48f9c04eccb369de25dd113c3f P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:27.870363 11166 raft_consensus.cc:515] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.870915 11166 leader_election.cc:290] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:27.871654 9426 tablet_bootstrap.cc:654] T 18802b48f9c04eccb369de25dd113c3f P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.873674 9427 tablet_bootstrap.cc:492] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.873816 9427 ts_tablet_manager.cc:1403] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.001s
I20251215 14:55:27.874447 9426 tablet_bootstrap.cc:492] T 18802b48f9c04eccb369de25dd113c3f P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:27.874557 9426 ts_tablet_manager.cc:1403] T 18802b48f9c04eccb369de25dd113c3f P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251215 14:55:27.874694 9427 raft_consensus.cc:359] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.874836 9427 raft_consensus.cc:385] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.874888 9427 raft_consensus.cc:740] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.875068 9427 consensus_queue.cc:260] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.875759 9427 ts_tablet_manager.cc:1434] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:27.876019 9427 tablet_bootstrap.cc:492] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.877504 9427 tablet_bootstrap.cc:654] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.877429 11552 raft_consensus.cc:493] T 7bacba021777416e9c547469aa08bd9c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.881978 9426 raft_consensus.cc:359] T 18802b48f9c04eccb369de25dd113c3f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.882153 9426 raft_consensus.cc:385] T 18802b48f9c04eccb369de25dd113c3f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.882203 9426 raft_consensus.cc:740] T 18802b48f9c04eccb369de25dd113c3f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.882397 9426 consensus_queue.cc:260] T 18802b48f9c04eccb369de25dd113c3f P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.882865 9426 ts_tablet_manager.cc:1434] T 18802b48f9c04eccb369de25dd113c3f P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.008s user 0.000s sys 0.001s
I20251215 14:55:27.883140 9426 tablet_bootstrap.cc:492] T d6fd306fb2544afa8a60d5e7a093d76b P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:27.887020 11611 consensus_queue.cc:1048] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.879482 11552 raft_consensus.cc:515] T 7bacba021777416e9c547469aa08bd9c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.889870 9426 tablet_bootstrap.cc:654] T d6fd306fb2544afa8a60d5e7a093d76b P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.890188 11552 leader_election.cc:290] T 7bacba021777416e9c547469aa08bd9c P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:27.890997 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7bacba021777416e9c547469aa08bd9c" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:27.879909 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d809129224b4a74b42c0f7e370233f6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:27.899859 9311 raft_consensus.cc:3060] T 4d809129224b4a74b42c0f7e370233f6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.901317 11738 raft_consensus.cc:493] T 02e391ec04cf44c881f31d0ba53af2e9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.901437 11738 raft_consensus.cc:515] T 02e391ec04cf44c881f31d0ba53af2e9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.901970 11738 leader_election.cc:290] T 02e391ec04cf44c881f31d0ba53af2e9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:27.903344 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "02e391ec04cf44c881f31d0ba53af2e9" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:27.904690 11552 raft_consensus.cc:493] T 20f30d23a43f43749f6f9054a18a84a8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:27.908283 9427 tablet_bootstrap.cc:492] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.908418 9427 ts_tablet_manager.cc:1403] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.004s
I20251215 14:55:27.909164 9427 raft_consensus.cc:359] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.909339 9427 raft_consensus.cc:385] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.909389 9427 raft_consensus.cc:740] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.909559 9427 consensus_queue.cc:260] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.910122 9427 ts_tablet_manager.cc:1434] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:27.910356 9427 tablet_bootstrap.cc:492] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.911926 9427 tablet_bootstrap.cc:654] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.913722 11038 consensus_queue.cc:1048] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.914697 9311 raft_consensus.cc:2468] T 4d809129224b4a74b42c0f7e370233f6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:27.918586 8978 leader_election.cc:304] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:27.918843 11166 raft_consensus.cc:2804] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:27.918969 11166 raft_consensus.cc:697] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:27.919209 11166 consensus_queue.cc:237] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.921093 11174 consensus_queue.cc:1048] T c4929bdb04914251b75a11d6936f1ee0 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.921754 11174 consensus_queue.cc:1048] T 18c0b2442bcd4fb69d7d9a4f5fb46061 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.940044 9427 tablet_bootstrap.cc:492] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.940207 9427 ts_tablet_manager.cc:1403] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.007s
I20251215 14:55:27.941006 9427 raft_consensus.cc:359] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.941171 9427 raft_consensus.cc:385] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.941222 9427 raft_consensus.cc:740] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.941408 9427 consensus_queue.cc:260] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.941921 9427 ts_tablet_manager.cc:1434] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:27.942183 9427 tablet_bootstrap.cc:492] T e8ffa009bae84660b331ebeddcccc266 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.943866 9427 tablet_bootstrap.cc:654] T e8ffa009bae84660b331ebeddcccc266 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.946316 9298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7bacba021777416e9c547469aa08bd9c" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:27.946527 9298 raft_consensus.cc:2393] T 7bacba021777416e9c547469aa08bd9c P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:27.947284 9299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "02e391ec04cf44c881f31d0ba53af2e9" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:27.947463 9299 raft_consensus.cc:2393] T 02e391ec04cf44c881f31d0ba53af2e9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:27.953656 9435 tablet_bootstrap.cc:492] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:27.953815 9435 ts_tablet_manager.cc:1403] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.170s user 0.015s sys 0.008s
I20251215 14:55:27.954982 9435 raft_consensus.cc:359] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.955155 9435 raft_consensus.cc:385] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.955241 9435 raft_consensus.cc:740] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.955413 9435 consensus_queue.cc:260] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.955884 9435 ts_tablet_manager.cc:1434] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:27.956151 9435 tablet_bootstrap.cc:492] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:27.957283 9427 tablet_bootstrap.cc:492] T e8ffa009bae84660b331ebeddcccc266 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.957429 9427 ts_tablet_manager.cc:1403] T e8ffa009bae84660b331ebeddcccc266 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.000s
I20251215 14:55:27.958225 9427 raft_consensus.cc:359] T e8ffa009bae84660b331ebeddcccc266 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.958457 9427 raft_consensus.cc:385] T e8ffa009bae84660b331ebeddcccc266 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.958524 9427 raft_consensus.cc:740] T e8ffa009bae84660b331ebeddcccc266 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.958761 9427 consensus_queue.cc:260] T e8ffa009bae84660b331ebeddcccc266 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.959338 9427 ts_tablet_manager.cc:1434] T e8ffa009bae84660b331ebeddcccc266 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:27.959638 9427 tablet_bootstrap.cc:492] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:27.961776 9427 tablet_bootstrap.cc:654] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.905094 11552 raft_consensus.cc:515] T 20f30d23a43f43749f6f9054a18a84a8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.920035 9426 tablet_bootstrap.cc:492] T d6fd306fb2544afa8a60d5e7a093d76b P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:27.968214 9426 ts_tablet_manager.cc:1403] T d6fd306fb2544afa8a60d5e7a093d76b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.085s user 0.003s sys 0.003s
I20251215 14:55:27.943621 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d809129224b4a74b42c0f7e370233f6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:27.943794 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d809129224b4a74b42c0f7e370233f6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:27.951050 11735 consensus_queue.cc:1048] T 2b686ad43973448c8e24230d7d1d7250 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.969228 11552 leader_election.cc:290] T 20f30d23a43f43749f6f9054a18a84a8 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:27.969595 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20f30d23a43f43749f6f9054a18a84a8" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:27.971486 9426 raft_consensus.cc:359] T d6fd306fb2544afa8a60d5e7a093d76b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.971714 9426 raft_consensus.cc:385] T d6fd306fb2544afa8a60d5e7a093d76b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.971805 9426 raft_consensus.cc:740] T d6fd306fb2544afa8a60d5e7a093d76b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.972043 9426 consensus_queue.cc:260] T d6fd306fb2544afa8a60d5e7a093d76b P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.972482 9426 ts_tablet_manager.cc:1434] T d6fd306fb2544afa8a60d5e7a093d76b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251215 14:55:27.973487 9426 tablet_bootstrap.cc:492] T de5ba7f2b5c84ac39e4019a0b9532176 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:27.975726 9426 tablet_bootstrap.cc:654] T de5ba7f2b5c84ac39e4019a0b9532176 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.978415 11473 consensus_queue.cc:1048] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.988317 9115 leader_election.cc:304] T 7bacba021777416e9c547469aa08bd9c P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:27.991941 9435 tablet_bootstrap.cc:654] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:27.992517 11699 raft_consensus.cc:3060] T 7bacba021777416e9c547469aa08bd9c P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:27.993770 9426 tablet_bootstrap.cc:492] T de5ba7f2b5c84ac39e4019a0b9532176 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:27.993940 9426 ts_tablet_manager.cc:1403] T de5ba7f2b5c84ac39e4019a0b9532176 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.002s
I20251215 14:55:27.994814 9426 raft_consensus.cc:359] T de5ba7f2b5c84ac39e4019a0b9532176 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:27.995002 9426 raft_consensus.cc:385] T de5ba7f2b5c84ac39e4019a0b9532176 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:27.995092 9426 raft_consensus.cc:740] T de5ba7f2b5c84ac39e4019a0b9532176 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:27.995597 11699 raft_consensus.cc:2749] T 7bacba021777416e9c547469aa08bd9c P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:27.996908 11611 consensus_queue.cc:1048] T 3a4767a5965244afac42190f97f0a113 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:27.999583 9427 tablet_bootstrap.cc:492] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:27.999724 9427 ts_tablet_manager.cc:1403] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.000s
I20251215 14:55:28.000550 9427 raft_consensus.cc:359] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.000717 9427 raft_consensus.cc:385] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.000774 9427 raft_consensus.cc:740] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.000949 9427 consensus_queue.cc:260] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.001324 9427 ts_tablet_manager.cc:1434] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:28.001609 9435 tablet_bootstrap.cc:492] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:28.001747 9435 ts_tablet_manager.cc:1403] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.000s
I20251215 14:55:28.002446 9435 raft_consensus.cc:359] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.002615 9435 raft_consensus.cc:385] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.002676 9435 raft_consensus.cc:740] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.002843 9435 consensus_queue.cc:260] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.003364 9435 ts_tablet_manager.cc:1434] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:28.003638 9435 tablet_bootstrap.cc:492] T d531a17b6d1d47fa9606e0a8206b3bfd P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:28.005297 9435 tablet_bootstrap.cc:654] T d531a17b6d1d47fa9606e0a8206b3bfd P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.008366 9427 tablet_bootstrap.cc:492] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:28.009614 9435 tablet_bootstrap.cc:492] T d531a17b6d1d47fa9606e0a8206b3bfd P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:28.009752 9435 ts_tablet_manager.cc:1403] T d531a17b6d1d47fa9606e0a8206b3bfd P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20251215 14:55:28.010174 9427 tablet_bootstrap.cc:654] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.010571 9435 raft_consensus.cc:359] T d531a17b6d1d47fa9606e0a8206b3bfd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.010761 9435 raft_consensus.cc:385] T d531a17b6d1d47fa9606e0a8206b3bfd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.010823 9435 raft_consensus.cc:740] T d531a17b6d1d47fa9606e0a8206b3bfd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.011013 9435 consensus_queue.cc:260] T d531a17b6d1d47fa9606e0a8206b3bfd P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.011610 9435 ts_tablet_manager.cc:1434] T d531a17b6d1d47fa9606e0a8206b3bfd P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:28.012167 9435 tablet_bootstrap.cc:492] T e1d4dc7d18f7448880b79af99283c99f P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:28.014067 9435 tablet_bootstrap.cc:654] T e1d4dc7d18f7448880b79af99283c99f P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.015916 9426 consensus_queue.cc:260] T de5ba7f2b5c84ac39e4019a0b9532176 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.016999 11038 raft_consensus.cc:493] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.017134 11038 raft_consensus.cc:515] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.019270 11038 leader_election.cc:290] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.028910 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4dd3af2da2c5445b962903d4475b0d58" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:28.029460 9028 raft_consensus.cc:2468] T 4dd3af2da2c5445b962903d4475b0d58 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:28.031016 11166 raft_consensus.cc:493] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.031140 11166 raft_consensus.cc:515] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.031708 11166 leader_election.cc:290] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.033149 9248 leader_election.cc:304] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:28.034096 11038 raft_consensus.cc:2804] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:28.034482 11038 raft_consensus.cc:493] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:28.034842 9296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "266937328422421ab6880d7f7410683e" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.034878 11038 raft_consensus.cc:3060] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.035087 9296 raft_consensus.cc:2468] T 266937328422421ab6880d7f7410683e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.035647 8978 leader_election.cc:304] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:28.035645 9115 leader_election.cc:304] T 02e391ec04cf44c881f31d0ba53af2e9 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:28.035959 11706 raft_consensus.cc:2804] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:28.036034 11706 raft_consensus.cc:493] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:28.036091 11706 raft_consensus.cc:3060] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.036128 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4dd3af2da2c5445b962903d4475b0d58" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:28.036762 9249 leader_election.cc:343] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.037263 11610 consensus_queue.cc:1048] T cf18d0368ee948a38d35ec47b732f6cc P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.038615 11706 raft_consensus.cc:515] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.039609 11706 leader_election.cc:290] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.039741 11552 raft_consensus.cc:3060] T 02e391ec04cf44c881f31d0ba53af2e9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.041123 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "266937328422421ab6880d7f7410683e" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:28.041316 9300 raft_consensus.cc:3060] T 266937328422421ab6880d7f7410683e P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.041606 11473 raft_consensus.cc:493] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.041715 11473 raft_consensus.cc:515] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.042199 11473 leader_election.cc:290] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.042248 11552 raft_consensus.cc:2749] T 02e391ec04cf44c881f31d0ba53af2e9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:28.038754 11735 consensus_queue.cc:1048] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20251215 14:55:28.044149 9426 ts_tablet_manager.cc:1434] T de5ba7f2b5c84ac39e4019a0b9532176 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.023s user 0.003s sys 0.000s
I20251215 14:55:28.044277 9300 raft_consensus.cc:2468] T 266937328422421ab6880d7f7410683e P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:28.044365 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6fd306fb2544afa8a60d5e7a093d76b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:28.044498 9426 tablet_bootstrap.cc:492] T 7e8bf1cdbf2a48f59945268887cc5a2b P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:28.044534 9027 raft_consensus.cc:2468] T d6fd306fb2544afa8a60d5e7a093d76b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:28.044654 8978 leader_election.cc:304] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:28.044942 9248 leader_election.cc:304] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:28.046061 11679 raft_consensus.cc:2804] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:28.046200 11679 raft_consensus.cc:697] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:28.046434 11484 raft_consensus.cc:2804] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:28.046514 11484 raft_consensus.cc:493] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:28.046577 11484 raft_consensus.cc:3060] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.046492 11679 consensus_queue.cc:237] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.049265 11484 raft_consensus.cc:515] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.049829 11484 leader_election.cc:290] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.050753 11484 consensus_queue.cc:1048] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.052574 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6fd306fb2544afa8a60d5e7a093d76b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.052168 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6fd306fb2544afa8a60d5e7a093d76b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:28.053190 9025 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6fd306fb2544afa8a60d5e7a093d76b" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:28.053372 9025 raft_consensus.cc:3060] T d6fd306fb2544afa8a60d5e7a093d76b P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.056035 9025 raft_consensus.cc:2468] T d6fd306fb2544afa8a60d5e7a093d76b P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:28.056833 9248 leader_election.cc:304] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:28.057559 11166 consensus_queue.cc:1048] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.057240 11484 raft_consensus.cc:2804] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:28.058476 9177 raft_consensus.cc:2468] T d6fd306fb2544afa8a60d5e7a093d76b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:28.058187 11484 raft_consensus.cc:697] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:28.059386 9426 tablet_bootstrap.cc:654] T 7e8bf1cdbf2a48f59945268887cc5a2b P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.059273 11484 consensus_queue.cc:237] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
W20251215 14:55:28.060271 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:28.063127 11706 consensus_queue.cc:1048] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.073210 11611 consensus_queue.cc:1048] T 4f49d57104554c91a13229d3940cd4d2 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:28.077368 8976 leader_election.cc:343] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.077477 9296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20f30d23a43f43749f6f9054a18a84a8" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.077811 9296 raft_consensus.cc:2393] T 20f30d23a43f43749f6f9054a18a84a8 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
W20251215 14:55:28.077862 8976 leader_election.cc:343] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.080552 9426 tablet_bootstrap.cc:492] T 7e8bf1cdbf2a48f59945268887cc5a2b P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:28.080734 9426 ts_tablet_manager.cc:1403] T 7e8bf1cdbf2a48f59945268887cc5a2b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.005s
I20251215 14:55:28.081511 9426 raft_consensus.cc:359] T 7e8bf1cdbf2a48f59945268887cc5a2b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.081710 9426 raft_consensus.cc:385] T 7e8bf1cdbf2a48f59945268887cc5a2b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.081782 9426 raft_consensus.cc:740] T 7e8bf1cdbf2a48f59945268887cc5a2b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.081997 9426 consensus_queue.cc:260] T 7e8bf1cdbf2a48f59945268887cc5a2b P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.082489 9426 ts_tablet_manager.cc:1434] T 7e8bf1cdbf2a48f59945268887cc5a2b P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:28.082794 9426 tablet_bootstrap.cc:492] T e6f6324610f44cefb0ce67fd76e0e001 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:28.086750 9426 tablet_bootstrap.cc:654] T e6f6324610f44cefb0ce67fd76e0e001 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.089403 11283 raft_consensus.cc:493] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.089525 11283 raft_consensus.cc:515] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.090059 11283 leader_election.cc:290] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.092041 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d531a17b6d1d47fa9606e0a8206b3bfd" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.092469 9311 raft_consensus.cc:2468] T d531a17b6d1d47fa9606e0a8206b3bfd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.092952 8978 leader_election.cc:304] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:28.093255 11706 raft_consensus.cc:2804] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:28.093362 11706 raft_consensus.cc:493] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:28.093477 11706 raft_consensus.cc:3060] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.094185 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "266937328422421ab6880d7f7410683e" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.095860 11706 raft_consensus.cc:515] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.096465 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "266937328422421ab6880d7f7410683e" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:28.096604 11706 leader_election.cc:290] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.098757 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d531a17b6d1d47fa9606e0a8206b3bfd" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:28.098910 9311 raft_consensus.cc:3060] T d531a17b6d1d47fa9606e0a8206b3bfd P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.101531 9311 raft_consensus.cc:2468] T d531a17b6d1d47fa9606e0a8206b3bfd P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:28.103786 11038 raft_consensus.cc:515] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.104843 9435 tablet_bootstrap.cc:492] T e1d4dc7d18f7448880b79af99283c99f P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:28.105422 9435 ts_tablet_manager.cc:1403] T e1d4dc7d18f7448880b79af99283c99f P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.093s user 0.007s sys 0.005s
I20251215 14:55:28.105402 8978 leader_election.cc:304] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:28.105640 11166 raft_consensus.cc:2804] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:28.105736 11166 raft_consensus.cc:697] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:28.105940 11166 consensus_queue.cc:237] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.107178 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4dd3af2da2c5445b962903d4475b0d58" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:28.107745 9028 raft_consensus.cc:3060] T 4dd3af2da2c5445b962903d4475b0d58 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.105384 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4dd3af2da2c5445b962903d4475b0d58" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:28.110765 11283 raft_consensus.cc:493] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.110883 11283 raft_consensus.cc:515] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
W20251215 14:55:28.110924 9249 leader_election.cc:343] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.111377 11283 leader_election.cc:290] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.102516 9115 leader_election.cc:304] T 20f30d23a43f43749f6f9054a18a84a8 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:28.114210 11860 raft_consensus.cc:3060] T 20f30d23a43f43749f6f9054a18a84a8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.120992 11860 raft_consensus.cc:2749] T 20f30d23a43f43749f6f9054a18a84a8 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:28.121469 11038 leader_election.cc:290] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.122655 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e512c231686948619d338fa0fc8aae03" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.122905 9311 raft_consensus.cc:2468] T e512c231686948619d338fa0fc8aae03 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.123324 8978 leader_election.cc:304] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:28.123725 11706 raft_consensus.cc:2804] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:28.123842 11706 raft_consensus.cc:493] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:28.123950 11706 raft_consensus.cc:3060] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:28.130934 11563 log.cc:927] Time spent T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Append to log took a long time: real 0.104s user 0.001s sys 0.000s
I20251215 14:55:28.131314 11588 raft_consensus.cc:493] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.131436 11588 raft_consensus.cc:515] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.132027 11588 leader_election.cc:290] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.137269 11706 raft_consensus.cc:515] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.139458 9028 raft_consensus.cc:2468] T 4dd3af2da2c5445b962903d4475b0d58 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
W20251215 14:55:28.144433 8976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 66623.1us
I20251215 14:55:28.145033 9248 leader_election.cc:304] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:28.146508 11484 raft_consensus.cc:2804] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:28.146616 11484 raft_consensus.cc:697] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:28.146835 11484 consensus_queue.cc:237] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.147127 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d531a17b6d1d47fa9606e0a8206b3bfd" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.146057 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6f6324610f44cefb0ce67fd76e0e001" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.147936 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d531a17b6d1d47fa9606e0a8206b3bfd" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:28.148466 9311 raft_consensus.cc:2468] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.150707 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6f6324610f44cefb0ce67fd76e0e001" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.150738 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e512c231686948619d338fa0fc8aae03" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.151253 9180 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e512c231686948619d338fa0fc8aae03" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:28.156082 11038 consensus_queue.cc:1048] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.157321 9426 tablet_bootstrap.cc:492] T e6f6324610f44cefb0ce67fd76e0e001 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:28.158032 9426 ts_tablet_manager.cc:1403] T e6f6324610f44cefb0ce67fd76e0e001 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.075s user 0.025s sys 0.014s
W20251215 14:55:28.158687 8976 leader_election.cc:343] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.159328 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e512c231686948619d338fa0fc8aae03" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:28.159602 9311 raft_consensus.cc:3060] T e512c231686948619d338fa0fc8aae03 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.158658 11283 consensus_queue.cc:1048] T 5bd1578d434047158b6fbce7c24daebb P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:28.160280 8976 leader_election.cc:343] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.163570 9427 tablet_bootstrap.cc:492] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:28.163704 9427 ts_tablet_manager.cc:1403] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.155s user 0.002s sys 0.004s
I20251215 14:55:28.164398 9427 raft_consensus.cc:359] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.164598 9427 raft_consensus.cc:385] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.164649 9427 raft_consensus.cc:740] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.164808 9427 consensus_queue.cc:260] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.165289 9427 ts_tablet_manager.cc:1434] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:28.159474 9426 raft_consensus.cc:359] T e6f6324610f44cefb0ce67fd76e0e001 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.165544 9427 tablet_bootstrap.cc:492] T 5e751be4722043928e6977c48c359aae P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:28.165545 9426 raft_consensus.cc:385] T e6f6324610f44cefb0ce67fd76e0e001 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.165642 9426 raft_consensus.cc:740] T e6f6324610f44cefb0ce67fd76e0e001 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.165864 9426 consensus_queue.cc:260] T e6f6324610f44cefb0ce67fd76e0e001 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.166141 11283 consensus_queue.cc:1048] T 9a4c7bd7d0984ef788fe2c0504058c37 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.166383 9426 ts_tablet_manager.cc:1434] T e6f6324610f44cefb0ce67fd76e0e001 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20251215 14:55:28.166651 9426 tablet_bootstrap.cc:492] T 23ace8d6e2bb42de9368a06190a07431 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:28.166991 9427 tablet_bootstrap.cc:654] T 5e751be4722043928e6977c48c359aae P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.168246 9426 tablet_bootstrap.cc:654] T 23ace8d6e2bb42de9368a06190a07431 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.169572 11691 consensus_queue.cc:1048] T d064a85455844115899b3de91a2313f5 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:28.171092 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 6: this message will repeat every 5th retry.
I20251215 14:55:28.178150 8978 leader_election.cc:304] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:28.180596 9180 raft_consensus.cc:3060] T 7e8bf1cdbf2a48f59945268887cc5a2b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.184435 11038 consensus_queue.cc:1048] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.189688 9435 raft_consensus.cc:359] T e1d4dc7d18f7448880b79af99283c99f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.189867 9435 raft_consensus.cc:385] T e1d4dc7d18f7448880b79af99283c99f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.189913 9435 raft_consensus.cc:740] T e1d4dc7d18f7448880b79af99283c99f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.190078 9435 consensus_queue.cc:260] T e1d4dc7d18f7448880b79af99283c99f P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.194826 11679 raft_consensus.cc:2804] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:28.194923 11679 raft_consensus.cc:493] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:28.194985 11679 raft_consensus.cc:3060] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.197420 11679 raft_consensus.cc:515] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.197970 11679 leader_election.cc:290] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.198621 11679 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.198783 11679 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:28.199368 11679 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:28.201539 8976 leader_election.cc:343] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:28.203754 8976 leader_election.cc:343] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.204198 11706 leader_election.cc:290] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:28.205616 8976 leader_election.cc:343] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:28.205904 8976 leader_election.cc:343] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:28.211069 8976 leader_election.cc:343] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.197855 9311 raft_consensus.cc:2468] T e512c231686948619d338fa0fc8aae03 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:28.220371 9427 tablet_bootstrap.cc:492] T 5e751be4722043928e6977c48c359aae P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:28.220533 9427 ts_tablet_manager.cc:1403] T 5e751be4722043928e6977c48c359aae P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.055s user 0.004s sys 0.004s
I20251215 14:55:28.221271 9427 raft_consensus.cc:359] T 5e751be4722043928e6977c48c359aae P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.221552 9427 raft_consensus.cc:385] T 5e751be4722043928e6977c48c359aae P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.221642 9427 raft_consensus.cc:740] T 5e751be4722043928e6977c48c359aae P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.221851 9427 consensus_queue.cc:260] T 5e751be4722043928e6977c48c359aae P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.222388 9427 ts_tablet_manager.cc:1434] T 5e751be4722043928e6977c48c359aae P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:28.222690 9427 tablet_bootstrap.cc:492] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:28.200606 9435 ts_tablet_manager.cc:1434] T e1d4dc7d18f7448880b79af99283c99f P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20251215 14:55:28.223194 9435 tablet_bootstrap.cc:492] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:28.224275 9427 tablet_bootstrap.cc:654] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.225847 9435 tablet_bootstrap.cc:654] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.230218 9426 tablet_bootstrap.cc:492] T 23ace8d6e2bb42de9368a06190a07431 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:28.230518 9426 ts_tablet_manager.cc:1403] T 23ace8d6e2bb42de9368a06190a07431 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.064s user 0.000s sys 0.014s
I20251215 14:55:28.230615 9180 raft_consensus.cc:3060] T 2ca89ec0fe3647ad9c3e62d16640bb20 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.231439 9426 raft_consensus.cc:359] T 23ace8d6e2bb42de9368a06190a07431 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.231747 9426 raft_consensus.cc:385] T 23ace8d6e2bb42de9368a06190a07431 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.231873 9426 raft_consensus.cc:740] T 23ace8d6e2bb42de9368a06190a07431 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.232185 9426 consensus_queue.cc:260] T 23ace8d6e2bb42de9368a06190a07431 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.232851 9426 ts_tablet_manager.cc:1434] T 23ace8d6e2bb42de9368a06190a07431 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:28.233182 9426 tablet_bootstrap.cc:492] T a4b0a5e13ae941dcb99749f1e0c04176 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:28.234737 11552 raft_consensus.cc:493] T 21437c9162f1435485dde5fca3522be1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.234889 11552 raft_consensus.cc:515] T 21437c9162f1435485dde5fca3522be1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.235034 9426 tablet_bootstrap.cc:654] T a4b0a5e13ae941dcb99749f1e0c04176 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.235595 11552 leader_election.cc:290] T 21437c9162f1435485dde5fca3522be1 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.236258 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "21437c9162f1435485dde5fca3522be1" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:28.236461 9027 raft_consensus.cc:2393] T 21437c9162f1435485dde5fca3522be1 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:28.236558 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "21437c9162f1435485dde5fca3522be1" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.237090 9115 leader_election.cc:304] T 21437c9162f1435485dde5fca3522be1 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:28.237517 11552 raft_consensus.cc:3060] T 21437c9162f1435485dde5fca3522be1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.238806 11038 consensus_queue.cc:1048] T 21437c9162f1435485dde5fca3522be1 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.240082 11552 raft_consensus.cc:2749] T 21437c9162f1435485dde5fca3522be1 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:28.242395 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6f6324610f44cefb0ce67fd76e0e001" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:28.242622 9177 raft_consensus.cc:3060] T e6f6324610f44cefb0ce67fd76e0e001 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.242738 9426 tablet_bootstrap.cc:492] T a4b0a5e13ae941dcb99749f1e0c04176 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:28.242874 9426 ts_tablet_manager.cc:1403] T a4b0a5e13ae941dcb99749f1e0c04176 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20251215 14:55:28.245153 9177 raft_consensus.cc:2468] T e6f6324610f44cefb0ce67fd76e0e001 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:28.250212 9426 raft_consensus.cc:359] T a4b0a5e13ae941dcb99749f1e0c04176 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.250392 9426 raft_consensus.cc:385] T a4b0a5e13ae941dcb99749f1e0c04176 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.250473 9426 raft_consensus.cc:740] T a4b0a5e13ae941dcb99749f1e0c04176 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.250669 9426 consensus_queue.cc:260] T a4b0a5e13ae941dcb99749f1e0c04176 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.251951 9426 ts_tablet_manager.cc:1434] T a4b0a5e13ae941dcb99749f1e0c04176 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20251215 14:55:28.252241 9426 tablet_bootstrap.cc:492] T b34a860bf4244586948ae9eafe35103a P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:28.254562 11706 consensus_queue.cc:1048] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:28.255869 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:55:28.256728 9426 tablet_bootstrap.cc:654] T b34a860bf4244586948ae9eafe35103a P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.257607 8976 leader_election.cc:304] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:28.258482 11283 raft_consensus.cc:2804] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:28.258589 11283 raft_consensus.cc:697] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:28.258816 11283 consensus_queue.cc:237] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.265259 8978 leader_election.cc:304] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:28.265663 11878 raft_consensus.cc:2804] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:28.265803 11878 raft_consensus.cc:697] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:28.266026 11878 consensus_queue.cc:237] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.266650 9426 tablet_bootstrap.cc:492] T b34a860bf4244586948ae9eafe35103a P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:28.266841 9426 ts_tablet_manager.cc:1403] T b34a860bf4244586948ae9eafe35103a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.000s
I20251215 14:55:28.267285 11166 raft_consensus.cc:493] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.267475 11166 raft_consensus.cc:515] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.268304 11166 leader_election.cc:290] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.269726 11038 consensus_queue.cc:1048] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.271816 11679 raft_consensus.cc:493] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.271934 11679 raft_consensus.cc:515] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.272441 11679 leader_election.cc:290] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.277045 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "666af680888c4b3c81187d0195684bc7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.287057 11588 consensus_queue.cc:1048] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.287465 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "caefb83a990e4ad2baf621cd83265f96" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.287652 9171 raft_consensus.cc:2468] T caefb83a990e4ad2baf621cd83265f96 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.288197 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e6f6324610f44cefb0ce67fd76e0e001" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:28.288434 9311 raft_consensus.cc:3060] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.289112 8976 leader_election.cc:304] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:28.289438 9435 tablet_bootstrap.cc:492] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:28.289407 11588 raft_consensus.cc:2804] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:28.289489 11588 raft_consensus.cc:493] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:28.289543 11588 raft_consensus.cc:3060] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.289553 9435 ts_tablet_manager.cc:1403] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.066s user 0.009s sys 0.005s
I20251215 14:55:28.290211 9435 raft_consensus.cc:359] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.290341 9435 raft_consensus.cc:385] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.291404 9435 raft_consensus.cc:740] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.291584 9435 consensus_queue.cc:260] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.291973 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "666af680888c4b3c81187d0195684bc7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.292009 11588 raft_consensus.cc:515] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.292114 9300 raft_consensus.cc:2468] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.293006 9435 ts_tablet_manager.cc:1434] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:28.293154 9427 tablet_bootstrap.cc:492] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:28.293186 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "caefb83a990e4ad2baf621cd83265f96" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.293267 9435 tablet_bootstrap.cc:492] T 5bdbdc16389442f587d18347a2340fd5 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:28.293282 9427 ts_tablet_manager.cc:1403] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.071s user 0.003s sys 0.000s
I20251215 14:55:28.293319 9300 raft_consensus.cc:2468] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.293509 11588 leader_election.cc:290] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.294173 9427 raft_consensus.cc:359] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.294376 9427 raft_consensus.cc:385] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.294471 9427 raft_consensus.cc:740] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.294718 9427 consensus_queue.cc:260] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.290979 9311 raft_consensus.cc:2468] T e6f6324610f44cefb0ce67fd76e0e001 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:28.295262 9427 ts_tablet_manager.cc:1434] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:28.296064 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "caefb83a990e4ad2baf621cd83265f96" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:28.296638 9427 tablet_bootstrap.cc:492] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:28.296479 9179 raft_consensus.cc:3060] T caefb83a990e4ad2baf621cd83265f96 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:28.297814 8976 consensus_peers.cc:597] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:28.300597 9435 tablet_bootstrap.cc:654] T 5bdbdc16389442f587d18347a2340fd5 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.307111 9427 tablet_bootstrap.cc:654] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.311354 9426 raft_consensus.cc:359] T b34a860bf4244586948ae9eafe35103a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.311547 9426 raft_consensus.cc:385] T b34a860bf4244586948ae9eafe35103a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.311596 9426 raft_consensus.cc:740] T b34a860bf4244586948ae9eafe35103a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.312397 11283 consensus_queue.cc:1048] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.316428 11679 consensus_queue.cc:1048] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.324858 9179 raft_consensus.cc:2468] T caefb83a990e4ad2baf621cd83265f96 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:28.326189 8976 leader_election.cc:304] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:28.327061 11679 raft_consensus.cc:2804] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:28.327248 11679 raft_consensus.cc:697] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:28.327523 11679 consensus_queue.cc:237] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.328522 9426 consensus_queue.cc:260] T b34a860bf4244586948ae9eafe35103a P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.329046 9426 ts_tablet_manager.cc:1434] T b34a860bf4244586948ae9eafe35103a P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.062s user 0.002s sys 0.000s
I20251215 14:55:28.333824 9426 tablet_bootstrap.cc:492] T 4dd3af2da2c5445b962903d4475b0d58 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:28.335309 9426 tablet_bootstrap.cc:654] T 4dd3af2da2c5445b962903d4475b0d58 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.337116 9174 raft_consensus.cc:2468] T 666af680888c4b3c81187d0195684bc7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
W20251215 14:55:28.342769 8976 consensus_peers.cc:597] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:28.343755 11691 raft_consensus.cc:493] T 18802b48f9c04eccb369de25dd113c3f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.350647 11691 raft_consensus.cc:515] T 18802b48f9c04eccb369de25dd113c3f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.351567 11691 leader_election.cc:290] T 18802b48f9c04eccb369de25dd113c3f P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
W20251215 14:55:28.352140 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:55:28.352262 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:28.352748 11283 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:28.352873 8978 leader_election.cc:304] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:28.352958 11283 consensus_queue.cc:1048] T e6084ebf2a804bfc9d2c2cde3e0cba98 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.353078 11878 consensus_queue.cc:1048] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.353312 11745 raft_consensus.cc:2804] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:28.353374 11745 raft_consensus.cc:493] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:28.353442 11745 raft_consensus.cc:3060] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.356000 11745 raft_consensus.cc:515] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.357689 9426 tablet_bootstrap.cc:492] T 4dd3af2da2c5445b962903d4475b0d58 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:28.357805 9426 ts_tablet_manager.cc:1403] T 4dd3af2da2c5445b962903d4475b0d58 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.003s
I20251215 14:55:28.358453 9426 raft_consensus.cc:359] T 4dd3af2da2c5445b962903d4475b0d58 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.358606 9426 raft_consensus.cc:385] T 4dd3af2da2c5445b962903d4475b0d58 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.358650 9426 raft_consensus.cc:740] T 4dd3af2da2c5445b962903d4475b0d58 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.358536 11038 consensus_queue.cc:1048] T 7e8bf1cdbf2a48f59945268887cc5a2b P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.358819 9426 consensus_queue.cc:260] T 4dd3af2da2c5445b962903d4475b0d58 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.359339 9426 ts_tablet_manager.cc:1434] T 4dd3af2da2c5445b962903d4475b0d58 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20251215 14:55:28.359603 9426 tablet_bootstrap.cc:492] T 37554f8c1a90462095c511f00df6dece P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:28.361186 9426 tablet_bootstrap.cc:654] T 37554f8c1a90462095c511f00df6dece P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.364733 9427 tablet_bootstrap.cc:492] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:28.365079 11745 leader_election.cc:290] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.365504 9427 ts_tablet_manager.cc:1403] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.004s
I20251215 14:55:28.365767 9435 tablet_bootstrap.cc:492] T 5bdbdc16389442f587d18347a2340fd5 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:28.365886 9435 ts_tablet_manager.cc:1403] T 5bdbdc16389442f587d18347a2340fd5 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.073s user 0.006s sys 0.014s
I20251215 14:55:28.366894 9435 raft_consensus.cc:359] T 5bdbdc16389442f587d18347a2340fd5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.367055 9435 raft_consensus.cc:385] T 5bdbdc16389442f587d18347a2340fd5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.367110 9435 raft_consensus.cc:740] T 5bdbdc16389442f587d18347a2340fd5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.367301 9435 consensus_queue.cc:260] T 5bdbdc16389442f587d18347a2340fd5 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.367707 9172 raft_consensus.cc:3060] T 23ace8d6e2bb42de9368a06190a07431 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.368175 9435 ts_tablet_manager.cc:1434] T 5bdbdc16389442f587d18347a2340fd5 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:28.368419 9435 tablet_bootstrap.cc:492] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:28.370167 9435 tablet_bootstrap.cc:654] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.369488 9427 raft_consensus.cc:359] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.370287 9427 raft_consensus.cc:385] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.370677 9427 raft_consensus.cc:740] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.371968 9427 consensus_queue.cc:260] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.374511 9427 ts_tablet_manager.cc:1434] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.009s user 0.000s sys 0.002s
I20251215 14:55:28.375406 9427 tablet_bootstrap.cc:492] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:28.377331 11473 consensus_queue.cc:1048] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.379578 11706 raft_consensus.cc:493] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.380170 11706 raft_consensus.cc:515] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.380340 9435 tablet_bootstrap.cc:492] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:28.380476 9435 ts_tablet_manager.cc:1403] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.002s
I20251215 14:55:28.377367 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18802b48f9c04eccb369de25dd113c3f" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.381170 9435 raft_consensus.cc:359] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.381323 9435 raft_consensus.cc:385] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.381381 9435 raft_consensus.cc:740] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.381554 9435 consensus_queue.cc:260] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.381785 11706 leader_election.cc:290] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.382339 9435 ts_tablet_manager.cc:1434] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:28.382625 9178 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4da9d74efd427ca27431c54a84a3e9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.383034 9435 tablet_bootstrap.cc:492] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:28.382619 9177 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "666af680888c4b3c81187d0195684bc7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:28.384701 8976 leader_election.cc:343] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.385412 9435 tablet_bootstrap.cc:654] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.385596 9226 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
W20251215 14:55:28.386041 9249 consensus_peers.cc:597] T 5875cdedb77841359158f7f185ee30f6 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:28.386127 9427 tablet_bootstrap.cc:654] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.388077 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "18802b48f9c04eccb369de25dd113c3f" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:28.388549 9028 raft_consensus.cc:2393] T 18802b48f9c04eccb369de25dd113c3f P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:28.389425 9112 leader_election.cc:304] T 18802b48f9c04eccb369de25dd113c3f P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:28.389803 11860 raft_consensus.cc:3060] T 18802b48f9c04eccb369de25dd113c3f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.392391 11860 raft_consensus.cc:2749] T 18802b48f9c04eccb369de25dd113c3f P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:28.398947 9435 tablet_bootstrap.cc:492] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:28.399080 9435 ts_tablet_manager.cc:1403] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.003s
I20251215 14:55:28.399755 9435 raft_consensus.cc:359] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.400261 9435 raft_consensus.cc:385] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.400329 9435 raft_consensus.cc:740] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.400532 9435 consensus_queue.cc:260] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.401008 9435 ts_tablet_manager.cc:1434] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:28.401247 9435 tablet_bootstrap.cc:492] T 8f6bf35f57e94a1d983612561aa6f185 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:28.401389 11679 consensus_queue.cc:1048] T 0ea937af02b447e6a78cda0741cc8570 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.403059 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "caefb83a990e4ad2baf621cd83265f96" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:28.403261 9311 raft_consensus.cc:3060] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.405978 9311 raft_consensus.cc:2468] T caefb83a990e4ad2baf621cd83265f96 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:28.407953 9435 tablet_bootstrap.cc:654] T 8f6bf35f57e94a1d983612561aa6f185 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.408136 9426 tablet_bootstrap.cc:492] T 37554f8c1a90462095c511f00df6dece P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:28.408270 9426 ts_tablet_manager.cc:1403] T 37554f8c1a90462095c511f00df6dece P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.000s
I20251215 14:55:28.408968 9426 raft_consensus.cc:359] T 37554f8c1a90462095c511f00df6dece P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.409124 9426 raft_consensus.cc:385] T 37554f8c1a90462095c511f00df6dece P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.409184 9426 raft_consensus.cc:740] T 37554f8c1a90462095c511f00df6dece P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.409368 9426 consensus_queue.cc:260] T 37554f8c1a90462095c511f00df6dece P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.409874 9426 ts_tablet_manager.cc:1434] T 37554f8c1a90462095c511f00df6dece P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:28.410146 9426 tablet_bootstrap.cc:492] T 5bdbdc16389442f587d18347a2340fd5 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:28.411635 9426 tablet_bootstrap.cc:654] T 5bdbdc16389442f587d18347a2340fd5 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.423390 9435 tablet_bootstrap.cc:492] T 8f6bf35f57e94a1d983612561aa6f185 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:28.423556 9435 ts_tablet_manager.cc:1403] T 8f6bf35f57e94a1d983612561aa6f185 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.001s
I20251215 14:55:28.424335 9435 raft_consensus.cc:359] T 8f6bf35f57e94a1d983612561aa6f185 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.424496 9435 raft_consensus.cc:385] T 8f6bf35f57e94a1d983612561aa6f185 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.424543 9435 raft_consensus.cc:740] T 8f6bf35f57e94a1d983612561aa6f185 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.424714 9435 consensus_queue.cc:260] T 8f6bf35f57e94a1d983612561aa6f185 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.425197 9435 ts_tablet_manager.cc:1434] T 8f6bf35f57e94a1d983612561aa6f185 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:28.425304 9426 tablet_bootstrap.cc:492] T 5bdbdc16389442f587d18347a2340fd5 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:28.425449 9435 tablet_bootstrap.cc:492] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:28.425555 9426 ts_tablet_manager.cc:1403] T 5bdbdc16389442f587d18347a2340fd5 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.001s
I20251215 14:55:28.426604 9426 raft_consensus.cc:359] T 5bdbdc16389442f587d18347a2340fd5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.426895 9435 tablet_bootstrap.cc:654] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.426862 9426 raft_consensus.cc:385] T 5bdbdc16389442f587d18347a2340fd5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.426947 9426 raft_consensus.cc:740] T 5bdbdc16389442f587d18347a2340fd5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.427937 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "666af680888c4b3c81187d0195684bc7" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:28.428158 9311 raft_consensus.cc:3060] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.428411 9426 consensus_queue.cc:260] T 5bdbdc16389442f587d18347a2340fd5 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.429841 9426 ts_tablet_manager.cc:1434] T 5bdbdc16389442f587d18347a2340fd5 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:28.430369 9426 tablet_bootstrap.cc:492] T 4d809129224b4a74b42c0f7e370233f6 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:28.431044 9311 raft_consensus.cc:2468] T 666af680888c4b3c81187d0195684bc7 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:28.435113 9307 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4da9d74efd427ca27431c54a84a3e9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.438299 9435 tablet_bootstrap.cc:492] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:28.438513 9426 tablet_bootstrap.cc:654] T 4d809129224b4a74b42c0f7e370233f6 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.438923 9435 ts_tablet_manager.cc:1403] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.004s
I20251215 14:55:28.438963 11473 raft_consensus.cc:493] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.439194 11473 raft_consensus.cc:515] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.439638 9435 raft_consensus.cc:359] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.439782 9435 raft_consensus.cc:385] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.439834 9435 raft_consensus.cc:740] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.440001 9435 consensus_queue.cc:260] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.440403 9435 ts_tablet_manager.cc:1434] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:28.440645 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4b0a5e13ae941dcb99749f1e0c04176" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.440862 9174 raft_consensus.cc:2468] T a4b0a5e13ae941dcb99749f1e0c04176 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:28.441236 9249 leader_election.cc:304] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:28.441558 11174 raft_consensus.cc:2804] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:28.441632 11174 raft_consensus.cc:493] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:28.441689 11174 raft_consensus.cc:3060] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.443186 9435 tablet_bootstrap.cc:492] T fa73a61ff5be4cd2b590d72763bf7c5d P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:28.444046 11174 raft_consensus.cc:515] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.444686 9435 tablet_bootstrap.cc:654] T fa73a61ff5be4cd2b590d72763bf7c5d P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.445382 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4b0a5e13ae941dcb99749f1e0c04176" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:28.445513 9172 raft_consensus.cc:3060] T a4b0a5e13ae941dcb99749f1e0c04176 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.446756 11174 leader_election.cc:290] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.447811 9172 raft_consensus.cc:2468] T a4b0a5e13ae941dcb99749f1e0c04176 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:28.447840 11473 leader_election.cc:290] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.448225 9249 leader_election.cc:304] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:28.448494 11473 raft_consensus.cc:2804] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:28.448704 11473 raft_consensus.cc:697] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:28.448956 11473 consensus_queue.cc:237] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.449425 11588 consensus_queue.cc:1048] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.461345 9435 tablet_bootstrap.cc:492] T fa73a61ff5be4cd2b590d72763bf7c5d P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:28.461503 9435 ts_tablet_manager.cc:1403] T fa73a61ff5be4cd2b590d72763bf7c5d P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.004s
I20251215 14:55:28.462249 9435 raft_consensus.cc:359] T fa73a61ff5be4cd2b590d72763bf7c5d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:28.462423 9435 raft_consensus.cc:385] T fa73a61ff5be4cd2b590d72763bf7c5d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.462473 9435 raft_consensus.cc:740] T fa73a61ff5be4cd2b590d72763bf7c5d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.462672 9435 consensus_queue.cc:260] T fa73a61ff5be4cd2b590d72763bf7c5d P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:28.468089 9435 ts_tablet_manager.cc:1434] T fa73a61ff5be4cd2b590d72763bf7c5d P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20251215 14:55:28.468426 9435 tablet_bootstrap.cc:492] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:28.470144 9435 tablet_bootstrap.cc:654] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.476563 9426 tablet_bootstrap.cc:492] T 4d809129224b4a74b42c0f7e370233f6 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:28.482707 9426 ts_tablet_manager.cc:1403] T 4d809129224b4a74b42c0f7e370233f6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.052s user 0.006s sys 0.000s
I20251215 14:55:28.490897 9435 tablet_bootstrap.cc:492] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:28.491046 9435 ts_tablet_manager.cc:1403] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.002s
I20251215 14:55:28.491798 9435 raft_consensus.cc:359] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.491971 9435 raft_consensus.cc:385] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.492030 9435 raft_consensus.cc:740] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.496629 9435 consensus_queue.cc:260] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.497157 9435 ts_tablet_manager.cc:1434] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20251215 14:55:28.497400 9435 tablet_bootstrap.cc:492] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:28.497298 11679 consensus_queue.cc:1048] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.498109 9427 tablet_bootstrap.cc:492] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:28.498253 9427 ts_tablet_manager.cc:1403] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.123s user 0.003s sys 0.007s
I20251215 14:55:28.498991 9427 raft_consensus.cc:359] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:28.499516 9427 raft_consensus.cc:385] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.499619 9427 raft_consensus.cc:740] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.500005 9427 consensus_queue.cc:260] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:28.500414 11679 consensus_queue.cc:1048] T 90c7925890474a76b35a3ce5e6db8ebf P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.501116 9427 ts_tablet_manager.cc:1434] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251215 14:55:28.501385 9435 tablet_bootstrap.cc:654] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.504340 9427 tablet_bootstrap.cc:492] T 6c9bc7a7bd4447dba112999eff69c932 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:28.504437 9426 raft_consensus.cc:359] T 4d809129224b4a74b42c0f7e370233f6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.506771 9426 raft_consensus.cc:385] T 4d809129224b4a74b42c0f7e370233f6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.507472 9426 raft_consensus.cc:740] T 4d809129224b4a74b42c0f7e370233f6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.509614 9426 consensus_queue.cc:260] T 4d809129224b4a74b42c0f7e370233f6 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.512171 11691 raft_consensus.cc:493] T 4dd3af2da2c5445b962903d4475b0d58 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.512288 11691 raft_consensus.cc:515] T 4dd3af2da2c5445b962903d4475b0d58 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.512900 11691 leader_election.cc:290] T 4dd3af2da2c5445b962903d4475b0d58 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.513909 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4dd3af2da2c5445b962903d4475b0d58" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.514731 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4dd3af2da2c5445b962903d4475b0d58" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:28.515003 9027 raft_consensus.cc:2393] T 4dd3af2da2c5445b962903d4475b0d58 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:28.515486 9112 leader_election.cc:304] T 4dd3af2da2c5445b962903d4475b0d58 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:28.515327 9426 ts_tablet_manager.cc:1434] T 4d809129224b4a74b42c0f7e370233f6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.031s user 0.000s sys 0.003s
I20251215 14:55:28.515592 9435 tablet_bootstrap.cc:492] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:28.515720 9435 ts_tablet_manager.cc:1403] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.005s
I20251215 14:55:28.515915 11860 raft_consensus.cc:3060] T 4dd3af2da2c5445b962903d4475b0d58 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.516404 9435 raft_consensus.cc:359] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.516541 9435 raft_consensus.cc:385] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.516589 9435 raft_consensus.cc:740] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.516764 9435 consensus_queue.cc:260] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.517205 9435 ts_tablet_manager.cc:1434] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:28.517223 9426 tablet_bootstrap.cc:492] T 95b78c1518f1481794948f2db1055f38 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:28.517740 9435 tablet_bootstrap.cc:492] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:28.518473 11860 raft_consensus.cc:2749] T 4dd3af2da2c5445b962903d4475b0d58 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:28.526890 11484 raft_consensus.cc:493] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.527053 11484 raft_consensus.cc:515] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.527674 11484 leader_election.cc:290] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.528057 9435 tablet_bootstrap.cc:654] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.528355 11679 raft_consensus.cc:493] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.528435 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6c9bc7a7bd4447dba112999eff69c932" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.528703 11679 raft_consensus.cc:515] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
W20251215 14:55:28.528893 9249 leader_election.cc:343] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.534379 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de5ba7f2b5c84ac39e4019a0b9532176" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.534623 9171 raft_consensus.cc:2468] T de5ba7f2b5c84ac39e4019a0b9532176 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.536844 11484 raft_consensus.cc:493] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.536975 11484 raft_consensus.cc:515] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.537529 11484 leader_election.cc:290] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.538183 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8ffa009bae84660b331ebeddcccc266" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.538208 8976 leader_election.cc:304] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:28.538704 11679 leader_election.cc:290] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:28.538722 9249 leader_election.cc:343] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.539295 11166 raft_consensus.cc:2804] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:28.539386 11166 raft_consensus.cc:493] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:28.539446 11166 raft_consensus.cc:3060] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.542018 9427 tablet_bootstrap.cc:654] T 6c9bc7a7bd4447dba112999eff69c932 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.542460 11166 raft_consensus.cc:515] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.542742 9426 tablet_bootstrap.cc:654] T 95b78c1518f1481794948f2db1055f38 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.543658 11166 leader_election.cc:290] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.546679 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de5ba7f2b5c84ac39e4019a0b9532176" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:28.546849 9171 raft_consensus.cc:3060] T de5ba7f2b5c84ac39e4019a0b9532176 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.549866 9171 raft_consensus.cc:2468] T de5ba7f2b5c84ac39e4019a0b9532176 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:28.553601 8976 leader_election.cc:304] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:28.553984 11588 raft_consensus.cc:2804] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:28.554088 11588 raft_consensus.cc:697] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:28.554375 11588 consensus_queue.cc:237] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.574107 8978 leader_election.cc:304] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:28.574651 11745 raft_consensus.cc:2804] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:28.574813 11745 raft_consensus.cc:697] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:28.575093 11745 consensus_queue.cc:237] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.575630 9435 tablet_bootstrap.cc:492] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:28.575779 9435 ts_tablet_manager.cc:1403] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.058s user 0.006s sys 0.005s
I20251215 14:55:28.576493 9435 raft_consensus.cc:359] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.576666 9435 raft_consensus.cc:385] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.576725 9435 raft_consensus.cc:740] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.576891 9435 consensus_queue.cc:260] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.577359 9435 ts_tablet_manager.cc:1434] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:28.577620 9435 tablet_bootstrap.cc:492] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:28.579109 9435 tablet_bootstrap.cc:654] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.582486 11588 consensus_queue.cc:1048] T 5e5c1626a30444bf987a7d7e09a586f7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.583714 11588 consensus_queue.cc:1048] T b34a860bf4244586948ae9eafe35103a P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.584606 11588 consensus_queue.cc:1048] T 02e391ec04cf44c881f31d0ba53af2e9 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.585394 11588 consensus_queue.cc:1048] T 20f30d23a43f43749f6f9054a18a84a8 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.585808 9426 tablet_bootstrap.cc:492] T 95b78c1518f1481794948f2db1055f38 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:28.585961 9426 ts_tablet_manager.cc:1403] T 95b78c1518f1481794948f2db1055f38 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.069s user 0.005s sys 0.000s
I20251215 14:55:28.586328 11588 consensus_queue.cc:1048] T 7bacba021777416e9c547469aa08bd9c P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:28.590421 8978 leader_election.cc:343] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.586597 9426 raft_consensus.cc:359] T 95b78c1518f1481794948f2db1055f38 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.590586 8978 leader_election.cc:304] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:28.591069 11745 raft_consensus.cc:2749] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:28.590960 9426 raft_consensus.cc:385] T 95b78c1518f1481794948f2db1055f38 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.591475 9426 raft_consensus.cc:740] T 95b78c1518f1481794948f2db1055f38 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.593849 9426 consensus_queue.cc:260] T 95b78c1518f1481794948f2db1055f38 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.599097 9426 ts_tablet_manager.cc:1434] T 95b78c1518f1481794948f2db1055f38 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.013s user 0.003s sys 0.000s
I20251215 14:55:28.600076 9435 tablet_bootstrap.cc:492] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:28.600220 9435 ts_tablet_manager.cc:1403] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.004s
I20251215 14:55:28.600544 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4b0a5e13ae941dcb99749f1e0c04176" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:28.601110 9435 raft_consensus.cc:359] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.601274 9435 raft_consensus.cc:385] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.601331 9435 raft_consensus.cc:740] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.601511 9435 consensus_queue.cc:260] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.601994 9435 ts_tablet_manager.cc:1434] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:28.602000 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4b0a5e13ae941dcb99749f1e0c04176" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:28.602227 9435 tablet_bootstrap.cc:492] T a9ed7d1946ba433eb8b19ccf6a84b7ad P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:28.602319 9426 tablet_bootstrap.cc:492] T d531a17b6d1d47fa9606e0a8206b3bfd P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:28.603847 9435 tablet_bootstrap.cc:654] T a9ed7d1946ba433eb8b19ccf6a84b7ad P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.603937 9426 tablet_bootstrap.cc:654] T d531a17b6d1d47fa9606e0a8206b3bfd P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.605908 9427 tablet_bootstrap.cc:492] T 6c9bc7a7bd4447dba112999eff69c932 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:28.606040 9427 ts_tablet_manager.cc:1403] T 6c9bc7a7bd4447dba112999eff69c932 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.103s user 0.004s sys 0.004s
I20251215 14:55:28.606638 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6c9bc7a7bd4447dba112999eff69c932" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:28.606688 9427 raft_consensus.cc:359] T 6c9bc7a7bd4447dba112999eff69c932 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.606904 9427 raft_consensus.cc:385] T 6c9bc7a7bd4447dba112999eff69c932 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.606971 9427 raft_consensus.cc:740] T 6c9bc7a7bd4447dba112999eff69c932 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.607148 9427 consensus_queue.cc:260] T 6c9bc7a7bd4447dba112999eff69c932 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.607650 9427 ts_tablet_manager.cc:1434] T 6c9bc7a7bd4447dba112999eff69c932 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251215 14:55:28.607905 9427 tablet_bootstrap.cc:492] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:28.608124 9028 raft_consensus.cc:2468] T 6c9bc7a7bd4447dba112999eff69c932 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:28.609205 9427 tablet_bootstrap.cc:654] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.609345 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8ffa009bae84660b331ebeddcccc266" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:28.609982 9028 raft_consensus.cc:2468] T e8ffa009bae84660b331ebeddcccc266 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:28.615242 9435 tablet_bootstrap.cc:492] T a9ed7d1946ba433eb8b19ccf6a84b7ad P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:28.615676 9435 ts_tablet_manager.cc:1403] T a9ed7d1946ba433eb8b19ccf6a84b7ad P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.005s
I20251215 14:55:28.616416 9435 raft_consensus.cc:359] T a9ed7d1946ba433eb8b19ccf6a84b7ad P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.616575 9435 raft_consensus.cc:385] T a9ed7d1946ba433eb8b19ccf6a84b7ad P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.616618 9435 raft_consensus.cc:740] T a9ed7d1946ba433eb8b19ccf6a84b7ad P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.616776 9435 consensus_queue.cc:260] T a9ed7d1946ba433eb8b19ccf6a84b7ad P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.617201 9435 ts_tablet_manager.cc:1434] T a9ed7d1946ba433eb8b19ccf6a84b7ad P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:28.617430 9435 tablet_bootstrap.cc:492] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4: Bootstrap starting.
I20251215 14:55:28.618917 9435 tablet_bootstrap.cc:654] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.621866 9427 tablet_bootstrap.cc:492] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:28.622058 9427 ts_tablet_manager.cc:1403] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.003s
I20251215 14:55:28.623205 9361 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:28.623198 9427 raft_consensus.cc:359] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.623452 9427 raft_consensus.cc:385] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.623546 9427 raft_consensus.cc:740] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.623852 9427 consensus_queue.cc:260] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.624747 9427 ts_tablet_manager.cc:1434] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20251215 14:55:28.625500 9427 tablet_bootstrap.cc:492] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:28.627096 11860 raft_consensus.cc:493] T 95b78c1518f1481794948f2db1055f38 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.627236 11860 raft_consensus.cc:515] T 95b78c1518f1481794948f2db1055f38 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.627787 11860 leader_election.cc:290] T 95b78c1518f1481794948f2db1055f38 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.628836 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95b78c1518f1481794948f2db1055f38" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.629037 9311 raft_consensus.cc:2393] T 95b78c1518f1481794948f2db1055f38 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:28.634053 9427 tablet_bootstrap.cc:654] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.636236 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95b78c1518f1481794948f2db1055f38" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:28.637102 9112 leader_election.cc:304] T 95b78c1518f1481794948f2db1055f38 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:28.637573 11860 raft_consensus.cc:3060] T 95b78c1518f1481794948f2db1055f38 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.643450 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de5ba7f2b5c84ac39e4019a0b9532176" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.643692 9311 raft_consensus.cc:2468] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.645393 9311 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "de5ba7f2b5c84ac39e4019a0b9532176" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:28.645598 9311 raft_consensus.cc:3060] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.649122 9311 raft_consensus.cc:2468] T de5ba7f2b5c84ac39e4019a0b9532176 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:28.653548 9426 tablet_bootstrap.cc:492] T d531a17b6d1d47fa9606e0a8206b3bfd P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:28.653828 9426 ts_tablet_manager.cc:1403] T d531a17b6d1d47fa9606e0a8206b3bfd P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.052s user 0.007s sys 0.001s
I20251215 14:55:28.656703 9426 raft_consensus.cc:359] T d531a17b6d1d47fa9606e0a8206b3bfd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.657063 9426 raft_consensus.cc:385] T d531a17b6d1d47fa9606e0a8206b3bfd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.657186 9426 raft_consensus.cc:740] T d531a17b6d1d47fa9606e0a8206b3bfd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.660073 11860 raft_consensus.cc:2749] T 95b78c1518f1481794948f2db1055f38 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:28.657575 9426 consensus_queue.cc:260] T d531a17b6d1d47fa9606e0a8206b3bfd P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.661228 9426 ts_tablet_manager.cc:1434] T d531a17b6d1d47fa9606e0a8206b3bfd P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s
I20251215 14:55:28.663451 9427 tablet_bootstrap.cc:492] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:28.663725 9427 ts_tablet_manager.cc:1403] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.003s
I20251215 14:55:28.662168 9426 tablet_bootstrap.cc:492] T e1d4dc7d18f7448880b79af99283c99f P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:28.666545 9427 raft_consensus.cc:359] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.667243 9427 raft_consensus.cc:385] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.667503 9427 raft_consensus.cc:740] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.668287 9427 consensus_queue.cc:260] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.671591 9427 ts_tablet_manager.cc:1434] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
W20251215 14:55:28.672034 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:28.672696 9435 tablet_bootstrap.cc:492] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4: No bootstrap required, opened a new log
I20251215 14:55:28.672886 9435 ts_tablet_manager.cc:1403] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4: Time spent bootstrapping tablet: real 0.056s user 0.021s sys 0.012s
I20251215 14:55:28.673095 9426 tablet_bootstrap.cc:654] T e1d4dc7d18f7448880b79af99283c99f P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.674005 9427 tablet_bootstrap.cc:492] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:28.674538 9435 raft_consensus.cc:359] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.679456 9435 raft_consensus.cc:385] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.679620 9435 raft_consensus.cc:740] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e89303a500544272b601d7c29be802b4, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.680292 9435 consensus_queue.cc:260] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.681316 9435 ts_tablet_manager.cc:1434] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20251215 14:55:28.682051 9427 tablet_bootstrap.cc:654] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.684263 11706 raft_consensus.cc:493] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.684368 11588 raft_consensus.cc:493] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.684456 11706 raft_consensus.cc:515] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:28.685145 11706 leader_election.cc:290] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.684461 11588 raft_consensus.cc:515] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.685848 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa73a61ff5be4cd2b590d72763bf7c5d" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.686085 11588 leader_election.cc:290] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:28.687144 8976 leader_election.cc:343] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.687683 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bdbdc16389442f587d18347a2340fd5" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.687851 9172 raft_consensus.cc:2468] T 5bdbdc16389442f587d18347a2340fd5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.688198 8976 leader_election.cc:304] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:28.688473 11706 raft_consensus.cc:2804] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:28.688556 11706 raft_consensus.cc:493] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:28.688624 11706 raft_consensus.cc:3060] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.693419 11706 raft_consensus.cc:515] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.694468 11706 leader_election.cc:290] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.696005 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bdbdc16389442f587d18347a2340fd5" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:28.696188 9172 raft_consensus.cc:3060] T 5bdbdc16389442f587d18347a2340fd5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.698830 9172 raft_consensus.cc:2468] T 5bdbdc16389442f587d18347a2340fd5 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:28.699507 8976 leader_election.cc:304] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:28.699790 11588 raft_consensus.cc:2804] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:28.699910 11588 raft_consensus.cc:697] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:28.700145 11588 consensus_queue.cc:237] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.702013 9427 tablet_bootstrap.cc:492] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:28.705224 9426 tablet_bootstrap.cc:492] T e1d4dc7d18f7448880b79af99283c99f P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:28.705499 9426 ts_tablet_manager.cc:1403] T e1d4dc7d18f7448880b79af99283c99f P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.007s
I20251215 14:55:28.707484 9426 raft_consensus.cc:359] T e1d4dc7d18f7448880b79af99283c99f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.707928 9426 raft_consensus.cc:385] T e1d4dc7d18f7448880b79af99283c99f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.708012 9426 raft_consensus.cc:740] T e1d4dc7d18f7448880b79af99283c99f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.708374 9426 consensus_queue.cc:260] T e1d4dc7d18f7448880b79af99283c99f P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.709246 9427 ts_tablet_manager.cc:1403] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.036s user 0.005s sys 0.001s
I20251215 14:55:28.711141 9426 ts_tablet_manager.cc:1434] T e1d4dc7d18f7448880b79af99283c99f P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20251215 14:55:28.712949 9427 raft_consensus.cc:359] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.716575 11588 raft_consensus.cc:493] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.721127 11588 raft_consensus.cc:515] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.722311 11588 leader_election.cc:290] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.713510 9427 raft_consensus.cc:385] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.722806 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1d4dc7d18f7448880b79af99283c99f" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.722992 9172 raft_consensus.cc:2468] T e1d4dc7d18f7448880b79af99283c99f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.723102 9427 raft_consensus.cc:740] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.723417 8976 leader_election.cc:304] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:28.724388 11588 raft_consensus.cc:2804] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:28.724470 11588 raft_consensus.cc:493] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:28.724536 11588 raft_consensus.cc:3060] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.724505 9427 consensus_queue.cc:260] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.728224 9427 ts_tablet_manager.cc:1434] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.019s user 0.002s sys 0.001s
I20251215 14:55:28.728912 11588 raft_consensus.cc:515] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.729525 9427 tablet_bootstrap.cc:492] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:28.730684 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1d4dc7d18f7448880b79af99283c99f" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:28.730971 9179 raft_consensus.cc:3060] T e1d4dc7d18f7448880b79af99283c99f P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.734520 9179 raft_consensus.cc:2468] T e1d4dc7d18f7448880b79af99283c99f P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:28.734969 8976 leader_election.cc:304] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:28.735541 11745 raft_consensus.cc:2804] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:28.735653 11745 raft_consensus.cc:697] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:28.735867 11745 consensus_queue.cc:237] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.739771 11552 raft_consensus.cc:493] T b34a860bf4244586948ae9eafe35103a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.739892 11552 raft_consensus.cc:515] T b34a860bf4244586948ae9eafe35103a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.740401 11552 leader_election.cc:290] T b34a860bf4244586948ae9eafe35103a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.741001 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b34a860bf4244586948ae9eafe35103a" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:28.741914 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b34a860bf4244586948ae9eafe35103a" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.742452 9115 leader_election.cc:304] T b34a860bf4244586948ae9eafe35103a P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:28.742703 11552 raft_consensus.cc:2749] T b34a860bf4244586948ae9eafe35103a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:28.745715 9179 raft_consensus.cc:3060] T 4d809129224b4a74b42c0f7e370233f6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.749702 11706 consensus_queue.cc:1048] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.750149 9427 tablet_bootstrap.cc:654] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.751466 11588 leader_election.cc:290] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.751921 11588 raft_consensus.cc:493] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.752128 11588 raft_consensus.cc:515] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.753172 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9ed7d1946ba433eb8b19ccf6a84b7ad" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.753320 11588 leader_election.cc:290] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:28.753695 8976 leader_election.cc:343] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.761385 9426 tablet_bootstrap.cc:492] T 5875cdedb77841359158f7f185ee30f6 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:28.763118 9426 tablet_bootstrap.cc:654] T 5875cdedb77841359158f7f185ee30f6 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.776180 9296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa73a61ff5be4cd2b590d72763bf7c5d" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.776367 9296 raft_consensus.cc:2468] T fa73a61ff5be4cd2b590d72763bf7c5d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.776958 9296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bdbdc16389442f587d18347a2340fd5" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.777115 9296 raft_consensus.cc:2468] T 5bdbdc16389442f587d18347a2340fd5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.778153 9296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bdbdc16389442f587d18347a2340fd5" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:28.778286 9296 raft_consensus.cc:3060] T 5bdbdc16389442f587d18347a2340fd5 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.781024 9296 raft_consensus.cc:2468] T 5bdbdc16389442f587d18347a2340fd5 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:28.788480 11473 raft_consensus.cc:493] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.790622 11473 raft_consensus.cc:515] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.791199 11473 leader_election.cc:290] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.792078 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ae3004e4a76422397c6e1761d020e38" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:28.792616 9249 leader_election.cc:343] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.798722 11588 raft_consensus.cc:493] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.799520 11588 raft_consensus.cc:515] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.799853 11745 raft_consensus.cc:493] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.801518 11745 raft_consensus.cc:515] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.802059 11745 leader_election.cc:290] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.802831 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f6bf35f57e94a1d983612561aa6f185" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:28.803391 8976 leader_election.cc:343] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.804334 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bfe7f2bc9b04aaeb6102b6b673d9379" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:28.805349 8976 leader_election.cc:343] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.806592 11588 leader_election.cc:290] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.812718 9179 raft_consensus.cc:3060] T d6fd306fb2544afa8a60d5e7a093d76b P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.818792 11611 raft_consensus.cc:493] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.818926 11611 raft_consensus.cc:515] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.819478 11611 leader_election.cc:290] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.820142 11174 consensus_queue.cc:1048] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.820497 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e751be4722043928e6977c48c359aae" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:28.821672 9249 leader_election.cc:343] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.823899 11611 consensus_queue.cc:1048] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.855317 11038 raft_consensus.cc:493] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.855479 11038 raft_consensus.cc:515] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.856040 11038 leader_election.cc:290] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.856899 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b6e5ac88fc74d66a3f74fb69eb01455" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:28.857733 9249 leader_election.cc:343] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.865537 9426 tablet_bootstrap.cc:492] T 5875cdedb77841359158f7f185ee30f6 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:28.865682 9426 ts_tablet_manager.cc:1403] T 5875cdedb77841359158f7f185ee30f6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.104s user 0.000s sys 0.009s
I20251215 14:55:28.866426 9426 raft_consensus.cc:359] T 5875cdedb77841359158f7f185ee30f6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.866604 9426 raft_consensus.cc:385] T 5875cdedb77841359158f7f185ee30f6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.866654 9426 raft_consensus.cc:740] T 5875cdedb77841359158f7f185ee30f6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.866823 9426 consensus_queue.cc:260] T 5875cdedb77841359158f7f185ee30f6 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.867311 9426 ts_tablet_manager.cc:1434] T 5875cdedb77841359158f7f185ee30f6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:28.867580 9426 tablet_bootstrap.cc:492] T e9f514f7656247fd90f550b4132a15e6 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:28.869196 9426 tablet_bootstrap.cc:654] T e9f514f7656247fd90f550b4132a15e6 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.871208 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1d4dc7d18f7448880b79af99283c99f" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.871382 9304 raft_consensus.cc:2468] T e1d4dc7d18f7448880b79af99283c99f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.871529 9307 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1d4dc7d18f7448880b79af99283c99f" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:28.871685 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9ed7d1946ba433eb8b19ccf6a84b7ad" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.871819 9304 raft_consensus.cc:2468] T a9ed7d1946ba433eb8b19ccf6a84b7ad P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.872241 9301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f6bf35f57e94a1d983612561aa6f185" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.872360 9301 raft_consensus.cc:2468] T 8f6bf35f57e94a1d983612561aa6f185 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.872768 9299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bfe7f2bc9b04aaeb6102b6b673d9379" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:28.872886 9299 raft_consensus.cc:2468] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:28.871682 9307 raft_consensus.cc:3060] T e1d4dc7d18f7448880b79af99283c99f P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.875984 9307 raft_consensus.cc:2468] T e1d4dc7d18f7448880b79af99283c99f P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:28.885618 11038 raft_consensus.cc:493] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.885756 11038 raft_consensus.cc:515] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.886327 11038 leader_election.cc:290] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.887009 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9f514f7656247fd90f550b4132a15e6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.888242 9427 tablet_bootstrap.cc:492] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:28.888373 9427 ts_tablet_manager.cc:1403] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.159s user 0.008s sys 0.000s
W20251215 14:55:28.888881 9249 leader_election.cc:343] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.889037 9427 raft_consensus.cc:359] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.889182 9427 raft_consensus.cc:385] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.889230 9427 raft_consensus.cc:740] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.889396 9427 consensus_queue.cc:260] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.889850 9427 ts_tablet_manager.cc:1434] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:28.890091 9427 tablet_bootstrap.cc:492] T a4b0a5e13ae941dcb99749f1e0c04176 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
W20251215 14:55:28.899608 8976 consensus_peers.cc:597] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:28.907670 11038 consensus_queue.cc:1048] T 23ace8d6e2bb42de9368a06190a07431 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.908531 11038 consensus_queue.cc:1048] T 2ca89ec0fe3647ad9c3e62d16640bb20 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:28.909027 9248 leader_election.cc:343] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:28.910265 9248 leader_election.cc:343] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.914249 9248 leader_election.cc:304] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:28.915279 11174 raft_consensus.cc:2804] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:28.915361 11174 raft_consensus.cc:493] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:28.915423 11174 raft_consensus.cc:3060] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.915935 9427 tablet_bootstrap.cc:654] T a4b0a5e13ae941dcb99749f1e0c04176 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:28.916488 9248 leader_election.cc:304] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:28.917814 11484 raft_consensus.cc:2804] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:28.917886 11484 raft_consensus.cc:493] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:28.917960 11484 raft_consensus.cc:3060] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:28.918008 11174 raft_consensus.cc:515] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.919026 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6c9bc7a7bd4447dba112999eff69c932" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:28.919611 9249 leader_election.cc:343] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.920118 11174 leader_election.cc:290] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.920415 11484 raft_consensus.cc:515] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.920948 11484 leader_election.cc:290] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.922397 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8ffa009bae84660b331ebeddcccc266" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:28.922998 9249 leader_election.cc:343] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.942291 11745 consensus_queue.cc:1048] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:28.947081 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 6a7a401d5386499183b6560411f593b6 (table default.Table_11bd06e0cea44252b4cf0e27aca273da [id=7e8561f684374b289185e72f3027003d], current schema version=5) failed: Not found: failed to reset TS proxy: No leader found: Tablet 6a7a401d5386499183b6560411f593b6 consensus state has no leader
I20251215 14:55:28.949920 11745 raft_consensus.cc:493] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.949960 9426 tablet_bootstrap.cc:492] T e9f514f7656247fd90f550b4132a15e6 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:28.950053 11745 raft_consensus.cc:515] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.950152 9426 ts_tablet_manager.cc:1403] T e9f514f7656247fd90f550b4132a15e6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.083s user 0.002s sys 0.002s
I20251215 14:55:28.950636 11745 leader_election.cc:290] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:28.951154 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9f514f7656247fd90f550b4132a15e6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:28.951469 9426 raft_consensus.cc:359] T e9f514f7656247fd90f550b4132a15e6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
W20251215 14:55:28.951665 8976 leader_election.cc:343] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:28.951730 9426 raft_consensus.cc:385] T e9f514f7656247fd90f550b4132a15e6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:28.951864 9426 raft_consensus.cc:740] T e9f514f7656247fd90f550b4132a15e6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:28.952688 9426 consensus_queue.cc:260] T e9f514f7656247fd90f550b4132a15e6 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.957268 9426 ts_tablet_manager.cc:1434] T e9f514f7656247fd90f550b4132a15e6 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20251215 14:55:28.961051 9426 tablet_bootstrap.cc:492] T e8ffa009bae84660b331ebeddcccc266 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:28.972524 11484 raft_consensus.cc:493] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:28.972684 11484 raft_consensus.cc:515] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:28.973266 11484 leader_election.cc:290] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:28.973729 11588 consensus_queue.cc:1048] T 37554f8c1a90462095c511f00df6dece P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:28.974644 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f909de19a0184e5b8d54a04ed11a9c70" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:28.975241 9249 leader_election.cc:343] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:29.002415 9426 tablet_bootstrap.cc:654] T e8ffa009bae84660b331ebeddcccc266 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.020895 9427 tablet_bootstrap.cc:492] T a4b0a5e13ae941dcb99749f1e0c04176 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:29.021054 9427 ts_tablet_manager.cc:1403] T a4b0a5e13ae941dcb99749f1e0c04176 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.131s user 0.007s sys 0.000s
I20251215 14:55:29.023602 8978 leader_election.cc:304] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.023860 11706 raft_consensus.cc:2804] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:29.023996 11706 raft_consensus.cc:493] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:29.024150 11706 raft_consensus.cc:3060] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.027985 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ae3004e4a76422397c6e1761d020e38" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:29.031543 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e751be4722043928e6977c48c359aae" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:29.031705 9028 raft_consensus.cc:2468] T 5e751be4722043928e6977c48c359aae P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:29.030645 9427 raft_consensus.cc:359] T a4b0a5e13ae941dcb99749f1e0c04176 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.032415 9427 raft_consensus.cc:385] T a4b0a5e13ae941dcb99749f1e0c04176 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.034730 9426 tablet_bootstrap.cc:492] T e8ffa009bae84660b331ebeddcccc266 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:29.035277 9426 ts_tablet_manager.cc:1403] T e8ffa009bae84660b331ebeddcccc266 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.074s user 0.005s sys 0.000s
I20251215 14:55:29.036548 9426 raft_consensus.cc:359] T e8ffa009bae84660b331ebeddcccc266 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.036856 9426 raft_consensus.cc:385] T e8ffa009bae84660b331ebeddcccc266 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.037007 9426 raft_consensus.cc:740] T e8ffa009bae84660b331ebeddcccc266 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.037385 9427 raft_consensus.cc:740] T a4b0a5e13ae941dcb99749f1e0c04176 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.038028 9426 consensus_queue.cc:260] T e8ffa009bae84660b331ebeddcccc266 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.038960 9426 ts_tablet_manager.cc:1434] T e8ffa009bae84660b331ebeddcccc266 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20251215 14:55:29.039697 9427 consensus_queue.cc:260] T a4b0a5e13ae941dcb99749f1e0c04176 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.040871 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b6e5ac88fc74d66a3f74fb69eb01455" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:29.041030 9028 raft_consensus.cc:2468] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:29.042567 9426 tablet_bootstrap.cc:492] T 266937328422421ab6880d7f7410683e P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:29.043104 11706 raft_consensus.cc:515] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:29.048656 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa73a61ff5be4cd2b590d72763bf7c5d" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:29.049129 8976 leader_election.cc:343] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:29.049268 11706 leader_election.cc:290] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:29.054656 8978 leader_election.cc:304] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.055055 11588 raft_consensus.cc:2804] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:29.055173 11588 raft_consensus.cc:493] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:29.055186 11484 consensus_queue.cc:1048] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.055279 11588 raft_consensus.cc:3060] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.055550 9426 tablet_bootstrap.cc:654] T 266937328422421ab6880d7f7410683e P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.056447 11952 raft_consensus.cc:493] T 5875cdedb77841359158f7f185ee30f6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:29.056553 11952 raft_consensus.cc:515] T 5875cdedb77841359158f7f185ee30f6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.057050 11952 leader_election.cc:290] T 5875cdedb77841359158f7f185ee30f6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:29.057687 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5875cdedb77841359158f7f185ee30f6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:29.058238 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5875cdedb77841359158f7f185ee30f6" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:29.058444 11588 raft_consensus.cc:515] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.058866 9112 leader_election.cc:304] T 5875cdedb77841359158f7f185ee30f6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:29.059075 11952 raft_consensus.cc:2749] T 5875cdedb77841359158f7f185ee30f6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:29.059407 11588 leader_election.cc:290] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:29.059861 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9ed7d1946ba433eb8b19ccf6a84b7ad" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:29.060423 8976 leader_election.cc:343] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:29.060343 11706 consensus_queue.cc:1048] T 4d809129224b4a74b42c0f7e370233f6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.064555 8978 leader_election.cc:304] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.064947 11588 raft_consensus.cc:2804] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:29.065176 9427 ts_tablet_manager.cc:1434] T a4b0a5e13ae941dcb99749f1e0c04176 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.043s user 0.002s sys 0.001s
I20251215 14:55:29.065706 9427 tablet_bootstrap.cc:492] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:29.068475 11588 raft_consensus.cc:493] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:29.069526 11588 raft_consensus.cc:3060] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.072194 11588 raft_consensus.cc:515] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.073329 11588 leader_election.cc:290] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:29.073643 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f6bf35f57e94a1d983612561aa6f185" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:29.074335 11166 consensus_queue.cc:1048] T 95b78c1518f1481794948f2db1055f38 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.074425 8978 leader_election.cc:304] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.074661 11679 raft_consensus.cc:2804] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:29.074744 11679 raft_consensus.cc:493] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:29.074829 11679 raft_consensus.cc:3060] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:29.075011 8976 leader_election.cc:343] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:29.077266 11679 raft_consensus.cc:515] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.077836 11679 leader_election.cc:290] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:29.078857 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bfe7f2bc9b04aaeb6102b6b673d9379" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:29.079370 8976 leader_election.cc:343] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
W20251215 14:55:29.114301 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:29.119867 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9f514f7656247fd90f550b4132a15e6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:29.120148 9028 raft_consensus.cc:2468] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:29.120920 11679 consensus_queue.cc:1048] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.125524 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6c9bc7a7bd4447dba112999eff69c932" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:29.125751 9024 raft_consensus.cc:3060] T 6c9bc7a7bd4447dba112999eff69c932 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.128389 9024 raft_consensus.cc:2468] T 6c9bc7a7bd4447dba112999eff69c932 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:29.130754 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8ffa009bae84660b331ebeddcccc266" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:29.131014 9024 raft_consensus.cc:3060] T e8ffa009bae84660b331ebeddcccc266 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.131577 11473 raft_consensus.cc:493] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:29.131701 11473 raft_consensus.cc:515] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.132225 11473 leader_election.cc:290] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:29.132860 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3e5c385232140079705470ad2d6e020" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:29.133371 9249 leader_election.cc:343] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:29.134123 9170 raft_consensus.cc:3060] T b34a860bf4244586948ae9eafe35103a P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.134501 9024 raft_consensus.cc:2468] T e8ffa009bae84660b331ebeddcccc266 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:29.135658 11679 raft_consensus.cc:493] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:29.135787 11679 raft_consensus.cc:515] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.136677 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f909de19a0184e5b8d54a04ed11a9c70" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:29.136749 11679 leader_election.cc:290] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:29.137154 8976 leader_election.cc:343] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:29.137874 11952 raft_consensus.cc:493] T 37554f8c1a90462095c511f00df6dece P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:29.137984 11952 raft_consensus.cc:515] T 37554f8c1a90462095c511f00df6dece P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.138505 11952 leader_election.cc:290] T 37554f8c1a90462095c511f00df6dece P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:29.139129 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37554f8c1a90462095c511f00df6dece" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:29.139377 9304 raft_consensus.cc:2393] T 37554f8c1a90462095c511f00df6dece P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:29.139767 9024 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37554f8c1a90462095c511f00df6dece" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:29.140610 9112 leader_election.cc:304] T 37554f8c1a90462095c511f00df6dece P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:29.141152 11952 raft_consensus.cc:3060] T 37554f8c1a90462095c511f00df6dece P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.143599 11952 raft_consensus.cc:2749] T 37554f8c1a90462095c511f00df6dece P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:29.148674 9427 tablet_bootstrap.cc:654] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.166673 9427 tablet_bootstrap.cc:492] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:29.166934 9427 ts_tablet_manager.cc:1403] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.101s user 0.004s sys 0.001s
I20251215 14:55:29.167702 9427 raft_consensus.cc:359] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.167793 9426 tablet_bootstrap.cc:492] T 266937328422421ab6880d7f7410683e P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:29.168115 9426 ts_tablet_manager.cc:1403] T 266937328422421ab6880d7f7410683e P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.126s user 0.000s sys 0.027s
I20251215 14:55:29.169549 9427 raft_consensus.cc:385] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.169955 9427 raft_consensus.cc:740] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.170091 9426 raft_consensus.cc:359] T 266937328422421ab6880d7f7410683e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.170581 9426 raft_consensus.cc:385] T 266937328422421ab6880d7f7410683e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.170802 9426 raft_consensus.cc:740] T 266937328422421ab6880d7f7410683e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.171382 9426 consensus_queue.cc:260] T 266937328422421ab6880d7f7410683e P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.171583 9427 consensus_queue.cc:260] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.172605 9426 ts_tablet_manager.cc:1434] T 266937328422421ab6880d7f7410683e P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s
I20251215 14:55:29.173041 9427 ts_tablet_manager.cc:1434] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251215 14:55:29.173406 9426 tablet_bootstrap.cc:492] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:29.173907 9427 tablet_bootstrap.cc:492] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:29.176601 11166 raft_consensus.cc:493] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:29.178402 11166 raft_consensus.cc:515] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.178979 11166 leader_election.cc:290] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:29.180230 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3dca27f234054f9582a2ca6c5e6f5cad" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:29.183378 8976 leader_election.cc:343] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:29.185196 9427 tablet_bootstrap.cc:654] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.185150 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9f514f7656247fd90f550b4132a15e6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:29.185379 9304 raft_consensus.cc:2468] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:29.186450 9426 tablet_bootstrap.cc:654] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.198997 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fa73a61ff5be4cd2b590d72763bf7c5d" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:29.199333 9300 raft_consensus.cc:3060] T fa73a61ff5be4cd2b590d72763bf7c5d P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.200201 9427 tablet_bootstrap.cc:492] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:29.200345 9427 ts_tablet_manager.cc:1403] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.003s
I20251215 14:55:29.201095 9427 raft_consensus.cc:359] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.201275 9427 raft_consensus.cc:385] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.201367 9427 raft_consensus.cc:740] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.201565 9427 consensus_queue.cc:260] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.202364 9427 ts_tablet_manager.cc:1434] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:29.202379 9300 raft_consensus.cc:2468] T fa73a61ff5be4cd2b590d72763bf7c5d P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:29.202857 9427 tablet_bootstrap.cc:492] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156: Bootstrap starting.
I20251215 14:55:29.204550 9427 tablet_bootstrap.cc:654] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.209757 9426 tablet_bootstrap.cc:492] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:29.210127 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9ed7d1946ba433eb8b19ccf6a84b7ad" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:29.210243 9426 ts_tablet_manager.cc:1403] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.037s user 0.003s sys 0.007s
I20251215 14:55:29.210445 9300 raft_consensus.cc:3060] T a9ed7d1946ba433eb8b19ccf6a84b7ad P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.212777 9426 raft_consensus.cc:359] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.213325 9426 raft_consensus.cc:385] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.213414 9300 raft_consensus.cc:2468] T a9ed7d1946ba433eb8b19ccf6a84b7ad P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:29.213539 9426 raft_consensus.cc:740] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.215147 9426 consensus_queue.cc:260] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.219574 9426 ts_tablet_manager.cc:1434] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20251215 14:55:29.221028 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f6bf35f57e94a1d983612561aa6f185" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:29.221312 9304 raft_consensus.cc:3060] T 8f6bf35f57e94a1d983612561aa6f185 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.223946 9304 raft_consensus.cc:2468] T 8f6bf35f57e94a1d983612561aa6f185 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:29.229054 9298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bfe7f2bc9b04aaeb6102b6b673d9379" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:29.229269 9298 raft_consensus.cc:3060] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.239739 11679 raft_consensus.cc:493] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:29.239941 11679 raft_consensus.cc:515] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.240572 11679 leader_election.cc:290] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:29.241245 9297 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3dca27f234054f9582a2ca6c5e6f5cad" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:29.241430 9297 raft_consensus.cc:2468] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:29.242888 9301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f909de19a0184e5b8d54a04ed11a9c70" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:29.243069 9301 raft_consensus.cc:2468] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:29.243832 9426 tablet_bootstrap.cc:492] T 410b0b292c204193a4983580abc97aa9 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:29.244608 9298 raft_consensus.cc:2468] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:29.247366 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "410b0b292c204193a4983580abc97aa9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:29.247996 8976 leader_election.cc:343] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:29.254225 9426 tablet_bootstrap.cc:654] T 410b0b292c204193a4983580abc97aa9 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.260500 9042 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f909de19a0184e5b8d54a04ed11a9c70" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:29.260773 9042 raft_consensus.cc:2468] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:29.262058 9039 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3e5c385232140079705470ad2d6e020" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:29.267603 8978 leader_election.cc:304] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.268460 11166 raft_consensus.cc:2804] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:29.268566 11166 raft_consensus.cc:493] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:29.268641 11166 raft_consensus.cc:3060] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.272636 11166 raft_consensus.cc:515] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.273733 9170 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9f514f7656247fd90f550b4132a15e6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:29.273947 9170 raft_consensus.cc:3060] T e9f514f7656247fd90f550b4132a15e6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.274287 11166 leader_election.cc:290] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:29.276480 9170 raft_consensus.cc:2468] T e9f514f7656247fd90f550b4132a15e6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:29.277021 8976 leader_election.cc:304] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:29.280617 11588 raft_consensus.cc:2804] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:29.280766 11588 raft_consensus.cc:697] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:29.281025 11588 consensus_queue.cc:237] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.292714 11038 consensus_queue.cc:1048] T 18802b48f9c04eccb369de25dd113c3f P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.302497 9426 tablet_bootstrap.cc:492] T 410b0b292c204193a4983580abc97aa9 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:29.302882 9426 ts_tablet_manager.cc:1403] T 410b0b292c204193a4983580abc97aa9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.059s user 0.008s sys 0.004s
I20251215 14:55:29.303495 11552 raft_consensus.cc:493] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:29.303646 11552 raft_consensus.cc:515] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.304257 11552 leader_election.cc:290] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:29.305647 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b6e5ac88fc74d66a3f74fb69eb01455" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:29.305819 9300 raft_consensus.cc:2468] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:29.306138 9426 raft_consensus.cc:359] T 410b0b292c204193a4983580abc97aa9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.306509 9426 raft_consensus.cc:385] T 410b0b292c204193a4983580abc97aa9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.306713 9426 raft_consensus.cc:740] T 410b0b292c204193a4983580abc97aa9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.307224 9426 consensus_queue.cc:260] T 410b0b292c204193a4983580abc97aa9 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.308988 9426 ts_tablet_manager.cc:1434] T 410b0b292c204193a4983580abc97aa9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s
I20251215 14:55:29.307536 9115 leader_election.cc:304] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:29.309439 11952 raft_consensus.cc:2804] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:29.309541 11952 raft_consensus.cc:493] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:29.309621 11952 raft_consensus.cc:3060] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.312288 11952 raft_consensus.cc:515] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.314384 11952 leader_election.cc:290] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Requested vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:29.316179 11552 raft_consensus.cc:493] T d531a17b6d1d47fa9606e0a8206b3bfd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:29.316315 11552 raft_consensus.cc:515] T d531a17b6d1d47fa9606e0a8206b3bfd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.316854 11552 leader_election.cc:290] T d531a17b6d1d47fa9606e0a8206b3bfd P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:29.317255 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b6e5ac88fc74d66a3f74fb69eb01455" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:29.317416 9300 raft_consensus.cc:3060] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.319748 9300 raft_consensus.cc:2468] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:29.320050 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d531a17b6d1d47fa9606e0a8206b3bfd" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:29.320236 9304 raft_consensus.cc:2393] T d531a17b6d1d47fa9606e0a8206b3bfd P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:29.320238 9115 leader_election.cc:304] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:29.320550 11552 raft_consensus.cc:2804] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:29.320699 11552 raft_consensus.cc:697] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 LEADER]: Becoming Leader. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Running, Role: LEADER
I20251215 14:55:29.320950 11552 consensus_queue.cc:237] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.323930 9426 tablet_bootstrap.cc:492] T f909de19a0184e5b8d54a04ed11a9c70 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:29.325636 9426 tablet_bootstrap.cc:654] T f909de19a0184e5b8d54a04ed11a9c70 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:29.330119 9248 leader_election.cc:343] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:29.331490 9170 raft_consensus.cc:3060] T 666af680888c4b3c81187d0195684bc7 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.331601 9248 leader_election.cc:304] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:29.332445 11038 raft_consensus.cc:2749] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:29.332609 11038 raft_consensus.cc:493] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:29.332690 11038 raft_consensus.cc:515] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.333155 11038 leader_election.cc:290] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:29.333660 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "410b0b292c204193a4983580abc97aa9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:29.333819 9172 raft_consensus.cc:2468] T 410b0b292c204193a4983580abc97aa9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:29.334838 11166 consensus_queue.cc:1048] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.337344 9427 tablet_bootstrap.cc:492] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156: No bootstrap required, opened a new log
I20251215 14:55:29.337567 9427 ts_tablet_manager.cc:1403] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156: Time spent bootstrapping tablet: real 0.135s user 0.030s sys 0.018s
I20251215 14:55:29.338408 9427 raft_consensus.cc:359] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.338660 9427 raft_consensus.cc:385] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.338768 9427 raft_consensus.cc:740] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.339028 9427 consensus_queue.cc:260] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.339677 9427 ts_tablet_manager.cc:1434] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251215 14:55:29.341751 9248 leader_election.cc:304] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.342008 11038 raft_consensus.cc:2804] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:29.342307 11038 raft_consensus.cc:493] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:29.342486 11038 raft_consensus.cc:3060] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.347064 9248 leader_election.cc:304] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.346901 11038 raft_consensus.cc:515] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.348527 9174 raft_consensus.cc:3060] T d531a17b6d1d47fa9606e0a8206b3bfd P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.352654 11968 raft_consensus.cc:2764] T 1b6e5ac88fc74d66a3f74fb69eb01455 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20251215 14:55:29.353454 11166 consensus_queue.cc:1048] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:29.357748 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 89742.8us
I20251215 14:55:29.357817 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e751be4722043928e6977c48c359aae" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:29.358379 9249 leader_election.cc:343] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:29.360128 8978 leader_election.cc:304] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.360442 11745 raft_consensus.cc:2804] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:29.360560 11745 raft_consensus.cc:697] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:29.360788 11745 consensus_queue.cc:237] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:29.367770 8978 leader_election.cc:304] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.358851 11038 leader_election.cc:290] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:29.373225 11679 raft_consensus.cc:2804] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:29.373374 11679 raft_consensus.cc:697] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:29.373632 11679 consensus_queue.cc:237] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.375550 9248 leader_election.cc:304] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.378585 11968 consensus_queue.cc:1048] T d6fd306fb2544afa8a60d5e7a093d76b P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.379076 11968 raft_consensus.cc:2804] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:29.379177 11968 raft_consensus.cc:493] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:29.379244 11968 raft_consensus.cc:3060] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.385532 9248 leader_election.cc:304] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.385829 11610 raft_consensus.cc:2804] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:29.385978 11610 raft_consensus.cc:697] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:29.386212 11610 consensus_queue.cc:237] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.384835 11968 raft_consensus.cc:515] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.390641 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9f514f7656247fd90f550b4132a15e6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:29.390925 9179 raft_consensus.cc:2393] T e9f514f7656247fd90f550b4132a15e6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e89303a500544272b601d7c29be802b4 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:29.396106 8978 leader_election.cc:304] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.396174 11968 leader_election.cc:290] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:29.396559 11706 raft_consensus.cc:2804] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:29.396684 11706 raft_consensus.cc:697] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:29.396988 11706 consensus_queue.cc:237] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.385990 9248 leader_election.cc:304] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.405339 11484 raft_consensus.cc:2804] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:29.405509 11484 raft_consensus.cc:697] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:29.405769 11484 consensus_queue.cc:237] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.421402 11038 consensus_queue.cc:1048] T 4dd3af2da2c5445b962903d4475b0d58 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.422511 9248 leader_election.cc:304] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.432309 9426 tablet_bootstrap.cc:492] T f909de19a0184e5b8d54a04ed11a9c70 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:29.432473 9426 ts_tablet_manager.cc:1403] T f909de19a0184e5b8d54a04ed11a9c70 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.109s user 0.005s sys 0.001s
I20251215 14:55:29.432713 11484 raft_consensus.cc:2804] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:29.433156 11484 raft_consensus.cc:493] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:29.433327 11484 raft_consensus.cc:3060] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.438771 11484 raft_consensus.cc:515] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.439553 11484 leader_election.cc:290] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:29.439975 9174 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f909de19a0184e5b8d54a04ed11a9c70" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:29.440479 11166 consensus_queue.cc:1048] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:29.441903 9248 leader_election.cc:343] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:29.442023 9248 leader_election.cc:304] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:29.442252 11174 raft_consensus.cc:2749] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:29.442219 9426 raft_consensus.cc:359] T f909de19a0184e5b8d54a04ed11a9c70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.442378 9426 raft_consensus.cc:385] T f909de19a0184e5b8d54a04ed11a9c70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.442433 9426 raft_consensus.cc:740] T f909de19a0184e5b8d54a04ed11a9c70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.442639 9426 consensus_queue.cc:260] T f909de19a0184e5b8d54a04ed11a9c70 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.443214 9426 ts_tablet_manager.cc:1434] T f909de19a0184e5b8d54a04ed11a9c70 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.011s user 0.002s sys 0.000s
I20251215 14:55:29.443485 9426 tablet_bootstrap.cc:492] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:29.443607 11706 consensus_queue.cc:1048] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.444096 11706 consensus_queue.cc:1048] T 266937328422421ab6880d7f7410683e P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.444967 9426 tablet_bootstrap.cc:654] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.445955 9174 raft_consensus.cc:3060] T f909de19a0184e5b8d54a04ed11a9c70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.453449 9174 raft_consensus.cc:2468] T f909de19a0184e5b8d54a04ed11a9c70 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:29.454247 9249 leader_election.cc:304] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:29.454574 11484 raft_consensus.cc:2804] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:29.454910 11484 raft_consensus.cc:697] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:29.455494 11484 consensus_queue.cc:237] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.460374 9426 tablet_bootstrap.cc:492] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:29.460529 9426 ts_tablet_manager.cc:1403] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.003s
I20251215 14:55:29.461256 9426 raft_consensus.cc:359] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.461443 9426 raft_consensus.cc:385] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.461515 9426 raft_consensus.cc:740] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.461715 9426 consensus_queue.cc:260] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.462248 9426 ts_tablet_manager.cc:1434] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:29.462620 9426 tablet_bootstrap.cc:492] T c3e5c385232140079705470ad2d6e020 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
W20251215 14:55:29.464344 8976 consensus_peers.cc:597] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251215 14:55:29.464383 9249 leader_election.cc:304] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:29.464773 11174 raft_consensus.cc:2804] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:29.464859 11174 raft_consensus.cc:493] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:29.464933 11174 raft_consensus.cc:3060] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.466542 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b6e5ac88fc74d66a3f74fb69eb01455" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:29.466722 9030 raft_consensus.cc:2468] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 0.
I20251215 14:55:29.467417 11174 raft_consensus.cc:515] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.467962 11174 leader_election.cc:290] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:29.468344 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "410b0b292c204193a4983580abc97aa9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:29.468550 9171 raft_consensus.cc:3060] T 410b0b292c204193a4983580abc97aa9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.468739 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1b6e5ac88fc74d66a3f74fb69eb01455" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:29.468923 9030 raft_consensus.cc:3060] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.471128 9171 raft_consensus.cc:2468] T 410b0b292c204193a4983580abc97aa9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:29.471355 9030 raft_consensus.cc:2468] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ea5306c36594ef4a62211f2bd6669a3 in term 1.
I20251215 14:55:29.471885 9030 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d531a17b6d1d47fa9606e0a8206b3bfd" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:29.480420 11038 raft_consensus.cc:493] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:29.480561 11038 raft_consensus.cc:515] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.481153 11038 leader_election.cc:290] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:29.490747 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e751be4722043928e6977c48c359aae" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:29.490986 9027 raft_consensus.cc:3060] T 5e751be4722043928e6977c48c359aae P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.494458 9027 raft_consensus.cc:2468] T 5e751be4722043928e6977c48c359aae P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:29.490732 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "410b0b292c204193a4983580abc97aa9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:29.495080 9028 raft_consensus.cc:2468] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:29.479146 9426 tablet_bootstrap.cc:654] T c3e5c385232140079705470ad2d6e020 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.482436 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4da9d74efd427ca27431c54a84a3e9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:29.500301 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9f514f7656247fd90f550b4132a15e6" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:29.487730 9170 raft_consensus.cc:3060] T 5875cdedb77841359158f7f185ee30f6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.496773 11552 raft_consensus.cc:493] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:29.500694 11552 raft_consensus.cc:515] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.501253 11552 leader_election.cc:290] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:29.505838 9112 leader_election.cc:304] T d531a17b6d1d47fa9606e0a8206b3bfd P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:29.506318 11552 raft_consensus.cc:2749] T d531a17b6d1d47fa9606e0a8206b3bfd P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:29.509719 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f909de19a0184e5b8d54a04ed11a9c70" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:29.509891 9027 raft_consensus.cc:3060] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.512475 9027 raft_consensus.cc:2468] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:29.513751 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "410b0b292c204193a4983580abc97aa9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:29.513998 9027 raft_consensus.cc:3060] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.515138 9029 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9ed7d1946ba433eb8b19ccf6a84b7ad" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:29.516193 8978 leader_election.cc:304] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.516530 11993 raft_consensus.cc:2804] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:29.516687 11993 raft_consensus.cc:493] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:29.516873 11993 raft_consensus.cc:3060] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.518005 9426 tablet_bootstrap.cc:492] T c3e5c385232140079705470ad2d6e020 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:29.518138 9426 ts_tablet_manager.cc:1403] T c3e5c385232140079705470ad2d6e020 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.056s user 0.003s sys 0.007s
I20251215 14:55:29.518785 9426 raft_consensus.cc:359] T c3e5c385232140079705470ad2d6e020 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.518956 9426 raft_consensus.cc:385] T c3e5c385232140079705470ad2d6e020 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.519018 9426 raft_consensus.cc:740] T c3e5c385232140079705470ad2d6e020 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.519281 9426 consensus_queue.cc:260] T c3e5c385232140079705470ad2d6e020 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.519671 11993 raft_consensus.cc:515] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.519843 9426 ts_tablet_manager.cc:1434] T c3e5c385232140079705470ad2d6e020 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:29.520103 9426 tablet_bootstrap.cc:492] T e512c231686948619d338fa0fc8aae03 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:29.520512 11997 consensus_queue.cc:1048] T d531a17b6d1d47fa9606e0a8206b3bfd P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.520582 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3dca27f234054f9582a2ca6c5e6f5cad" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
W20251215 14:55:29.521111 8976 leader_election.cc:343] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:29.521209 11745 consensus_queue.cc:1048] T e6f6324610f44cefb0ce67fd76e0e001 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.521464 11993 leader_election.cc:290] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:29.516520 9027 raft_consensus.cc:2468] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:29.523459 8978 leader_election.cc:304] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.523653 9027 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4da9d74efd427ca27431c54a84a3e9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:29.523846 9027 raft_consensus.cc:2468] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 0.
I20251215 14:55:29.524382 9249 leader_election.cc:304] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
W20251215 14:55:29.524629 9249 leader_election.cc:343] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:29.525694 11174 raft_consensus.cc:2804] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:29.525791 11174 raft_consensus.cc:697] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:29.525996 11174 consensus_queue.cc:237] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.531865 9426 tablet_bootstrap.cc:654] T e512c231686948619d338fa0fc8aae03 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.540139 9426 tablet_bootstrap.cc:492] T e512c231686948619d338fa0fc8aae03 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:29.540292 9426 ts_tablet_manager.cc:1403] T e512c231686948619d338fa0fc8aae03 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.001s
I20251215 14:55:29.551350 9426 raft_consensus.cc:359] T e512c231686948619d338fa0fc8aae03 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.551553 9426 raft_consensus.cc:385] T e512c231686948619d338fa0fc8aae03 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.551606 9426 raft_consensus.cc:740] T e512c231686948619d338fa0fc8aae03 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.551820 9426 consensus_queue.cc:260] T e512c231686948619d338fa0fc8aae03 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.552333 9426 ts_tablet_manager.cc:1434] T e512c231686948619d338fa0fc8aae03 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s
I20251215 14:55:29.552587 9426 tablet_bootstrap.cc:492] T da4da9d74efd427ca27431c54a84a3e9 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:29.553990 9426 tablet_bootstrap.cc:654] T da4da9d74efd427ca27431c54a84a3e9 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.556267 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "410b0b292c204193a4983580abc97aa9" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:29.556800 9300 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e9f514f7656247fd90f550b4132a15e6" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:29.556975 9300 raft_consensus.cc:2393] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 67978ac4539d4b289e53f4eedd9a8156 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:29.561403 8978 leader_election.cc:304] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.561697 11997 raft_consensus.cc:2764] T f909de19a0184e5b8d54a04ed11a9c70 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20251215 14:55:29.561861 11997 raft_consensus.cc:2804] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:29.561954 11997 raft_consensus.cc:697] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:29.562182 11997 consensus_queue.cc:237] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.564502 11988 raft_consensus.cc:493] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:29.564615 11988 raft_consensus.cc:515] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.565110 11988 leader_election.cc:290] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:29.566299 9179 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3e5c385232140079705470ad2d6e020" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
I20251215 14:55:29.566481 9179 raft_consensus.cc:2468] T c3e5c385232140079705470ad2d6e020 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:29.567029 8976 leader_election.cc:304] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:29.567332 11745 raft_consensus.cc:2804] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:29.567395 11745 raft_consensus.cc:493] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:29.567448 11745 raft_consensus.cc:3060] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.569842 11745 raft_consensus.cc:515] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.570371 11745 leader_election.cc:290] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:29.573143 9171 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3e5c385232140079705470ad2d6e020" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:29.573352 9171 raft_consensus.cc:3060] T c3e5c385232140079705470ad2d6e020 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.576244 11997 consensus_queue.cc:1048] T caefb83a990e4ad2baf621cd83265f96 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.584740 9426 tablet_bootstrap.cc:492] T da4da9d74efd427ca27431c54a84a3e9 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:29.584975 9426 ts_tablet_manager.cc:1403] T da4da9d74efd427ca27431c54a84a3e9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.032s user 0.003s sys 0.006s
I20251215 14:55:29.585585 9426 raft_consensus.cc:359] T da4da9d74efd427ca27431c54a84a3e9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.585726 9426 raft_consensus.cc:385] T da4da9d74efd427ca27431c54a84a3e9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.585768 9426 raft_consensus.cc:740] T da4da9d74efd427ca27431c54a84a3e9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.585942 9426 consensus_queue.cc:260] T da4da9d74efd427ca27431c54a84a3e9 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.586267 9426 ts_tablet_manager.cc:1434] T da4da9d74efd427ca27431c54a84a3e9 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:29.586581 9426 tablet_bootstrap.cc:492] T 6c9bc7a7bd4447dba112999eff69c932 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:29.588126 9426 tablet_bootstrap.cc:654] T 6c9bc7a7bd4447dba112999eff69c932 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.606711 9171 raft_consensus.cc:2468] T c3e5c385232140079705470ad2d6e020 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:29.610339 9298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a9ed7d1946ba433eb8b19ccf6a84b7ad" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:29.610591 9298 raft_consensus.cc:2393] T a9ed7d1946ba433eb8b19ccf6a84b7ad P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:29.612352 9301 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3dca27f234054f9582a2ca6c5e6f5cad" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:29.612512 9301 raft_consensus.cc:3060] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:29.614367 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:29.615032 9301 raft_consensus.cc:2468] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:29.614400 9115 leader_election.cc:304] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:29.621595 11952 raft_consensus.cc:3060] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.624059 11952 raft_consensus.cc:2749] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:29.635249 9426 tablet_bootstrap.cc:492] T 6c9bc7a7bd4447dba112999eff69c932 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:29.635399 9426 ts_tablet_manager.cc:1403] T 6c9bc7a7bd4447dba112999eff69c932 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.049s user 0.006s sys 0.002s
I20251215 14:55:29.636129 9426 raft_consensus.cc:359] T 6c9bc7a7bd4447dba112999eff69c932 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.636293 9426 raft_consensus.cc:385] T 6c9bc7a7bd4447dba112999eff69c932 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.636341 9426 raft_consensus.cc:740] T 6c9bc7a7bd4447dba112999eff69c932 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.636519 9426 consensus_queue.cc:260] T 6c9bc7a7bd4447dba112999eff69c932 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.636780 8976 leader_election.cc:304] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156; no voters:
I20251215 14:55:29.636994 9426 ts_tablet_manager.cc:1434] T 6c9bc7a7bd4447dba112999eff69c932 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251215 14:55:29.637161 11993 raft_consensus.cc:2804] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:29.637383 11993 raft_consensus.cc:697] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:29.637648 11993 consensus_queue.cc:237] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.642488 9426 tablet_bootstrap.cc:492] T 3dca27f234054f9582a2ca6c5e6f5cad P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:29.644186 9426 tablet_bootstrap.cc:654] T 3dca27f234054f9582a2ca6c5e6f5cad P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.659569 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3e5c385232140079705470ad2d6e020" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:29.659720 9303 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c3e5c385232140079705470ad2d6e020" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:29.659919 9304 raft_consensus.cc:2468] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:29.666776 9426 tablet_bootstrap.cc:492] T 3dca27f234054f9582a2ca6c5e6f5cad P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:29.666929 9426 ts_tablet_manager.cc:1403] T 3dca27f234054f9582a2ca6c5e6f5cad P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.003s
I20251215 14:55:29.666940 8978 leader_election.cc:304] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:29.667228 11745 raft_consensus.cc:2749] T 410b0b292c204193a4983580abc97aa9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:29.667663 9426 raft_consensus.cc:359] T 3dca27f234054f9582a2ca6c5e6f5cad P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.667831 9426 raft_consensus.cc:385] T 3dca27f234054f9582a2ca6c5e6f5cad P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.667896 9426 raft_consensus.cc:740] T 3dca27f234054f9582a2ca6c5e6f5cad P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.668067 9426 consensus_queue.cc:260] T 3dca27f234054f9582a2ca6c5e6f5cad P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.668520 9426 ts_tablet_manager.cc:1434] T 3dca27f234054f9582a2ca6c5e6f5cad P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251215 14:55:29.672732 11993 consensus_queue.cc:1048] T e512c231686948619d338fa0fc8aae03 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.674166 11992 consensus_queue.cc:1048] T 666af680888c4b3c81187d0195684bc7 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.678450 9426 tablet_bootstrap.cc:492] T 8f6bf35f57e94a1d983612561aa6f185 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:29.680176 9426 tablet_bootstrap.cc:654] T 8f6bf35f57e94a1d983612561aa6f185 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.684034 11484 consensus_queue.cc:1048] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.694492 11745 raft_consensus.cc:493] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:29.694705 11745 raft_consensus.cc:515] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.695730 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ae3004e4a76422397c6e1761d020e38" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3" is_pre_election: true
W20251215 14:55:29.696316 8976 leader_election.cc:343] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:29.696630 11745 leader_election.cc:290] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:29.697997 11588 consensus_queue.cc:1048] T de5ba7f2b5c84ac39e4019a0b9532176 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.698341 11588 consensus_queue.cc:1048] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.699290 8978 leader_election.cc:304] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.699703 11588 raft_consensus.cc:2804] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:29.699841 11588 raft_consensus.cc:697] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:29.700060 11588 consensus_queue.cc:237] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.700837 9248 leader_election.cc:304] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.701323 11484 raft_consensus.cc:2804] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:29.701426 11484 raft_consensus.cc:697] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:29.701627 11484 consensus_queue.cc:237] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.708149 9248 leader_election.cc:304] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:29.709463 12007 raft_consensus.cc:2749] T e9f514f7656247fd90f550b4132a15e6 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251215 14:55:29.712996 9248 leader_election.cc:304] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.713485 11174 raft_consensus.cc:2804] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:29.713698 11174 raft_consensus.cc:493] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:29.714279 11174 raft_consensus.cc:3060] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.716112 9426 tablet_bootstrap.cc:492] T 8f6bf35f57e94a1d983612561aa6f185 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:29.716244 9426 ts_tablet_manager.cc:1403] T 8f6bf35f57e94a1d983612561aa6f185 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.003s
I20251215 14:55:29.716945 9426 raft_consensus.cc:359] T 8f6bf35f57e94a1d983612561aa6f185 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.717118 9426 raft_consensus.cc:385] T 8f6bf35f57e94a1d983612561aa6f185 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.717175 9426 raft_consensus.cc:740] T 8f6bf35f57e94a1d983612561aa6f185 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.717327 9426 consensus_queue.cc:260] T 8f6bf35f57e94a1d983612561aa6f185 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.717765 9426 ts_tablet_manager.cc:1434] T 8f6bf35f57e94a1d983612561aa6f185 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251215 14:55:29.719535 11552 raft_consensus.cc:493] T e8ffa009bae84660b331ebeddcccc266 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:29.719645 11552 raft_consensus.cc:515] T e8ffa009bae84660b331ebeddcccc266 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.720222 11552 leader_election.cc:290] T e8ffa009bae84660b331ebeddcccc266 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:29.721885 9040 raft_consensus.cc:3060] T a4b0a5e13ae941dcb99749f1e0c04176 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.725119 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8ffa009bae84660b331ebeddcccc266" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:29.728252 11174 raft_consensus.cc:515] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.729108 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4da9d74efd427ca27431c54a84a3e9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:29.729257 9172 raft_consensus.cc:3060] T da4da9d74efd427ca27431c54a84a3e9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.731693 9172 raft_consensus.cc:2468] T da4da9d74efd427ca27431c54a84a3e9 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:29.735802 9249 leader_election.cc:304] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4; no voters:
I20251215 14:55:29.736470 11610 raft_consensus.cc:2804] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:29.736583 11610 raft_consensus.cc:697] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [term 1 LEADER]: Becoming Leader. State: Replica: e89303a500544272b601d7c29be802b4, State: Running, Role: LEADER
I20251215 14:55:29.736686 11174 leader_election.cc:290] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:29.736800 11610 consensus_queue.cc:237] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.754698 9032 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8ffa009bae84660b331ebeddcccc266" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:29.754987 9032 raft_consensus.cc:2393] T e8ffa009bae84660b331ebeddcccc266 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:29.756768 9426 tablet_bootstrap.cc:492] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:29.758395 9426 tablet_bootstrap.cc:654] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.759244 9112 leader_election.cc:304] T e8ffa009bae84660b331ebeddcccc266 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:29.759724 11552 raft_consensus.cc:3060] T e8ffa009bae84660b331ebeddcccc266 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.762753 11552 raft_consensus.cc:2749] T e8ffa009bae84660b331ebeddcccc266 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:29.771256 9299 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ae3004e4a76422397c6e1761d020e38" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:29.771466 9299 raft_consensus.cc:2468] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 0.
I20251215 14:55:29.780725 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "da4da9d74efd427ca27431c54a84a3e9" candidate_uuid: "e89303a500544272b601d7c29be802b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156"
I20251215 14:55:29.781011 9040 raft_consensus.cc:3060] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.795426 9040 raft_consensus.cc:2468] T da4da9d74efd427ca27431c54a84a3e9 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e89303a500544272b601d7c29be802b4 in term 1.
I20251215 14:55:29.801312 9426 tablet_bootstrap.cc:492] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:29.802853 9426 ts_tablet_manager.cc:1403] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.046s user 0.003s sys 0.007s
I20251215 14:55:29.803299 11484 consensus_queue.cc:1048] T a4b0a5e13ae941dcb99749f1e0c04176 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.804723 9426 raft_consensus.cc:359] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.809303 8978 leader_election.cc:304] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.809553 12021 raft_consensus.cc:2804] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251215 14:55:29.809720 12021 raft_consensus.cc:493] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251215 14:55:29.809851 12021 raft_consensus.cc:3060] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.812515 12021 raft_consensus.cc:515] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.813802 12021 leader_election.cc:290] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Requested vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:29.816498 9426 raft_consensus.cc:385] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.816577 9426 raft_consensus.cc:740] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.816771 9426 consensus_queue.cc:260] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.817252 9426 ts_tablet_manager.cc:1434] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.013s user 0.000s sys 0.000s
I20251215 14:55:29.817507 9426 tablet_bootstrap.cc:492] T 8ae3004e4a76422397c6e1761d020e38 P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:29.813508 9172 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ae3004e4a76422397c6e1761d020e38" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3ea5306c36594ef4a62211f2bd6669a3"
I20251215 14:55:29.819126 9426 tablet_bootstrap.cc:654] T 8ae3004e4a76422397c6e1761d020e38 P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
W20251215 14:55:29.820122 8976 leader_election.cc:343] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Illegal state: must be running to vote when last-logged opid is not known
I20251215 14:55:29.821326 9171 raft_consensus.cc:3060] T 266937328422421ab6880d7f7410683e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.832938 9426 tablet_bootstrap.cc:492] T 8ae3004e4a76422397c6e1761d020e38 P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:29.833084 9426 ts_tablet_manager.cc:1403] T 8ae3004e4a76422397c6e1761d020e38 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.000s
I20251215 14:55:29.834622 9426 raft_consensus.cc:359] T 8ae3004e4a76422397c6e1761d020e38 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.834816 9426 raft_consensus.cc:385] T 8ae3004e4a76422397c6e1761d020e38 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.834861 9426 raft_consensus.cc:740] T 8ae3004e4a76422397c6e1761d020e38 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.835062 9426 consensus_queue.cc:260] T 8ae3004e4a76422397c6e1761d020e38 P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.835569 9426 ts_tablet_manager.cc:1434] T 8ae3004e4a76422397c6e1761d020e38 P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251215 14:55:29.835842 9426 tablet_bootstrap.cc:492] T 5e751be4722043928e6977c48c359aae P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:29.837548 9426 tablet_bootstrap.cc:654] T 5e751be4722043928e6977c48c359aae P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.842847 11988 consensus_queue.cc:1048] T 5bdbdc16389442f587d18347a2340fd5 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.863631 9426 tablet_bootstrap.cc:492] T 5e751be4722043928e6977c48c359aae P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:29.863973 9426 ts_tablet_manager.cc:1403] T 5e751be4722043928e6977c48c359aae P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.004s
I20251215 14:55:29.867894 9426 raft_consensus.cc:359] T 5e751be4722043928e6977c48c359aae P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.868360 9426 raft_consensus.cc:385] T 5e751be4722043928e6977c48c359aae P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.868513 9426 raft_consensus.cc:740] T 5e751be4722043928e6977c48c359aae P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.869124 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ae3004e4a76422397c6e1761d020e38" candidate_uuid: "67978ac4539d4b289e53f4eedd9a8156" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4"
I20251215 14:55:29.869001 9426 consensus_queue.cc:260] T 5e751be4722043928e6977c48c359aae P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.869422 9308 raft_consensus.cc:3060] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:29.870329 9426 ts_tablet_manager.cc:1434] T 5e751be4722043928e6977c48c359aae P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20251215 14:55:29.872740 9308 raft_consensus.cc:2468] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67978ac4539d4b289e53f4eedd9a8156 in term 1.
I20251215 14:55:29.892638 9226 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:29.905226 8978 leader_election.cc:304] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3
I20251215 14:55:29.905619 12021 raft_consensus.cc:2804] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader election won for term 1
I20251215 14:55:29.905844 12021 raft_consensus.cc:697] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 LEADER]: Becoming Leader. State: Replica: 67978ac4539d4b289e53f4eedd9a8156, State: Running, Role: LEADER
I20251215 14:55:29.906463 12021 consensus_queue.cc:237] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.931797 9426 tablet_bootstrap.cc:492] T fa73a61ff5be4cd2b590d72763bf7c5d P 3ea5306c36594ef4a62211f2bd6669a3: Bootstrap starting.
I20251215 14:55:29.935531 11588 consensus_queue.cc:1048] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:29.950584 9426 tablet_bootstrap.cc:654] T fa73a61ff5be4cd2b590d72763bf7c5d P 3ea5306c36594ef4a62211f2bd6669a3: Neither blocks nor log segments found. Creating new log.
I20251215 14:55:29.970490 9088 heartbeater.cc:344] Connected to a master server at 127.8.121.190:44279
I20251215 14:55:29.988862 9426 tablet_bootstrap.cc:492] T fa73a61ff5be4cd2b590d72763bf7c5d P 3ea5306c36594ef4a62211f2bd6669a3: No bootstrap required, opened a new log
I20251215 14:55:29.989256 9426 ts_tablet_manager.cc:1403] T fa73a61ff5be4cd2b590d72763bf7c5d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent bootstrapping tablet: real 0.058s user 0.012s sys 0.000s
I20251215 14:55:29.991732 9426 raft_consensus.cc:359] T fa73a61ff5be4cd2b590d72763bf7c5d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:29.992208 9426 raft_consensus.cc:385] T fa73a61ff5be4cd2b590d72763bf7c5d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251215 14:55:29.992342 9426 raft_consensus.cc:740] T fa73a61ff5be4cd2b590d72763bf7c5d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ea5306c36594ef4a62211f2bd6669a3, State: Initialized, Role: FOLLOWER
I20251215 14:55:29.993263 9426 consensus_queue.cc:260] T fa73a61ff5be4cd2b590d72763bf7c5d P 3ea5306c36594ef4a62211f2bd6669a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:29.997269 11552 raft_consensus.cc:493] T 8ae3004e4a76422397c6e1761d020e38 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:29.997402 11552 raft_consensus.cc:515] T 8ae3004e4a76422397c6e1761d020e38 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:29.997936 11552 leader_election.cc:290] T 8ae3004e4a76422397c6e1761d020e38 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:29.999135 9296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ae3004e4a76422397c6e1761d020e38" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:29.999369 9296 raft_consensus.cc:2393] T 8ae3004e4a76422397c6e1761d020e38 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:30.000295 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8ae3004e4a76422397c6e1761d020e38" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:30.001247 9112 leader_election.cc:304] T 8ae3004e4a76422397c6e1761d020e38 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:30.001852 11552 raft_consensus.cc:3060] T 8ae3004e4a76422397c6e1761d020e38 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:30.004503 11552 raft_consensus.cc:2749] T 8ae3004e4a76422397c6e1761d020e38 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:30.009851 12021 consensus_queue.cc:1048] T e1d4dc7d18f7448880b79af99283c99f P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.031386 11552 raft_consensus.cc:493] T e512c231686948619d338fa0fc8aae03 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:30.031939 11552 raft_consensus.cc:515] T e512c231686948619d338fa0fc8aae03 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:30.034020 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e512c231686948619d338fa0fc8aae03" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:30.034409 11552 leader_election.cc:290] T e512c231686948619d338fa0fc8aae03 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:30.037250 9426 ts_tablet_manager.cc:1434] T fa73a61ff5be4cd2b590d72763bf7c5d P 3ea5306c36594ef4a62211f2bd6669a3: Time spent starting tablet: real 0.048s user 0.002s sys 0.001s
W20251215 14:55:30.042179 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet b4a856793e8b46cfb42110de5d383ff7 (table default.Table_8bca373710104ce89200ac1c18f9a622 [id=81cf043be94c44afaef4b8c7f1ce1b00], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b4a856793e8b46cfb42110de5d383ff7 consensus state has no leader
I20251215 14:55:30.046674 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e512c231686948619d338fa0fc8aae03" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:30.053346 11563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Bootstrap replayed 1/1 log segments. Stats: ops{read=897 overwritten=0 applied=897 ignored=0} inserts{seen=709 ignored=0} mutations{seen=1158 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251215 14:55:30.054450 11563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: Bootstrap complete.
I20251215 14:55:30.054610 9112 leader_election.cc:304] T e512c231686948619d338fa0fc8aae03 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:30.054977 11552 raft_consensus.cc:2749] T e512c231686948619d338fa0fc8aae03 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:30.077157 11563 raft_consensus.cc:359] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:30.078223 11563 raft_consensus.cc:740] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: cad1fca07ac7419cb608c21541f672f3, State: Initialized, Role: FOLLOWER
I20251215 14:55:30.079012 11563 consensus_queue.cc:260] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 897, Last appended: 2.897, Last appended by leader: 897, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:30.081732 11552 raft_consensus.cc:493] T 6c9bc7a7bd4447dba112999eff69c932 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:30.081869 11552 raft_consensus.cc:515] T 6c9bc7a7bd4447dba112999eff69c932 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:30.082424 11552 leader_election.cc:290] T 6c9bc7a7bd4447dba112999eff69c932 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:30.083328 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6c9bc7a7bd4447dba112999eff69c932" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:30.083562 9028 raft_consensus.cc:2393] T 6c9bc7a7bd4447dba112999eff69c932 P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:30.083699 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6c9bc7a7bd4447dba112999eff69c932" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:30.085559 9115 leader_election.cc:304] T 6c9bc7a7bd4447dba112999eff69c932 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:30.085922 11860 raft_consensus.cc:3060] T 6c9bc7a7bd4447dba112999eff69c932 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:30.088466 11860 raft_consensus.cc:2749] T 6c9bc7a7bd4447dba112999eff69c932 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:30.091542 12047 sys_catalog.cc:455] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } } }
I20251215 14:55:30.093863 12047 sys_catalog.cc:458] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: This master's current role is: FOLLOWER
I20251215 14:55:30.093741 11563 sys_catalog.cc:565] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [sys.catalog]: configured and running, proceeding with master startup.
I20251215 14:55:30.097168 11552 consensus_queue.cc:1048] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.135859 11860 consensus_queue.cc:1048] T 1b6e5ac88fc74d66a3f74fb69eb01455 P 3ea5306c36594ef4a62211f2bd6669a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.163025 11860 raft_consensus.cc:493] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:30.163193 11860 raft_consensus.cc:515] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:30.163795 11860 leader_election.cc:290] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:30.164198 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bfe7f2bc9b04aaeb6102b6b673d9379" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:30.164397 9308 raft_consensus.cc:2393] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:30.169510 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bfe7f2bc9b04aaeb6102b6b673d9379" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:30.175346 9112 leader_election.cc:304] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:30.175717 11860 raft_consensus.cc:3060] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
W20251215 14:55:30.176286 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:30.178258 11860 raft_consensus.cc:2749] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:30.182772 11994 consensus_queue.cc:1048] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.192335 11484 consensus_queue.cc:1048] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.194437 11860 raft_consensus.cc:493] T 3dca27f234054f9582a2ca6c5e6f5cad P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:30.194679 11860 raft_consensus.cc:515] T 3dca27f234054f9582a2ca6c5e6f5cad P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:30.195930 9296 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3dca27f234054f9582a2ca6c5e6f5cad" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:30.196161 9296 raft_consensus.cc:2393] T 3dca27f234054f9582a2ca6c5e6f5cad P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:30.197373 11860 leader_election.cc:290] T 3dca27f234054f9582a2ca6c5e6f5cad P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:30.197988 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3dca27f234054f9582a2ca6c5e6f5cad" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:30.198587 9112 leader_election.cc:304] T 3dca27f234054f9582a2ca6c5e6f5cad P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:30.199143 11860 raft_consensus.cc:3060] T 3dca27f234054f9582a2ca6c5e6f5cad P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:30.202440 11860 raft_consensus.cc:2749] T 3dca27f234054f9582a2ca6c5e6f5cad P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:30.203564 11952 raft_consensus.cc:493] T 8f6bf35f57e94a1d983612561aa6f185 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:30.203701 11952 raft_consensus.cc:515] T 8f6bf35f57e94a1d983612561aa6f185 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:30.204255 11952 leader_election.cc:290] T 8f6bf35f57e94a1d983612561aa6f185 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:30.205180 9171 raft_consensus.cc:3060] T fa73a61ff5be4cd2b590d72763bf7c5d P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:30.205390 9304 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f6bf35f57e94a1d983612561aa6f185" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:30.205600 9304 raft_consensus.cc:2393] T 8f6bf35f57e94a1d983612561aa6f185 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate 67978ac4539d4b289e53f4eedd9a8156 in this term.
I20251215 14:55:30.208303 11588 consensus_queue.cc:1048] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.209931 9040 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8f6bf35f57e94a1d983612561aa6f185" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:30.210301 9112 leader_election.cc:304] T 8f6bf35f57e94a1d983612561aa6f185 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:30.210619 11952 raft_consensus.cc:3060] T 8f6bf35f57e94a1d983612561aa6f185 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:30.213109 11952 raft_consensus.cc:2749] T 8f6bf35f57e94a1d983612561aa6f185 P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:30.224160 12021 consensus_queue.cc:1048] T a9ed7d1946ba433eb8b19ccf6a84b7ad P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.254848 11174 consensus_queue.cc:1048] T e8ffa009bae84660b331ebeddcccc266 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.256989 11174 consensus_queue.cc:1048] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.280380 11174 consensus_queue.cc:1048] T 6c9bc7a7bd4447dba112999eff69c932 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.302497 11461 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" instance_seqno: 1765810500082532) as {username='slave'} at 127.8.121.129:33755; Asking this server to re-register.
I20251215 14:55:30.311137 11462 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" instance_seqno: 1765810500551421) as {username='slave'} at 127.8.121.130:37933; Asking this server to re-register.
I20251215 14:55:30.315762 9226 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:30.343014 11460 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e89303a500544272b601d7c29be802b4" instance_seqno: 1765810501001456) as {username='slave'} at 127.8.121.131:52245; Asking this server to re-register.
I20251215 14:55:30.347419 11988 consensus_queue.cc:1048] T fa73a61ff5be4cd2b590d72763bf7c5d P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.365794 11174 consensus_queue.cc:1048] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.370407 11460 ts_manager.cc:194] Registered new tserver with Master: 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
I20251215 14:55:30.411686 9088 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:30.423532 11952 raft_consensus.cc:493] T 5e751be4722043928e6977c48c359aae P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:30.423751 11952 raft_consensus.cc:515] T 5e751be4722043928e6977c48c359aae P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } }
I20251215 14:55:30.424440 11952 leader_election.cc:290] T 5e751be4722043928e6977c48c359aae P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e89303a500544272b601d7c29be802b4 (127.8.121.131:32959), 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:30.427119 9308 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e751be4722043928e6977c48c359aae" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e89303a500544272b601d7c29be802b4" is_pre_election: true
I20251215 14:55:30.427834 9028 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e751be4722043928e6977c48c359aae" candidate_uuid: "3ea5306c36594ef4a62211f2bd6669a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67978ac4539d4b289e53f4eedd9a8156" is_pre_election: true
I20251215 14:55:30.428822 9028 raft_consensus.cc:2393] T 5e751be4722043928e6977c48c359aae P 67978ac4539d4b289e53f4eedd9a8156 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3ea5306c36594ef4a62211f2bd6669a3 in current term 1: Already voted for candidate e89303a500544272b601d7c29be802b4 in this term.
I20251215 14:55:30.429926 9112 leader_election.cc:304] T 5e751be4722043928e6977c48c359aae P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:30.430347 11952 raft_consensus.cc:3060] T 5e751be4722043928e6977c48c359aae P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:30.433102 11952 raft_consensus.cc:2749] T 5e751be4722043928e6977c48c359aae P 3ea5306c36594ef4a62211f2bd6669a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:30.438071 11038 consensus_queue.cc:1048] T 410b0b292c204193a4983580abc97aa9 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.441438 11588 consensus_queue.cc:1048] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.444479 11588 consensus_queue.cc:1048] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.451752 11462 ts_manager.cc:194] Registered new tserver with Master: 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891)
I20251215 14:55:30.461478 9361 heartbeater.cc:461] Registering TS with master...
I20251215 14:55:30.468380 11588 consensus_queue.cc:1048] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.474100 11994 consensus_queue.cc:1048] T e9f514f7656247fd90f550b4132a15e6 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.482156 12064 catalog_manager.cc:1269] Loaded cluster ID: ed5da7b2c3a646fcbe8e0bb3a7589268
I20251215 14:55:30.482367 12064 catalog_manager.cc:1562] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: loading cluster ID for follower catalog manager: success
I20251215 14:55:30.504739 11611 consensus_queue.cc:1048] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.505672 11993 consensus_queue.cc:1048] T 3dca27f234054f9582a2ca6c5e6f5cad P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.514218 11460 ts_manager.cc:194] Registered new tserver with Master: e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
I20251215 14:55:30.520320 12064 catalog_manager.cc:1584] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: acquiring CA information for follower catalog manager: success
I20251215 14:55:30.527890 9304 raft_consensus.cc:3060] T c3e5c385232140079705470ad2d6e020 P e89303a500544272b601d7c29be802b4 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:30.534351 11588 consensus_queue.cc:1048] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.544318 11611 consensus_queue.cc:1048] T 5e751be4722043928e6977c48c359aae P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.553143 12064 catalog_manager.cc:1612] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251215 14:55:30.609980 11611 consensus_queue.cc:1048] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.639397 12021 consensus_queue.cc:1048] T 8f6bf35f57e94a1d983612561aa6f185 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.675629 11611 consensus_queue.cc:1048] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.677039 11611 consensus_queue.cc:1048] T f909de19a0184e5b8d54a04ed11a9c70 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251215 14:55:30.690696 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:30.714641 12093 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:30.715031 12093 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:30.720383 11988 consensus_queue.cc:1048] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.724562 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:55:30.728206 11610 consensus_queue.cc:1048] T da4da9d74efd427ca27431c54a84a3e9 P e89303a500544272b601d7c29be802b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.738422 9171 raft_consensus.cc:3060] T e512c231686948619d338fa0fc8aae03 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Advancing to term 1
I20251215 14:55:30.762845 12021 consensus_queue.cc:1048] T c3e5c385232140079705470ad2d6e020 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.768386 11588 consensus_queue.cc:1048] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.771773 11588 consensus_queue.cc:1048] T 3bfe7f2bc9b04aaeb6102b6b673d9379 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.773519 11588 consensus_queue.cc:1048] T 8ae3004e4a76422397c6e1761d020e38 P 67978ac4539d4b289e53f4eedd9a8156 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251215 14:55:30.744043 12093 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:30.817358 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:30.817723 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:55:30.818375 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:55:30.818840 12093 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:55:31.220023 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:31.241997 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet d88741012a814d41ac074e86805f492d (table default.Table_8b8a9e9ac41a4cf0b47d6c5fd4594684 [id=9a061a63f3c54a9bb093c9c41ae79db6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d88741012a814d41ac074e86805f492d consensus state has no leader
I20251215 14:55:31.392915 12104 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:31.393440 12104 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:31.396111 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:55:31.401490 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:31.401790 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:55:31.402278 12104 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:31.402303 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:55:31.402796 12104 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:55:31.662029 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:31.871737 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 11: this message will repeat every 5th retry.
I20251215 14:55:32.113647 12108 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:32.113927 12108 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:32.115025 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:55:32.119364 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:32.119689 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:55:32.114591 12108 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:32.120153 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:55:32.120477 12108 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:55:32.241283 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:32.501297 8678 master-stress-test.cc:577] Killing test thread 1/25
W20251215 14:55:32.564719 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet cd025ffa766d45f8bc6c42c6eaa3418c (table default.Table_681e95321cd9408b86d9b8dc14ab4448 [id=5ef3a8ef2a24423d89c8a77dffd849c6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cd025ffa766d45f8bc6c42c6eaa3418c consensus state has no leader
I20251215 14:55:32.701586 12111 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:32.701930 12111 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:32.705557 12111 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:32.705986 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:55:32.706149 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:55:32.706269 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:32.706604 12111 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:55:32.720201 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:32.843042 12112 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:32.843303 12112 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:32.844062 12112 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:32.844475 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:55:32.844633 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:32.844894 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:55:32.845336 11424 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:55:32.845630 12112 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:55:33.109493 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 11: this message will repeat every 5th retry.
W20251215 14:55:33.159209 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:33.534750 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:33.619031 8775 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 8e1a8070f9ab448088009e9a22a340f7 (table default.Table_89b4a7a3b7124af3986512c42ff0082e [id=9255b7fca6fe4f77b8e1f84ab57b097a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8e1a8070f9ab448088009e9a22a340f7 has no consensus state
W20251215 14:55:33.654587 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 11: this message will repeat every 5th retry.
W20251215 14:55:34.024142 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:34.405827 11952 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:34.406008 11952 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:34.406805 11952 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:34.408025 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:55:34.408874 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:55:34.408975 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:34.409171 11952 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:34.443712 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:34.446838 12121 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:34.447124 12121 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:34.448233 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:34.448236 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:55:34.448482 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:55:34.449067 12121 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:34.449100 11424 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:55:34.449393 12121 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:55:34.743146 8844 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet c276eb6ad0414bb8ae5d553ae623edac (table default.Table_d27029eebe7b40ad85ba792bad6d92c5 [id=7ec65d77d89d4e40a60b716f721e2940], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet c276eb6ad0414bb8ae5d553ae623edac consensus state has no leader
W20251215 14:55:35.009820 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:35.228552 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 16: this message will repeat every 5th retry.
I20251215 14:55:35.266268 12116 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:35.266453 12116 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:35.267263 12116 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:35.267999 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:55:35.268211 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:55:35.268311 8976 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:35.268668 12116 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:55:35.409798 12125 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:35.410090 12125 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:35.410955 12125 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:35.411268 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:35.411532 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:55:35.415755 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:55:35.416306 11424 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:55:35.417280 12125 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:55:35.483464 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:35.753652 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 0a597fd6c7c044228ffb2a5a5f924e70 (table default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0a597fd6c7c044228ffb2a5a5f924e70 consensus state has no leader
W20251215 14:55:36.036631 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:36.497598 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:36.922888 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d [id=066e8ae14004436cb8b4f3f740b45b19], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet bafc5063058a469bb9c9b3e5345eb1be consensus state has no leader
I20251215 14:55:36.939062 11860 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:36.939296 11860 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:36.939841 11860 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:36.940794 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:55:36.941097 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:55:36.941196 9112 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:36.941543 11860 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:37.000725 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 11: this message will repeat every 5th retry.
W20251215 14:55:37.028671 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:37.355564 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 16: this message will repeat every 5th retry.
W20251215 14:55:37.461766 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:37.854398 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:37.940466 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 3cdfcddd91fe47de8fd14dc718f421a6 (table default.Table_aba7a90daaf544eb972bd7349f27ae63 [id=2bd880b71b174f528054fbc22143c01f], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3cdfcddd91fe47de8fd14dc718f421a6 consensus state has no leader
I20251215 14:55:38.235047 12135 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:38.235313 12135 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:38.236268 12135 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:38.236416 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:55:38.236755 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:38.237040 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:55:38.237790 11424 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:55:38.238040 12135 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:55:38.406375 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:38.443126 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 11: this message will repeat every 5th retry.
W20251215 14:55:38.875771 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:39.450613 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:39.972638 12145 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:39.972826 12145 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:39.973393 12145 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:39.973902 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:55:39.974179 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:39.974433 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:55:39.974900 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:55:39.975335 12145 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:55:40.008074 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:40.288633 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
W20251215 14:55:40.542862 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:41.029611 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:41.314709 8775 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 7f9c173d11f1449b829a54190313bea3 (table default.Table_5227b3b62b1843ea9a43fecb24c0fd07 [id=1ff1a56115104321ba6aafed10d1506d], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7f9c173d11f1449b829a54190313bea3 consensus state has no leader
W20251215 14:55:41.419926 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 16: this message will repeat every 5th retry.
W20251215 14:55:41.445502 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:41.892946 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:42.412969 12150 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:42.413136 12150 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:42.413862 12150 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:42.414687 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:55:42.419804 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:55:42.419915 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:42.420248 12150 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:42.425035 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:42.737847 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
W20251215 14:55:42.819429 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 16: this message will repeat every 5th retry.
W20251215 14:55:43.048377 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:43.422748 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 16: this message will repeat every 5th retry.
W20251215 14:55:43.494364 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:43.687314 12160 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:43.687589 12160 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:43.688511 12160 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:43.688751 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:55:43.689057 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:43.689356 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:55:43.689797 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:55:43.690075 12160 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 14:55:43.863338 12161 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:43.863504 12161 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:43.864147 12161 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:43.864816 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:55:43.865103 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:43.865206 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:43.865437 12161 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:43.875928 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet a71d029bbd88416da1dbcad09dc93115 (table default.Table_83a70db13a46486d9ab7008ef949a790 [id=d9742d85ec7d4f2585a5a9b8ba41505f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet a71d029bbd88416da1dbcad09dc93115 consensus state has no leader
W20251215 14:55:43.876016 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:43.889362 12161 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:43.889516 12161 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:43.890141 12161 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:43.890797 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:55:43.890931 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:55:43.891037 9112 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:43.891283 12161 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:44.446733 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:44.844034 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:44.990175 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 21: this message will repeat every 5th retry.
W20251215 14:55:45.112591 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet a9ed7d1946ba433eb8b19ccf6a84b7ad (table default.Table_86c6dc8b4a624840b2920c56cdf1a347 [id=977c10f407a74ad1bb20f1d0026df250], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a9ed7d1946ba433eb8b19ccf6a84b7ad consensus state has no leader
W20251215 14:55:45.269686 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:45.721381 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:46.074239 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 21: this message will repeat every 5th retry.
W20251215 14:55:46.271224 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:46.438813 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet b4a856793e8b46cfb42110de5d383ff7 (table default.Table_8bca373710104ce89200ac1c18f9a622 [id=81cf043be94c44afaef4b8c7f1ce1b00], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b4a856793e8b46cfb42110de5d383ff7 consensus state has no leader
W20251215 14:55:46.456733 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 16: this message will repeat every 5th retry.
W20251215 14:55:46.733064 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:46.985271 12155 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:46.985445 12155 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:46.986059 12155 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:46.986807 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:55:46.987152 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:55:46.987283 9115 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:46.987638 12155 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:47.130050 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:47.647812 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet d88741012a814d41ac074e86805f492d (table default.Table_8b8a9e9ac41a4cf0b47d6c5fd4594684 [id=9a061a63f3c54a9bb093c9c41ae79db6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d88741012a814d41ac074e86805f492d consensus state has no leader
W20251215 14:55:47.662918 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:47.845323 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 16: this message will repeat every 5th retry.
W20251215 14:55:48.129980 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:48.628202 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:48.975453 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet cd025ffa766d45f8bc6c42c6eaa3418c (table default.Table_681e95321cd9408b86d9b8dc14ab4448 [id=5ef3a8ef2a24423d89c8a77dffd849c6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cd025ffa766d45f8bc6c42c6eaa3418c consensus state has no leader
W20251215 14:55:49.043198 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:49.281741 12177 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:49.281885 12177 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:49.282402 12177 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:49.283229 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:55:49.285081 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:55:49.285199 8976 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:49.285414 12177 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:49.471741 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:49.676451 12142 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:49.676621 12142 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:49.677402 12142 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:55:49.678102 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:55:49.678392 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:55:49.678479 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:55:49.678684 12176 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:55:49.950611 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:50.016644 8775 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 8e1a8070f9ab448088009e9a22a340f7 (table default.Table_89b4a7a3b7124af3986512c42ff0082e [id=9255b7fca6fe4f77b8e1f84ab57b097a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8e1a8070f9ab448088009e9a22a340f7 has no consensus state
W20251215 14:55:50.566912 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:51.106299 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:51.375679 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 21: this message will repeat every 5th retry.
W20251215 14:55:51.677534 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:52.142148 12193 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:52.142336 12193 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:52.143267 12193 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:52.143712 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:55:52.144178 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:52.144445 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
W20251215 14:55:52.144474 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:52.144917 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:55:52.145370 12193 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 14:55:52.395625 12166 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:52.395790 12166 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:52.396507 12166 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:52.397753 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:55:52.397869 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:55:52.397949 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:52.398157 12166 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:52.506140 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 21: this message will repeat every 5th retry.
W20251215 14:55:52.531010 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:52.943277 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:53.187003 12198 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:53.187224 12198 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:53.187907 12198 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:53.188334 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:53.188334 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:55:53.188601 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:55:53.189064 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:55:53.189316 12198 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:55:53.455384 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:53.906656 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 21: this message will repeat every 5th retry.
I20251215 14:55:53.907933 12199 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:53.908048 12199 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:53.908795 12199 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:53.909399 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:55:53.910216 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:55:53.910317 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:53.910517 12186 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:54.052793 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:54.593912 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:54.982826 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:55.047875 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 26: this message will repeat every 5th retry.
W20251215 14:55:55.449666 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:55.919239 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:56.143965 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 21: this message will repeat every 5th retry.
W20251215 14:55:56.456956 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:56.642275 12200 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:56.642447 12200 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:55:56.643019 12200 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:56.643656 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:55:56.644160 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:55:56.644266 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:55:56.644491 12200 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:56.707700 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 26: this message will repeat every 5th retry.
W20251215 14:55:56.966356 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:57.373536 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 21: this message will repeat every 5th retry.
W20251215 14:55:57.531801 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:55:57.787314 12213 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:57.787530 12213 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:55:57.788285 12213 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:55:57.788738 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:55:57.788780 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:55:57.788993 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:55:57.789572 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:55:57.789991 12213 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 14:55:57.803606 12202 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:55:57.803777 12202 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:55:57.804438 12202 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:55:57.805123 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:55:57.805248 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:55:57.805325 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:55:57.805487 12202 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:55:58.078760 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:58.538520 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:59.154383 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:55:59.605129 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:00.070595 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:00.524084 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:00.994225 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:01.447916 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:01.646934 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 26: this message will repeat every 5th retry.
I20251215 14:56:01.723618 12231 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:01.723784 12231 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:01.724431 12231 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:01.725131 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:56:01.725284 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:56:01.725406 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:56:01.725625 12231 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:01.881359 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:02.115558 9089 heartbeater.cc:646] Failed to heartbeat to 127.8.121.189:45723 (43 consecutive failures): Timed out: Failed to ping master at 127.8.121.189:45723: Ping RPC to 127.8.121.189:45723 timed out after 1.000s (SENT)
W20251215 14:56:02.398066 9362 heartbeater.cc:646] Failed to heartbeat to 127.8.121.189:45723 (43 consecutive failures): Timed out: Failed to ping master at 127.8.121.189:45723: Ping RPC to 127.8.121.189:45723 timed out after 1.000s (SENT)
W20251215 14:56:02.441354 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:02.476408 9227 heartbeater.cc:646] Failed to heartbeat to 127.8.121.189:45723 (43 consecutive failures): Timed out: Failed to ping master at 127.8.121.189:45723: Ping RPC to 127.8.121.189:45723 timed out after 1.000s (SENT)
W20251215 14:56:02.537168 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 26: this message will repeat every 5th retry.
W20251215 14:56:02.923035 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:03.118065 12239 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:03.118472 12239 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:56:03.119153 12239 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:56:03.119575 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:56:03.120337 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:56:03.120579 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:56:03.120960 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:56:03.121196 12239 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 14:56:03.156556 12218 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:03.156723 12218 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:03.157323 12218 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:56:03.158576 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:56:03.158720 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:56:03.158816 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:56:03.159382 12218 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:56:03.403285 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:03.993104 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:04.354897 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 26: this message will repeat every 5th retry.
W20251215 14:56:04.390359 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:04.767637 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 31: this message will repeat every 5th retry.
I20251215 14:56:04.787570 12238 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:04.787735 12238 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:56:04.788416 12238 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:04.789175 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:56:04.789306 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:56:04.789414 9112 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:56:04.789626 12238 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:05.003153 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:05.434089 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:05.985183 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:06.048173 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 26: this message will repeat every 5th retry.
W20251215 14:56:06.368939 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:06.750949 12249 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:06.751114 12249 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:06.752271 12249 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:56:06.753094 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:56:06.753208 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:56:06.753337 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:56:06.753883 12249 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:56:06.917266 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:07.049854 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 31: this message will repeat every 5th retry.
W20251215 14:56:07.463454 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:07.472735 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 26: this message will repeat every 5th retry.
W20251215 14:56:07.547786 8844 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet c276eb6ad0414bb8ae5d553ae623edac (table default.Table_d27029eebe7b40ad85ba792bad6d92c5 [id=7ec65d77d89d4e40a60b716f721e2940], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet c276eb6ad0414bb8ae5d553ae623edac consensus state has no leader
W20251215 14:56:07.947552 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:08.375136 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:08.551652 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 0a597fd6c7c044228ffb2a5a5f924e70 (table default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0a597fd6c7c044228ffb2a5a5f924e70 consensus state has no leader
W20251215 14:56:08.802910 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:09.051571 12247 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:09.051728 12247 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:09.052497 12247 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:09.053634 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:56:09.054319 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:56:09.054422 8976 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:56:09.055065 12247 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:56:09.279147 12255 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:09.279369 12255 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:09.280215 12255 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:09.281013 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:56:09.284005 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:56:09.284126 9115 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:56:09.284360 12255 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:09.298312 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:09.702515 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:09.730340 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d [id=066e8ae14004436cb8b4f3f740b45b19], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet bafc5063058a469bb9c9b3e5345eb1be consensus state has no leader
W20251215 14:56:10.227753 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:10.742282 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 3cdfcddd91fe47de8fd14dc718f421a6 (table default.Table_aba7a90daaf544eb972bd7349f27ae63 [id=2bd880b71b174f528054fbc22143c01f], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3cdfcddd91fe47de8fd14dc718f421a6 consensus state has no leader
W20251215 14:56:10.807369 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:10.858615 12199 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:10.858784 12199 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:10.859383 12199 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:10.860970 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:56:10.861271 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:56:10.861383 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:56:10.861578 12261 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:11.236227 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:11.463872 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 31: this message will repeat every 5th retry.
I20251215 14:56:11.471043 12255 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:11.471230 12255 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:11.471825 12255 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:11.472573 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:56:11.472906 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:56:11.473002 9112 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:56:11.473188 12255 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:11.758524 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:12.182868 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:12.242730 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 31: this message will repeat every 5th retry.
W20251215 14:56:12.604868 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:13.077996 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
W20251215 14:56:13.116813 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:13.594182 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:14.098654 8775 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 7f9c173d11f1449b829a54190313bea3 (table default.Table_5227b3b62b1843ea9a43fecb24c0fd07 [id=1ff1a56115104321ba6aafed10d1506d], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7f9c173d11f1449b829a54190313bea3 consensus state has no leader
I20251215 14:56:14.100023 12276 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:14.100191 12276 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:14.100876 12276 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:14.102059 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:56:14.103180 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:56:14.103282 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:56:14.103641 12276 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:14.200367 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:14.690027 12252 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:14.690191 12252 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:14.690696 12252 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:56:14.691483 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:56:14.699716 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:56:14.699849 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:56:14.700451 12278 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:56:14.734347 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 31: this message will repeat every 5th retry.
W20251215 14:56:14.778798 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:14.855266 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 36: this message will repeat every 5th retry.
W20251215 14:56:15.208848 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:15.524688 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
W20251215 14:56:15.750948 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:16.233723 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:16.284337 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 31: this message will repeat every 5th retry.
W20251215 14:56:16.665339 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:16.675936 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet a71d029bbd88416da1dbcad09dc93115 (table default.Table_83a70db13a46486d9ab7008ef949a790 [id=d9742d85ec7d4f2585a5a9b8ba41505f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet a71d029bbd88416da1dbcad09dc93115 consensus state has no leader
W20251215 14:56:16.853636 9369 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.8.121.189:45723)
W20251215 14:56:17.019995 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 36: this message will repeat every 5th retry.
W20251215 14:56:17.154138 9369 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.8.121.189:45723)
W20251215 14:56:17.171875 9369 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.8.121.189:45723)
W20251215 14:56:17.206471 9369 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.8.121.189:45723)
W20251215 14:56:17.224085 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:17.631561 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:17.846940 12270 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:17.847090 12270 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:17.847621 12270 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:17.848376 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:56:17.848518 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:56:17.848659 9112 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:56:17.848870 12270 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:17.897747 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 31: this message will repeat every 5th retry.
W20251215 14:56:17.919373 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet a9ed7d1946ba433eb8b19ccf6a84b7ad (table default.Table_86c6dc8b4a624840b2920c56cdf1a347 [id=977c10f407a74ad1bb20f1d0026df250], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a9ed7d1946ba433eb8b19ccf6a84b7ad consensus state has no leader
I20251215 14:56:18.028568 12297 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:18.028752 12297 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:56:18.029938 12297 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:56:18.030344 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:56:18.030365 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:56:18.030588 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:56:18.031071 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:56:18.031586 12297 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:56:18.052134 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:18.595897 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:19.182876 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:19.241655 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet b4a856793e8b46cfb42110de5d383ff7 (table default.Table_8bca373710104ce89200ac1c18f9a622 [id=81cf043be94c44afaef4b8c7f1ce1b00], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b4a856793e8b46cfb42110de5d383ff7 consensus state has no leader
W20251215 14:56:19.805092 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:19.869269 12291 negotiation.cc:337] Failed RPC negotiation. Trace:
1215 14:56:16.858066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.121.188:43131 (local address 127.0.0.1:48226)
1215 14:56:16.867646 (+ 9580us) negotiation.cc:107] Waiting for socket to connect
1215 14:56:16.867667 (+ 21us) client_negotiation.cc:174] Beginning negotiation
1215 14:56:16.867798 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1215 14:56:19.867532 (+2999734us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.8.121.188:43131: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":9417,"thread_start_us":9816,"threads_started":1}
W20251215 14:56:20.342721 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:20.419299 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet d88741012a814d41ac074e86805f492d (table default.Table_8b8a9e9ac41a4cf0b47d6c5fd4594684 [id=9a061a63f3c54a9bb093c9c41ae79db6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d88741012a814d41ac074e86805f492d consensus state has no leader
I20251215 14:56:20.435587 12307 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:20.435756 12307 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
W20251215 14:56:20.437124 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:56:20.437635 12307 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:20.442273 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:56:20.442409 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:56:20.442641 12307 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:20.896780 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:21.461419 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:21.465822 12305 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:21.465967 12305 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:21.466643 12305 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:21.467269 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:56:21.467465 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:56:21.467553 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:56:21.467811 12305 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:21.788516 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet cd025ffa766d45f8bc6c42c6eaa3418c (table default.Table_681e95321cd9408b86d9b8dc14ab4448 [id=5ef3a8ef2a24423d89c8a77dffd849c6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cd025ffa766d45f8bc6c42c6eaa3418c consensus state has no leader
W20251215 14:56:21.964107 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:22.395730 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:22.776919 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 36: this message will repeat every 5th retry.
W20251215 14:56:22.928129 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:22.948158 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 36: this message will repeat every 5th retry.
W20251215 14:56:22.983896 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet d45d6eebc703414fa9028faab9fc993c (table default.Table_fbefdfcff9c24a7387730593f0614c71 [id=3acc29dcf66b4841ba803cfb4eefeec3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d45d6eebc703414fa9028faab9fc993c consensus state has no leader
W20251215 14:56:23.526530 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:23.905575 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:24.171428 12306 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:24.171586 12306 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:24.172310 12306 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:56:24.172984 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:56:24.173204 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:56:24.173293 9249 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:56:24.173542 12306 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:56:24.400952 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:24.563200 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 36: this message will repeat every 5th retry.
W20251215 14:56:24.726967 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 41: this message will repeat every 5th retry.
W20251215 14:56:24.903429 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:25.312655 12319 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:25.312831 12319 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:25.313767 12319 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:25.314687 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:56:25.314836 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:56:25.314913 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:56:25.315194 12319 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:25.399221 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:25.980059 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:26.227561 12318 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:26.227730 12318 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:56:26.228317 12318 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:26.229091 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:56:26.229249 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:56:26.229372 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:56:26.229688 12318 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:26.374881 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:26.405234 12327 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:26.405385 12327 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:26.406216 12327 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:26.406790 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:56:26.407030 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:56:26.407147 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:56:26.407440 12327 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:56:26.629096 12327 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:26.629273 12327 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:26.629892 12327 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:26.630541 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:56:26.630757 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:56:26.630844 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:56:26.631089 12327 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:26.848369 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:26.958388 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 41: this message will repeat every 5th retry.
W20251215 14:56:27.212203 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 36: this message will repeat every 5th retry.
W20251215 14:56:27.235427 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 36: this message will repeat every 5th retry.
W20251215 14:56:27.435321 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:27.847750 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:27.977671 12337 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:27.977928 12337 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:56:27.979100 12337 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:56:27.979466 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:56:27.979712 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:56:27.980350 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:56:27.980916 11424 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:56:27.981483 12337 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:56:28.425213 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:28.969609 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:29.392975 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:29.970722 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:30.425392 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:30.474220 12341 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:30.474399 12341 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:30.475047 12341 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:30.475915 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:56:30.476248 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:56:30.476367 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:56:30.476730 12341 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:30.871851 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:30.977851 12340 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:30.978041 12340 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:30.978838 12340 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:56:30.983788 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:56:30.987293 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:56:30.987418 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:56:30.987663 12340 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:56:31.342834 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:31.774323 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:32.353370 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:32.533154 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 41: this message will repeat every 5th retry.
W20251215 14:56:32.917380 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:33.308171 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:33.468235 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 41: this message will repeat every 5th retry.
W20251215 14:56:33.880918 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:34.319592 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:34.705314 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:34.910984 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 46: this message will repeat every 5th retry.
W20251215 14:56:35.092602 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 41: this message will repeat every 5th retry.
W20251215 14:56:35.200127 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:35.440111 12329 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:35.440255 12329 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:35.440794 12329 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:35.441901 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:56:35.445945 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:56:35.446084 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:56:35.450413 12366 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:35.801610 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:36.013140 12371 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:36.013408 12371 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:36.014074 12371 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:36.014731 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:56:36.014945 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:56:36.015094 8976 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:56:36.015668 12322 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:36.188064 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:36.551642 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 41: this message will repeat every 5th retry.
W20251215 14:56:36.791038 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:37.289436 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 46: this message will repeat every 5th retry.
W20251215 14:56:37.406682 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:37.595396 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 41: this message will repeat every 5th retry.
W20251215 14:56:37.864881 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:38.277133 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:38.324139 12349 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:38.324306 12349 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:38.324894 12349 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:38.325485 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:56:38.325630 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:56:38.325729 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:56:38.326090 12349 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:56:38.344868 12349 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:38.345067 12349 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:38.346047 12349 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:38.346403 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:56:38.350811 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:56:38.350955 9115 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:56:38.351616 12373 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:56:38.733331 12383 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:38.733515 12383 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:56:38.734265 12383 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:56:38.734742 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:56:38.734797 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:56:38.735013 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:56:38.735466 11424 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:56:38.735677 12383 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:56:38.814172 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:39.203572 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:39.663539 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:40.146481 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:40.589911 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:40.968256 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:41.440573 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:41.892165 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 46: this message will repeat every 5th retry.
W20251215 14:56:41.945678 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:42.400877 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:42.952454 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:43.299413 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 46: this message will repeat every 5th retry.
W20251215 14:56:43.395934 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:43.807286 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:44.108170 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 51: this message will repeat every 5th retry.
W20251215 14:56:44.316344 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:44.722352 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:44.795893 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 46: this message will repeat every 5th retry.
W20251215 14:56:45.165645 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:45.729815 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:46.003988 12397 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:46.004146 12397 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:56:46.004928 12397 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:46.005628 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:56:46.005846 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:56:46.005934 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:56:46.006381 12397 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:56:46.117800 12397 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:46.117981 12397 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:46.118562 12397 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:46.119246 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:56:46.119984 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:56:46.120096 9115 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:56:46.120299 12397 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:56:46.149875 12409 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:46.150071 12409 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:46.150907 12409 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:46.152066 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:56:46.153698 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:56:46.153821 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:56:46.154050 12409 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:46.191562 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:46.371944 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 46: this message will repeat every 5th retry.
W20251215 14:56:46.634323 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:47.080158 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:47.466806 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:47.766299 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 51: this message will repeat every 5th retry.
W20251215 14:56:47.812099 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 46: this message will repeat every 5th retry.
W20251215 14:56:47.993993 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:48.545001 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:48.997315 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:49.220386 12416 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:49.220549 12416 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:49.221158 12416 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:49.221944 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:56:49.222558 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:56:49.222676 8976 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:56:49.222888 12416 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:56:49.373299 12424 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:49.373468 12424 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:49.374302 12424 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:56:49.375376 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:56:49.375808 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:56:49.375895 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:56:49.376250 12424 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:56:49.386262 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:49.713622 12419 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:49.713773 12419 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:49.714360 12419 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:49.714906 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:56:49.715250 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:56:49.715361 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:56:49.715553 12419 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:49.825886 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:50.398793 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:50.915655 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:51.389364 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:51.804736 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:52.232730 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:52.664292 12421 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:52.664479 12421 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:56:52.665122 12421 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:56:52.665843 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:56:52.666123 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:56:52.666257 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:56:52.666559 12421 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:56:52.702584 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:52.715906 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 51: this message will repeat every 5th retry.
W20251215 14:56:53.185698 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 51: this message will repeat every 5th retry.
W20251215 14:56:53.307245 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:53.868847 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:53.908279 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 56: this message will repeat every 5th retry.
I20251215 14:56:53.934221 12452 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:56:53.934422 12452 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:56:53.935213 12452 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:56:53.935671 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:56:53.935703 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:56:53.935916 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:56:53.936375 11424 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:56:53.936604 12452 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:56:54.312330 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:54.782940 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:55.336495 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:55.449180 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 51: this message will repeat every 5th retry.
W20251215 14:56:55.761466 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:56.374100 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:56.503731 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 51: this message will repeat every 5th retry.
W20251215 14:56:56.812201 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:57.419914 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:57.799799 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 56: this message will repeat every 5th retry.
W20251215 14:56:57.802431 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:58.360766 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 51: this message will repeat every 5th retry.
W20251215 14:56:58.384757 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:58.840901 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:56:59.398833 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:56:59.411322 8848 maintenance_manager.cc:419] P 1f310d741d8247488792985606a1c19e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033370
I20251215 14:56:59.576333 8847 maintenance_manager.cc:643] P 1f310d741d8247488792985606a1c19e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.164s user 0.122s sys 0.016s Metrics: {"bytes_written":215005,"cfile_init":1,"drs_written":1,"lbm_read_time_us":105,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2101,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":828,"thread_start_us":262,"threads_started":1,"wal-append.queue_time_us":375}
I20251215 14:56:59.577430 8848 maintenance_manager.cc:419] P 1f310d741d8247488792985606a1c19e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 52530 bytes on disk
I20251215 14:56:59.578281 8847 maintenance_manager.cc:643] P 1f310d741d8247488792985606a1c19e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":93,"lbm_reads_lt_1ms":4}
I20251215 14:56:59.765018 8777 maintenance_manager.cc:419] P 40747def373e4b19abfa5d21ba0a4315: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033388
I20251215 14:56:59.869508 8776 maintenance_manager.cc:643] P 40747def373e4b19abfa5d21ba0a4315: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.104s user 0.088s sys 0.012s Metrics: {"bytes_written":215005,"cfile_init":1,"drs_written":1,"lbm_read_time_us":96,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1904,"lbm_writes_lt_1ms":40,"peak_mem_usage":0,"rows_written":828,"thread_start_us":250,"threads_started":1,"wal-append.queue_time_us":347}
I20251215 14:56:59.870491 8777 maintenance_manager.cc:419] P 40747def373e4b19abfa5d21ba0a4315: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 52530 bytes on disk
I20251215 14:56:59.871302 8776 maintenance_manager.cc:643] P 40747def373e4b19abfa5d21ba0a4315: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.001s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":84,"lbm_reads_lt_1ms":4}
W20251215 14:56:59.933718 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:00.355306 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:00.845775 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:01.259445 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:01.812335 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:02.246482 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:02.278577 9089 heartbeater.cc:646] Failed to heartbeat to 127.8.121.189:45723 (103 consecutive failures): Timed out: Failed to ping master at 127.8.121.189:45723: Ping RPC to 127.8.121.189:45723 timed out after 1.000s (SENT)
W20251215 14:57:02.608176 9227 heartbeater.cc:646] Failed to heartbeat to 127.8.121.189:45723 (103 consecutive failures): Timed out: Failed to ping master at 127.8.121.189:45723: Ping RPC to 127.8.121.189:45723 timed out after 1.000s (SENT)
W20251215 14:57:02.663762 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:02.939689 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 56: this message will repeat every 5th retry.
W20251215 14:57:03.148284 9362 heartbeater.cc:646] Failed to heartbeat to 127.8.121.189:45723 (103 consecutive failures): Timed out: Failed to ping master at 127.8.121.189:45723: Ping RPC to 127.8.121.189:45723 timed out after 1.000s (SENT)
W20251215 14:57:03.173892 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 56: this message will repeat every 5th retry.
W20251215 14:57:03.217397 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:03.326141 12493 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:03.326325 12493 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:03.327145 12493 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:03.328413 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:57:03.330945 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:57:03.331069 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:57:03.331342 12461 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:57:03.356127 12491 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:03.356277 12491 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:03.356835 12491 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:57:03.357722 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:57:03.358142 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:57:03.358242 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:57:03.358587 12491 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:57:03.393582 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 61: this message will repeat every 5th retry.
W20251215 14:57:03.835819 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:04.064508 12498 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:04.064700 12498 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:04.065593 12498 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:04.066257 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:57:04.066494 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:57:04.066601 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:57:04.066805 12498 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:04.315699 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:04.766788 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:05.103410 12483 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:05.103570 12483 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:57:05.104146 12483 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:05.105152 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:57:05.105298 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:57:05.105422 9112 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:57:05.105693 12483 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:05.260594 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:05.350353 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 56: this message will repeat every 5th retry.
W20251215 14:57:05.671976 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:06.024539 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 56: this message will repeat every 5th retry.
W20251215 14:57:06.278648 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:06.872970 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:07.191444 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 61: this message will repeat every 5th retry.
W20251215 14:57:07.348147 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:07.565785 8844 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet c276eb6ad0414bb8ae5d553ae623edac (table default.Table_d27029eebe7b40ad85ba792bad6d92c5 [id=7ec65d77d89d4e40a60b716f721e2940], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet c276eb6ad0414bb8ae5d553ae623edac consensus state has no leader
W20251215 14:57:07.730581 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:08.147418 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:08.240202 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 56: this message will repeat every 5th retry.
W20251215 14:57:08.532367 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:08.882086 8846 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 (table default.Table_0593d9b93de9400ba29718af1b328262 [id=50a94314f5ba46e3a75b5a15e7362299], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 consensus state has no leader
W20251215 14:57:08.984193 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:09.129176 12515 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:09.129343 12515 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:09.129931 12515 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:09.130533 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:57:09.130643 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:57:09.130719 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:57:09.130915 12515 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:57:09.334307 12513 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:09.334477 12513 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:09.335076 12513 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:09.335755 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:57:09.335870 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:57:09.335995 9112 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:57:09.336314 12513 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:09.503711 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:10.126461 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:10.174991 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 3cdfcddd91fe47de8fd14dc718f421a6 (table default.Table_aba7a90daaf544eb972bd7349f27ae63 [id=2bd880b71b174f528054fbc22143c01f], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3cdfcddd91fe47de8fd14dc718f421a6 consensus state has no leader
I20251215 14:57:10.481531 12524 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:10.481747 12524 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:57:10.482553 12524 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:57:10.482999 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:57:10.483209 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:57:10.483425 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:57:10.483825 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:57:10.484058 12524 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:57:10.635906 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:11.135737 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:11.322142 8846 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 18cd1f63d51e4565bb8c55be13e3e099 (table default.Table_6ee288ff34ea426582a74cc4cf626490 [id=ab537167c6d94d9d83ed06b734395be3], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 18cd1f63d51e4565bb8c55be13e3e099 consensus state has no leader
W20251215 14:57:11.539927 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:11.966081 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:12.003612 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 61: this message will repeat every 5th retry.
W20251215 14:57:12.285622 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 61: this message will repeat every 5th retry.
W20251215 14:57:12.446733 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:13.063817 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:13.126446 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
W20251215 14:57:13.374956 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 66: this message will repeat every 5th retry.
W20251215 14:57:13.491475 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:13.547278 12538 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:13.547477 12538 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:57:13.548170 12538 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:57:13.548688 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:57:13.550534 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:57:13.550798 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:57:13.551282 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:57:13.551859 12538 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:57:13.914367 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:14.136722 8775 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 7f9c173d11f1449b829a54190313bea3 (table default.Table_5227b3b62b1843ea9a43fecb24c0fd07 [id=1ff1a56115104321ba6aafed10d1506d], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7f9c173d11f1449b829a54190313bea3 consensus state has no leader
I20251215 14:57:14.154560 12532 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:14.154739 12532 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:57:14.155431 12532 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:14.162266 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:57:14.162644 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:57:14.162751 9112 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:57:14.163089 12531 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:14.456084 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:14.876585 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:15.345362 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:15.527025 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
W20251215 14:57:15.811095 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 61: this message will repeat every 5th retry.
I20251215 14:57:15.910367 12515 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:15.910524 12515 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:15.911060 12515 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:15.911743 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:57:15.912329 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:57:15.912451 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:57:15.912691 12515 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:15.933776 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:16.461690 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:16.710323 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 61: this message will repeat every 5th retry.
W20251215 14:57:16.716907 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet a71d029bbd88416da1dbcad09dc93115 (table default.Table_83a70db13a46486d9ab7008ef949a790 [id=d9742d85ec7d4f2585a5a9b8ba41505f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet a71d029bbd88416da1dbcad09dc93115 consensus state has no leader
W20251215 14:57:17.029775 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:17.074506 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 66: this message will repeat every 5th retry.
I20251215 14:57:17.083910 12551 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:17.084075 12551 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:17.084645 12551 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:17.085942 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:57:17.092732 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:57:17.092880 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:57:17.093075 12551 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:17.607841 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:17.933962 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet a9ed7d1946ba433eb8b19ccf6a84b7ad (table default.Table_86c6dc8b4a624840b2920c56cdf1a347 [id=977c10f407a74ad1bb20f1d0026df250], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a9ed7d1946ba433eb8b19ccf6a84b7ad consensus state has no leader
W20251215 14:57:18.075505 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:18.549582 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:18.632200 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 61: this message will repeat every 5th retry.
W20251215 14:57:18.953261 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:19.246496 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet b4a856793e8b46cfb42110de5d383ff7 (table default.Table_8bca373710104ce89200ac1c18f9a622 [id=81cf043be94c44afaef4b8c7f1ce1b00], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b4a856793e8b46cfb42110de5d383ff7 consensus state has no leader
W20251215 14:57:19.465193 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:19.525492 12556 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:19.525792 12556 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:19.527591 12556 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:57:19.528476 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:57:19.528630 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:57:19.528731 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:57:19.528975 12556 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:57:19.961241 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:20.027946 12552 negotiation.cc:337] Failed RPC negotiation. Trace:
1215 14:57:16.859770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.8.121.188:43131 (local address 127.0.0.1:48272)
1215 14:57:16.860287 (+ 517us) negotiation.cc:107] Waiting for socket to connect
1215 14:57:16.860308 (+ 21us) client_negotiation.cc:174] Beginning negotiation
1215 14:57:16.860445 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1215 14:57:20.027546 (+3167101us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.8.121.188:43131: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":370,"thread_start_us":283,"threads_started":1}
W20251215 14:57:20.431687 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet d88741012a814d41ac074e86805f492d (table default.Table_8b8a9e9ac41a4cf0b47d6c5fd4594684 [id=9a061a63f3c54a9bb093c9c41ae79db6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d88741012a814d41ac074e86805f492d consensus state has no leader
W20251215 14:57:20.555616 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:21.021867 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:21.525154 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:21.800777 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 66: this message will repeat every 5th retry.
W20251215 14:57:21.807972 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet cd025ffa766d45f8bc6c42c6eaa3418c (table default.Table_681e95321cd9408b86d9b8dc14ab4448 [id=5ef3a8ef2a24423d89c8a77dffd849c6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cd025ffa766d45f8bc6c42c6eaa3418c consensus state has no leader
W20251215 14:57:21.977433 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:22.369007 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 66: this message will repeat every 5th retry.
W20251215 14:57:22.593127 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:22.986229 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet d45d6eebc703414fa9028faab9fc993c (table default.Table_fbefdfcff9c24a7387730593f0614c71 [id=3acc29dcf66b4841ba803cfb4eefeec3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d45d6eebc703414fa9028faab9fc993c consensus state has no leader
I20251215 14:57:23.138382 12541 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:23.138553 12541 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:23.139392 12541 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:23.140357 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:57:23.141142 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:57:23.141238 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:57:23.141983 12541 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:23.210088 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:23.441563 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 71: this message will repeat every 5th retry.
W20251215 14:57:23.684041 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:24.130579 12564 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:24.130834 12564 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:57:24.131517 12564 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:24.133055 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:57:24.135891 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:57:24.135996 9112 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:57:24.136216 12564 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:24.290720 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:24.840222 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:25.369638 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:25.620503 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 66: this message will repeat every 5th retry.
W20251215 14:57:25.843994 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:26.000793 12577 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:26.001037 12577 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:26.001879 12577 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:26.002591 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:57:26.008463 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:57:26.008616 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:57:26.008844 12577 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:26.363945 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:26.658174 12586 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:26.658341 12586 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:26.658910 12586 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:26.659502 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:57:26.659621 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:57:26.659739 9112 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:57:26.659955 12586 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:26.799369 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 66: this message will repeat every 5th retry.
W20251215 14:57:26.980406 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:27.046938 12577 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:27.047154 12577 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:27.048005 12577 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:27.048574 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:57:27.049379 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:57:27.049530 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:57:27.049814 12577 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:27.225334 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 71: this message will repeat every 5th retry.
W20251215 14:57:27.473958 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:27.884174 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:28.331322 12586 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:28.331480 12586 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:28.332129 12586 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:28.333691 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:57:28.334659 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:57:28.334765 9115 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:57:28.335211 12595 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:28.368613 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:28.914945 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:29.037478 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 66: this message will repeat every 5th retry.
I20251215 14:57:29.260762 12602 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:29.261138 12602 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:57:29.262063 12602 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:57:29.262461 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:57:29.262513 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:57:29.262758 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:57:29.263422 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:57:29.263881 12602 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:57:29.385238 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:29.914093 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:30.206250 11436 maintenance_manager.cc:419] P cad1fca07ac7419cb608c21541f672f3: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033365
I20251215 14:57:30.402199 11433 maintenance_manager.cc:643] P cad1fca07ac7419cb608c21541f672f3: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.195s user 0.132s sys 0.008s Metrics: {"bytes_written":194909,"cfile_init":1,"drs_written":1,"lbm_read_time_us":88,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2029,"lbm_writes_lt_1ms":39,"peak_mem_usage":0,"rows_written":709,"thread_start_us":3196,"threads_started":1,"wal-append.queue_time_us":3397}
I20251215 14:57:30.404287 11436 maintenance_manager.cc:419] P cad1fca07ac7419cb608c21541f672f3: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 46927 bytes on disk
I20251215 14:57:30.405280 11433 maintenance_manager.cc:643] P cad1fca07ac7419cb608c21541f672f3: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":119,"lbm_reads_lt_1ms":4}
W20251215 14:57:30.458194 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:30.941802 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:31.168329 12608 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:31.168502 12608 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:57:31.169081 12608 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:31.169818 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:57:31.169950 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:57:31.170105 9112 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:57:31.170327 12608 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:31.501423 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:32.014570 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:32.117043 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 71: this message will repeat every 5th retry.
W20251215 14:57:32.340667 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 71: this message will repeat every 5th retry.
W20251215 14:57:32.614142 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:33.172384 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:33.789034 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:34.316615 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:34.791060 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 76: this message will repeat every 5th retry.
W20251215 14:57:34.791143 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:35.333243 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:35.634447 12616 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:35.634789 12616 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:35.635725 12616 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:57:35.636380 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:57:35.636528 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:57:35.636636 9249 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:57:35.636883 12616 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:57:35.801510 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:35.847247 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 71: this message will repeat every 5th retry.
W20251215 14:57:36.379707 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:36.822577 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:36.851684 12608 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:36.851858 12608 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:57:36.852469 12608 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:36.853170 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:57:36.853305 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:57:36.853410 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:57:36.853675 12608 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:37.219869 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 71: this message will repeat every 5th retry.
W20251215 14:57:37.415634 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:37.442008 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 76: this message will repeat every 5th retry.
W20251215 14:57:37.918314 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:38.389014 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:38.855033 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:38.902005 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 71: this message will repeat every 5th retry.
W20251215 14:57:39.245625 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:39.734040 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:40.188284 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:40.724648 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:41.199510 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:41.768661 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:41.882004 12648 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:41.882155 12648 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:41.882980 12648 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:41.883836 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:57:41.884195 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:57:41.884323 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:57:41.884560 12648 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:42.175503 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 76: this message will repeat every 5th retry.
W20251215 14:57:42.207792 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:42.629653 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 76: this message will repeat every 5th retry.
W20251215 14:57:42.702082 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:42.794438 12621 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:42.794607 12621 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:42.795229 12621 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:57:42.796793 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:57:42.797876 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:57:42.798002 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:57:42.798238 12636 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:57:43.078807 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:43.388813 12613 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:43.388993 12613 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:43.420015 12613 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:43.420650 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:57:43.420933 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:57:43.421038 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:57:43.421244 12613 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:43.478477 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:43.955107 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:44.476994 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:44.855679 12654 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:44.855871 12654 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:44.856508 12654 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:44.857163 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:57:44.857290 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:57:44.857414 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:57:44.857669 12654 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:44.954355 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:45.179154 12659 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:45.179493 12659 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:57:45.180756 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:57:45.181900 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:57:45.181991 12659 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:57:45.182150 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:57:45.182646 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:57:45.183211 12659 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:57:45.315994 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 81: this message will repeat every 5th retry.
W20251215 14:57:45.334044 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:45.732100 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:46.213651 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 76: this message will repeat every 5th retry.
W20251215 14:57:46.336146 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:46.344652 12600 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:46.344784 12600 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:57:46.345333 12600 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:46.346220 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:57:46.346707 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:57:46.346802 9112 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:57:46.347263 12600 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:57:46.709786 12663 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:46.709985 12663 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:46.710681 12663 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:46.711299 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:57:46.711606 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:57:46.711745 9115 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:57:46.712002 12663 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:46.922535 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:47.017269 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 76: this message will repeat every 5th retry.
I20251215 14:57:47.350769 12660 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:47.350927 12660 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:47.351531 12660 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:57:47.352698 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:57:47.352871 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:57:47.353039 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:57:47.354930 12662 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:57:47.426517 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:47.808275 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 81: this message will repeat every 5th retry.
W20251215 14:57:47.924942 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:48.389559 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:48.791898 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 76: this message will repeat every 5th retry.
W20251215 14:57:48.961284 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:49.552667 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:50.051918 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:50.585139 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:51.142941 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:51.702714 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:52.259224 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:52.312494 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 81: this message will repeat every 5th retry.
W20251215 14:57:52.336529 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 81: this message will repeat every 5th retry.
I20251215 14:57:52.604722 12663 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:52.604889 12663 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:52.605515 12663 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:52.606230 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:57:52.606410 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:57:52.606516 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:57:52.606712 12663 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:52.735298 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:53.159749 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:53.597568 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:54.201707 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:54.677522 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:55.089699 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:55.388459 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 86: this message will repeat every 5th retry.
W20251215 14:57:55.564046 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:56.073446 12663 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:56.073613 12663 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:57:56.074131 12663 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:56.075397 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:57:56.075555 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:57:56.075680 9112 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:57:56.076017 12663 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:56.129818 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:56.463516 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 81: this message will repeat every 5th retry.
W20251215 14:57:56.524381 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:56.775318 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 81: this message will repeat every 5th retry.
W20251215 14:57:57.012423 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:57.406635 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:57.628688 12721 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:57.628875 12721 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:57:57.629510 12721 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:57:57.629972 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:57:57.629992 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:57:57.630224 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:57:57.630802 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:57:57.631484 12721 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:57:57.637410 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 86: this message will repeat every 5th retry.
W20251215 14:57:57.983296 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:57:58.483956 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:58.759822 12716 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:58.759981 12716 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:58.760740 12716 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:58.761423 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:57:58.761953 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:57:58.762063 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:57:58.762282 12716 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:59.102353 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:57:59.141310 12717 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:57:59.141484 12717 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:57:59.142066 12717 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:57:59.142946 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:57:59.143258 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:57:59.143361 8976 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:57:59.143615 12729 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:57:59.267298 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 81: this message will repeat every 5th retry.
W20251215 14:57:59.613615 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:00.198048 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:00.447044 12663 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:00.447237 12663 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:00.447978 12663 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:00.448864 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:58:00.449043 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:58:00.449174 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:00.449414 12663 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:00.760551 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:01.207221 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:01.646397 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:01.794261 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 86: this message will repeat every 5th retry.
W20251215 14:58:02.211359 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:02.229658 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 86: this message will repeat every 5th retry.
W20251215 14:58:02.438522 9089 heartbeater.cc:646] Failed to heartbeat to 127.8.121.189:45723 (163 consecutive failures): Timed out: Failed to ping master at 127.8.121.189:45723: Ping RPC to 127.8.121.189:45723 timed out after 1.000s (SENT)
W20251215 14:58:02.735373 9227 heartbeater.cc:646] Failed to heartbeat to 127.8.121.189:45723 (163 consecutive failures): Timed out: Failed to ping master at 127.8.121.189:45723: Ping RPC to 127.8.121.189:45723 timed out after 1.000s (SENT)
W20251215 14:58:02.835012 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:03.311990 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:03.379645 12729 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:03.379808 12729 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:58:03.381243 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:58:03.381476 12729 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:03.389644 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:58:03.389765 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:58:03.390112 12729 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:03.485348 9362 heartbeater.cc:646] Failed to heartbeat to 127.8.121.189:45723 (161 consecutive failures): Timed out: Failed to ping master at 127.8.121.189:45723: Ping RPC to 127.8.121.189:45723 timed out after 1.000s (SENT)
W20251215 14:58:03.922784 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:04.345228 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:04.577258 12745 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:04.577486 12745 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:04.578681 12745 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:58:04.578965 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:58:04.579177 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:58:04.579310 9249 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:58:04.579514 12745 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:58:04.857520 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:05.130728 12663 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:05.130896 12663 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:05.131546 12663 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:05.132247 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:58:05.132378 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:58:05.132508 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:05.132761 12663 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:05.268179 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:05.349004 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 91: this message will repeat every 5th retry.
W20251215 14:58:05.847994 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:05.889119 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 86: this message will repeat every 5th retry.
W20251215 14:58:06.289651 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:06.522956 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 86: this message will repeat every 5th retry.
W20251215 14:58:06.859567 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:06.870890 12753 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:06.871134 12753 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:06.871709 12753 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:06.872471 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:58:06.872882 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:58:06.872989 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:58:06.873265 12716 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:07.383235 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:07.535094 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 91: this message will repeat every 5th retry.
W20251215 14:58:07.595525 8844 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet c276eb6ad0414bb8ae5d553ae623edac (table default.Table_d27029eebe7b40ad85ba792bad6d92c5 [id=7ec65d77d89d4e40a60b716f721e2940], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet c276eb6ad0414bb8ae5d553ae623edac consensus state has no leader
W20251215 14:58:07.860503 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:08.422490 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:08.600747 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 0a597fd6c7c044228ffb2a5a5f924e70 (table default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0a597fd6c7c044228ffb2a5a5f924e70 consensus state has no leader
I20251215 14:58:08.689199 12765 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:08.689471 12765 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:58:08.690632 12765 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:58:08.691004 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:58:08.691265 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:58:08.693686 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:58:08.694236 11424 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:58:08.694970 12765 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:58:08.952222 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 86: this message will repeat every 5th retry.
W20251215 14:58:08.969897 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:09.085073 12760 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:09.085309 12760 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:58:09.086131 12760 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:09.087726 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:58:09.088266 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:58:09.088678 9112 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:09.089452 12760 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:09.376919 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:09.784271 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d [id=066e8ae14004436cb8b4f3f740b45b19], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet bafc5063058a469bb9c9b3e5345eb1be consensus state has no leader
W20251215 14:58:09.785663 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:10.200735 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:10.607069 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:10.829408 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 3cdfcddd91fe47de8fd14dc718f421a6 (table default.Table_aba7a90daaf544eb972bd7349f27ae63 [id=2bd880b71b174f528054fbc22143c01f], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3cdfcddd91fe47de8fd14dc718f421a6 consensus state has no leader
W20251215 14:58:11.157236 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:11.304904 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 91: this message will repeat every 5th retry.
W20251215 14:58:11.662881 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:11.681077 12762 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:11.681254 12762 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:11.681900 12762 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:58:11.682657 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:58:11.682812 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:58:11.682910 9249 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:58:11.683135 12762 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:58:11.827510 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 91: this message will repeat every 5th retry.
W20251215 14:58:12.114629 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:12.400048 12776 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:12.400276 12776 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:58:12.401027 12776 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:58:12.401598 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:58:12.401767 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:58:12.401855 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:58:12.402438 11424 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:58:12.402823 12776 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:58:12.638082 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:12.864624 12771 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:12.864794 12771 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:12.865406 12771 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:12.866201 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:58:12.866387 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:58:12.866499 8976 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:58:12.866660 12771 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:13.175523 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
W20251215 14:58:13.244731 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:13.775060 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:14.342149 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:14.407437 8775 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet eb309f7c439740c89470da5636523a69 (table default.Table_1b528fe70b3e4803a17a4755e2a7cc86 [id=40b600a183744fa992c73142cd90120b], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet eb309f7c439740c89470da5636523a69 consensus state has no leader
I20251215 14:58:14.537632 12780 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:14.537806 12780 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:14.538408 12780 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:14.539081 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:58:14.539243 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:58:14.539348 9112 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:14.539564 12780 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:14.745306 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:15.288610 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:15.502130 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 96: this message will repeat every 5th retry.
I20251215 14:58:15.505946 12780 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:15.506145 12780 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:58:15.507053 12780 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:15.507794 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:58:15.508204 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:58:15.508320 9112 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:15.508679 12780 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:15.552552 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
W20251215 14:58:15.894994 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:16.311228 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:16.545888 12789 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:16.546056 12789 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:16.547730 12789 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:16.548162 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:58:16.552151 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:58:16.552304 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:58:16.552682 12785 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:16.726840 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 91: this message will repeat every 5th retry.
W20251215 14:58:16.765246 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet a71d029bbd88416da1dbcad09dc93115 (table default.Table_83a70db13a46486d9ab7008ef949a790 [id=d9742d85ec7d4f2585a5a9b8ba41505f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet a71d029bbd88416da1dbcad09dc93115 consensus state has no leader
W20251215 14:58:16.883145 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 91: this message will repeat every 5th retry.
W20251215 14:58:16.890938 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:17.304204 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:17.692557 12789 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:17.692750 12789 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:17.693383 12789 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:17.694013 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:58:17.694314 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:58:17.694438 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:58:17.694801 12789 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:17.892325 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 96: this message will repeat every 5th retry.
W20251215 14:58:17.917109 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:17.961762 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet a9ed7d1946ba433eb8b19ccf6a84b7ad (table default.Table_86c6dc8b4a624840b2920c56cdf1a347 [id=977c10f407a74ad1bb20f1d0026df250], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a9ed7d1946ba433eb8b19ccf6a84b7ad consensus state has no leader
W20251215 14:58:18.332657 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 91: this message will repeat every 5th retry.
W20251215 14:58:18.488845 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:19.038959 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:19.248600 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet b4a856793e8b46cfb42110de5d383ff7 (table default.Table_8bca373710104ce89200ac1c18f9a622 [id=81cf043be94c44afaef4b8c7f1ce1b00], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b4a856793e8b46cfb42110de5d383ff7 consensus state has no leader
I20251215 14:58:19.378063 12778 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:19.378374 12778 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:19.378980 12778 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:19.379818 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:58:19.380096 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:58:19.380189 9115 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:19.380402 12778 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:19.651710 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:20.185658 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:20.460783 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet d88741012a814d41ac074e86805f492d (table default.Table_8b8a9e9ac41a4cf0b47d6c5fd4594684 [id=9a061a63f3c54a9bb093c9c41ae79db6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d88741012a814d41ac074e86805f492d consensus state has no leader
W20251215 14:58:20.569108 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:20.971344 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:21.205534 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 96: this message will repeat every 5th retry.
W20251215 14:58:21.315062 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 96: this message will repeat every 5th retry.
W20251215 14:58:21.427754 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:21.823334 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet cd025ffa766d45f8bc6c42c6eaa3418c (table default.Table_681e95321cd9408b86d9b8dc14ab4448 [id=5ef3a8ef2a24423d89c8a77dffd849c6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cd025ffa766d45f8bc6c42c6eaa3418c consensus state has no leader
W20251215 14:58:21.823529 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:22.344384 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:22.775142 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:23.023387 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet d45d6eebc703414fa9028faab9fc993c (table default.Table_fbefdfcff9c24a7387730593f0614c71 [id=3acc29dcf66b4841ba803cfb4eefeec3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d45d6eebc703414fa9028faab9fc993c consensus state has no leader
I20251215 14:58:23.175845 12805 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:23.176005 12805 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:23.176584 12805 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:23.177668 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:58:23.181671 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:23.186949 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:58:23.187121 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:58:23.187444 12785 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:58:23.188270 12780 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:23.188402 12780 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:23.188969 12780 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:23.189715 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:58:23.189855 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:58:23.189956 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:23.190152 12780 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:23.575470 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:24.109697 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:24.594748 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:24.752194 12821 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:24.752367 12821 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:58:24.753271 12821 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:58:24.753623 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:58:24.753710 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:58:24.753942 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:58:24.754290 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:58:24.754568 12821 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:58:25.004828 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:25.519251 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:25.632357 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 101: this message will repeat every 5th retry.
W20251215 14:58:25.995585 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:26.142165 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 96: this message will repeat every 5th retry.
W20251215 14:58:26.294639 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 96: this message will repeat every 5th retry.
W20251215 14:58:26.551188 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:27.018289 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:27.398280 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:27.424256 8978 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.131:32959, user_credentials={real_user=slave}} blocked reactor thread for 53005.3us
W20251215 14:58:27.430861 8976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.8.121.130:38013, user_credentials={real_user=slave}} blocked reactor thread for 50839.2us
W20251215 14:58:27.623705 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 96: this message will repeat every 5th retry.
W20251215 14:58:27.787668 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:27.983274 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 101: this message will repeat every 5th retry.
W20251215 14:58:28.309798 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:28.785012 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:29.395673 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:29.875510 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:30.296788 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:30.608915 12819 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:30.609076 12819 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:30.609830 12819 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:58:30.610466 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:58:30.610615 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:58:30.610738 9249 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:58:30.610955 12819 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:58:30.883224 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:30.976405 12816 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:30.976563 12816 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:30.977321 12816 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:30.977811 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:58:30.977944 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:58:30.978020 9115 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:30.978222 12816 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:31.434182 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:31.749480 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 101: this message will repeat every 5th retry.
W20251215 14:58:31.768213 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 101: this message will repeat every 5th retry.
W20251215 14:58:32.037433 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:32.458367 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:32.884505 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:32.993647 12860 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:32.993815 12860 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:58:32.994478 12860 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:58:32.994850 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:58:32.994879 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:58:32.995059 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:58:32.995545 11424 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:58:32.995790 12860 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 14:58:33.184901 12816 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:33.185060 12816 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:58:33.185652 12816 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:33.186457 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:58:33.186730 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:58:33.186848 9112 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:33.187248 12854 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:33.422343 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:33.865809 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:34.292372 12819 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:34.292528 12819 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:34.293147 12819 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:58:34.294008 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:58:34.294189 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:58:34.294297 9249 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:58:34.294530 12819 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:58:34.325935 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:34.744117 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:35.119807 12833 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:35.120028 12833 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:35.120880 12833 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:35.121348 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:58:35.121898 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:58:35.122017 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:58:35.122216 12833 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:35.170360 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:35.390264 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 106: this message will repeat every 5th retry.
W20251215 14:58:35.743391 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:35.966792 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 101: this message will repeat every 5th retry.
W20251215 14:58:36.036482 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 101: this message will repeat every 5th retry.
W20251215 14:58:36.144402 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:36.755455 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:37.232978 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:37.288295 12874 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:37.288471 12874 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:37.289057 12874 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:37.289681 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:58:37.289924 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:58:37.290035 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:58:37.290293 12874 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:37.355959 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 101: this message will repeat every 5th retry.
W20251215 14:58:37.706494 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:38.119297 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:38.197222 12879 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:38.197427 12879 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:58:38.198038 12879 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:38.198885 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:58:38.199350 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:58:38.199472 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:38.199697 12879 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:58:38.537163 12819 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:38.537365 12819 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:38.537948 12819 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:58:38.539189 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:58:38.539721 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:58:38.539839 9249 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:58:38.540349 12873 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:58:38.540836 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 106: this message will repeat every 5th retry.
W20251215 14:58:38.740355 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:39.173451 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:39.786306 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:40.384869 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:40.497746 12895 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:40.497928 12895 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:58:40.498809 12895 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:58:40.499230 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:58:40.499567 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:58:40.499853 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:58:40.501014 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:58:40.501339 12895 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:58:40.893918 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:41.324645 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 106: this message will repeat every 5th retry.
W20251215 14:58:41.390148 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:41.869414 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:42.017076 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 106: this message will repeat every 5th retry.
W20251215 14:58:42.477545 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:42.494446 12879 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:42.494601 12879 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:42.495230 12879 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:42.495844 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:58:42.496616 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:58:42.496714 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:42.496932 12879 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:43.066515 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:43.656450 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:44.111011 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:44.703630 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:44.928191 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 111: this message will repeat every 5th retry.
W20251215 14:58:45.144449 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:45.306284 12919 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:45.306463 12919 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:45.307065 12919 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:58:45.307897 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:58:45.308219 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:58:45.308336 9249 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:58:45.308557 12919 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:58:45.526402 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:45.761085 12900 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:45.761246 12900 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:45.761793 12900 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:45.762492 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:58:45.767650 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:58:45.767772 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:45.768901 12917 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:45.945043 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:46.138586 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 106: this message will repeat every 5th retry.
W20251215 14:58:46.204893 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 106: this message will repeat every 5th retry.
W20251215 14:58:46.342092 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:46.809859 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:46.856630 12917 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:46.856797 12917 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:58:46.857564 12917 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:46.858253 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:58:46.858431 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:58:46.858587 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:46.858836 12917 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:47.370873 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:47.540542 12888 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:47.540712 12888 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:47.541316 12888 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:47.542024 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:58:47.542150 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:58:47.542256 8976 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:58:47.542580 12888 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:47.836833 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:47.854290 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 106: this message will repeat every 5th retry.
W20251215 14:58:48.460633 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:48.624182 12915 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:48.624370 12915 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:48.625006 12915 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:48.625874 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:58:48.625998 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:58:48.626111 8976 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:58:48.626348 12888 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:48.863600 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 111: this message will repeat every 5th retry.
W20251215 14:58:49.001859 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:49.504019 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:49.715767 12937 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:49.715922 12937 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:58:49.716794 12937 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:58:49.716885 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:58:49.717051 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:58:49.717298 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:58:49.717676 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:58:49.717906 12937 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:58:49.934814 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:50.403908 12938 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:50.404093 12938 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:58:50.404702 12938 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:50.405449 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:58:50.411561 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:58:50.411727 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:50.411945 12938 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:50.477320 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:50.897539 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:51.305300 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 111: this message will repeat every 5th retry.
W20251215 14:58:51.329528 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:51.644883 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 111: this message will repeat every 5th retry.
I20251215 14:58:51.808270 12938 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:51.808452 12938 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:51.809082 12938 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:51.809734 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:58:51.809924 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:58:51.810030 9115 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:51.810264 12938 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:51.905745 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:52.238617 12938 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:52.238812 12938 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:52.239477 12938 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:52.240108 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:58:52.240291 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:58:52.240406 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:52.240685 12938 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:52.385483 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:52.774088 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:53.346071 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:53.845890 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:54.358870 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:54.920926 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:55.469285 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:55.659868 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 116: this message will repeat every 5th retry.
I20251215 14:58:55.966223 12959 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:55.966387 12959 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:55.967005 12959 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:58:55.968026 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:58:55.968199 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:58:55.968348 9112 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:58:55.968684 12952 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:58:55.977607 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:56.010416 12943 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:56.010588 12943 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:58:56.011402 12943 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:58:56.012053 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:58:56.012174 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:58:56.012290 9249 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:58:56.012494 12943 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:58:56.278435 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 111: this message will repeat every 5th retry.
W20251215 14:58:56.303397 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 111: this message will repeat every 5th retry.
W20251215 14:58:56.400092 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:58:56.637761 12963 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:58:56.637920 12963 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:58:56.638675 12963 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:58:56.639106 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:58:56.639214 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:58:56.639487 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:58:56.639962 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:58:56.640208 12963 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:58:56.818399 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:57.261631 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:57.689615 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:58.158388 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:58.410689 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 111: this message will repeat every 5th retry.
W20251215 14:58:58.591305 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:59.009630 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:58:59.282253 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 116: this message will repeat every 5th retry.
W20251215 14:58:59.595333 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:00.126245 12915 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:00.126420 12915 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:00.127331 12915 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:00.128479 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:59:00.129241 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:59:00.129352 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:59:00.129746 12915 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:00.153363 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:00.475265 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 116: this message will repeat every 5th retry.
W20251215 14:59:00.544818 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:00.923385 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:01.302897 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:01.468735 12972 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:01.468899 12972 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:01.469441 12972 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:01.470274 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:59:01.470428 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:59:01.470505 9115 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:01.470742 12972 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:01.485729 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 116: this message will repeat every 5th retry.
W20251215 14:59:01.742378 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:02.319499 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:02.579133 9089 heartbeater.cc:646] Failed to heartbeat to 127.8.121.189:45723 (223 consecutive failures): Timed out: Failed to ping master at 127.8.121.189:45723: Ping RPC to 127.8.121.189:45723 timed out after 1.000s (SENT)
W20251215 14:59:02.872130 9227 heartbeater.cc:646] Failed to heartbeat to 127.8.121.189:45723 (223 consecutive failures): Timed out: Failed to ping master at 127.8.121.189:45723: Ping RPC to 127.8.121.189:45723 timed out after 1.000s (SENT)
W20251215 14:59:02.879024 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:03.380199 12983 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:03.380403 12983 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:03.381048 12983 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:59:03.382041 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:59:03.383657 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:59:03.383848 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:59:03.384106 12985 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:59:03.444657 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:03.836118 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:03.928996 9362 heartbeater.cc:646] Failed to heartbeat to 127.8.121.189:45723 (221 consecutive failures): Timed out: Failed to ping master at 127.8.121.189:45723: Ping RPC to 127.8.121.189:45723 timed out after 1.000s (SENT)
W20251215 14:59:04.301386 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:04.797936 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:05.192791 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:05.473737 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 121: this message will repeat every 5th retry.
W20251215 14:59:05.649338 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:06.057716 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:06.188392 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 116: this message will repeat every 5th retry.
I20251215 14:59:06.193696 12915 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:06.193871 12915 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:06.194555 12915 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:06.195362 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:59:06.196189 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:59:06.196417 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:59:06.196724 12915 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:06.477531 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 116: this message will repeat every 5th retry.
W20251215 14:59:06.601912 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:07.042241 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:07.594678 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:07.643026 8844 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet c276eb6ad0414bb8ae5d553ae623edac (table default.Table_d27029eebe7b40ad85ba792bad6d92c5 [id=7ec65d77d89d4e40a60b716f721e2940], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet c276eb6ad0414bb8ae5d553ae623edac consensus state has no leader
W20251215 14:59:08.050334 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:08.454355 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:08.464448 13000 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:08.464596 13000 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:08.465173 13000 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:08.465945 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:59:08.466753 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:59:08.466881 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:59:08.467100 12981 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:08.695283 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 116: this message will repeat every 5th retry.
W20251215 14:59:08.851086 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 121: this message will repeat every 5th retry.
W20251215 14:59:08.915030 8846 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 (table default.Table_0593d9b93de9400ba29718af1b328262 [id=50a94314f5ba46e3a75b5a15e7362299], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2ea4fbf5ff164c90b5b8f6dab05b9764 consensus state has no leader
W20251215 14:59:09.046753 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:09.616686 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:09.970309 13010 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:09.970464 13010 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:59:09.971261 13010 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:09.972002 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:59:09.972121 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:59:09.972257 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:09.972457 13010 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:10.123831 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:10.214571 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 3cdfcddd91fe47de8fd14dc718f421a6 (table default.Table_aba7a90daaf544eb972bd7349f27ae63 [id=2bd880b71b174f528054fbc22143c01f], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 3cdfcddd91fe47de8fd14dc718f421a6 consensus state has no leader
I20251215 14:59:10.301214 13010 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:10.301400 13010 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:10.302079 13010 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:10.302927 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:59:10.303265 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:59:10.303385 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:10.303764 13007 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:10.542518 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 121: this message will repeat every 5th retry.
W20251215 14:59:10.647409 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:11.043898 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 121: this message will repeat every 5th retry.
W20251215 14:59:11.270117 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:11.398499 8846 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 18cd1f63d51e4565bb8c55be13e3e099 (table default.Table_6ee288ff34ea426582a74cc4cf626490 [id=ab537167c6d94d9d83ed06b734395be3], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 18cd1f63d51e4565bb8c55be13e3e099 consensus state has no leader
W20251215 14:59:11.812143 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:12.193692 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:12.601389 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:12.831321 13021 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:12.831534 13021 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:59:12.832389 13021 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:59:12.833010 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:59:12.835397 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:59:12.835706 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:59:12.836189 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:59:12.836542 13021 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:59:13.140533 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:13.202060 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
W20251215 14:59:13.638155 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:13.719237 13026 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:13.719415 13026 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:59:13.720072 13026 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:13.721055 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:59:13.721684 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:59:13.721807 9112 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:13.722118 13026 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:14.040169 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:14.262473 13007 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:14.262673 13007 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:14.263412 13007 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:14.264025 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:59:14.264402 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:59:14.264537 9112 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:14.264807 13007 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:14.427775 8775 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet eb309f7c439740c89470da5636523a69 (table default.Table_1b528fe70b3e4803a17a4755e2a7cc86 [id=40b600a183744fa992c73142cd90120b], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet eb309f7c439740c89470da5636523a69 consensus state has no leader
W20251215 14:59:14.512743 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:15.078218 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:15.567885 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
I20251215 14:59:15.603312 13035 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:15.603503 13035 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:15.604077 13035 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:15.604893 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:59:15.605085 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:59:15.605226 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:15.605472 13035 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:15.622062 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:15.933774 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 126: this message will repeat every 5th retry.
W20251215 14:59:16.153676 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:16.371924 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 121: this message will repeat every 5th retry.
W20251215 14:59:16.475322 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 121: this message will repeat every 5th retry.
I20251215 14:59:16.496857 13029 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:16.497017 13029 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:16.497743 13029 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:59:16.498629 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:59:16.499019 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:59:16.499135 9249 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:59:16.499373 13029 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:59:16.681370 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:16.778906 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet a71d029bbd88416da1dbcad09dc93115 (table default.Table_83a70db13a46486d9ab7008ef949a790 [id=d9742d85ec7d4f2585a5a9b8ba41505f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet a71d029bbd88416da1dbcad09dc93115 consensus state has no leader
W20251215 14:59:17.273634 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:17.891326 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:17.962224 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet a9ed7d1946ba433eb8b19ccf6a84b7ad (table default.Table_86c6dc8b4a624840b2920c56cdf1a347 [id=977c10f407a74ad1bb20f1d0026df250], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a9ed7d1946ba433eb8b19ccf6a84b7ad consensus state has no leader
W20251215 14:59:18.380920 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:18.510738 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 121: this message will repeat every 5th retry.
I20251215 14:59:18.593001 13037 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:18.593159 13037 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:18.593966 13037 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:18.594555 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:59:18.594776 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:59:18.594892 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:59:18.595105 13037 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:18.663422 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 126: this message will repeat every 5th retry.
W20251215 14:59:18.950508 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:19.289220 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet b4a856793e8b46cfb42110de5d383ff7 (table default.Table_8bca373710104ce89200ac1c18f9a622 [id=81cf043be94c44afaef4b8c7f1ce1b00], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b4a856793e8b46cfb42110de5d383ff7 consensus state has no leader
I20251215 14:59:19.300657 13047 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:19.300838 13047 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:19.301496 13047 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:19.302660 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:59:19.302942 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:59:19.303061 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:19.303337 13047 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:19.454735 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:20.054565 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:20.175696 13007 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:20.175886 13007 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:59:20.176506 13007 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:20.177825 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:59:20.177951 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:59:20.178061 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:20.178272 13007 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:20.473220 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet d88741012a814d41ac074e86805f492d (table default.Table_8b8a9e9ac41a4cf0b47d6c5fd4594684 [id=9a061a63f3c54a9bb093c9c41ae79db6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet d88741012a814d41ac074e86805f492d consensus state has no leader
W20251215 14:59:20.591699 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 126: this message will repeat every 5th retry.
W20251215 14:59:20.641927 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:21.130125 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 126: this message will repeat every 5th retry.
W20251215 14:59:21.154322 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:21.777105 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:21.834179 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet cd025ffa766d45f8bc6c42c6eaa3418c (table default.Table_681e95321cd9408b86d9b8dc14ab4448 [id=5ef3a8ef2a24423d89c8a77dffd849c6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet cd025ffa766d45f8bc6c42c6eaa3418c consensus state has no leader
W20251215 14:59:22.338435 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:22.750801 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:22.861186 8775 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 8e1a8070f9ab448088009e9a22a340f7 (table default.Table_89b4a7a3b7124af3986512c42ff0082e [id=9255b7fca6fe4f77b8e1f84ab57b097a], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8e1a8070f9ab448088009e9a22a340f7 has no consensus state
W20251215 14:59:23.142004 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:23.242720 13062 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:23.242871 13062 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:23.243502 13062 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:23.244099 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:59:23.244256 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:59:23.244395 9115 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:23.244637 13062 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:23.712298 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:24.088100 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:24.536749 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:25.004240 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:25.604372 13062 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:25.604561 13062 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:25.605460 13062 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:25.606168 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:59:25.606312 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:59:25.606406 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:25.606622 13062 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:25.623365 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:25.785655 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 131: this message will repeat every 5th retry.
I20251215 14:59:25.789212 13072 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:25.789381 13072 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:25.790019 13072 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:25.790622 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:59:25.791386 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:59:25.791492 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:59:25.791770 13072 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:26.107322 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:26.210192 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 126: this message will repeat every 5th retry.
W20251215 14:59:26.311430 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 126: this message will repeat every 5th retry.
W20251215 14:59:26.636052 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:27.113833 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:27.507458 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:27.969879 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:28.451340 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:28.884414 13068 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:28.884577 13068 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:28.885161 13068 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:59:28.885804 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:59:28.886199 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:59:28.886315 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:59:28.886597 13068 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:59:28.890413 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:29.013927 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 126: this message will repeat every 5th retry.
W20251215 14:59:29.153040 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 131: this message will repeat every 5th retry.
W20251215 14:59:29.367625 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:29.964810 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:30.460259 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:30.510027 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 131: this message will repeat every 5th retry.
W20251215 14:59:30.927573 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 131: this message will repeat every 5th retry.
W20251215 14:59:30.963936 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:31.562780 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:31.715634 13102 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:31.715778 13102 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:59:31.716524 13102 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:59:31.716966 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:59:31.717204 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:59:31.717453 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:59:31.717962 11424 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:59:31.718256 13102 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:59:32.033924 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:32.101270 13078 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:32.101433 13078 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:59:32.102015 13078 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:32.103255 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:59:32.103775 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:59:32.103879 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:32.104095 13078 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:32.587615 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:33.069341 13078 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:33.069511 13078 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:33.070083 13078 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:33.071311 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:59:33.071513 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:59:33.071655 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:33.072000 13078 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:33.101922 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:33.574213 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:33.981530 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:34.599521 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:35.058526 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:35.211210 13112 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:35.211383 13112 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:35.212163 13112 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:35.212839 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:59:35.212944 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:59:35.213070 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:59:35.213388 13112 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:35.532032 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 131: this message will repeat every 5th retry.
W20251215 14:59:35.543428 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:35.971570 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 136: this message will repeat every 5th retry.
W20251215 14:59:36.141287 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:36.493419 13112 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:36.493575 13112 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
W20251215 14:59:36.494724 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:59:36.494910 13112 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:36.495807 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:59:36.495941 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:59:36.496291 13107 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:36.546936 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 131: this message will repeat every 5th retry.
W20251215 14:59:36.562211 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:36.981592 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:37.085867 13095 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:37.086028 13095 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:37.086858 13095 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:59:37.087571 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:59:37.087880 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:59:37.087996 9249 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:59:37.088456 13095 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:59:37.477088 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:37.976984 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:38.533794 13127 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:38.534029 13127 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:59:38.534839 13127 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:59:38.535089 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:59:38.535085 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:59:38.535352 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:59:38.535995 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:59:38.536260 13127 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:59:38.601184 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:38.656164 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 131: this message will repeat every 5th retry.
I20251215 14:59:38.842975 13128 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:38.843116 13128 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:38.843721 13128 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:38.844496 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:59:38.844660 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:59:38.844796 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:38.845139 13128 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:39.031790 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:39.507902 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:39.734269 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 136: this message will repeat every 5th retry.
W20251215 14:59:40.005828 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:40.493021 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:40.614648 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 136: this message will repeat every 5th retry.
W20251215 14:59:41.014441 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:41.024274 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 136: this message will repeat every 5th retry.
W20251215 14:59:41.595680 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:42.089840 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:42.577363 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:42.964923 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:43.549103 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:44.008100 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:44.602686 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:45.025388 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:45.188093 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 136: this message will repeat every 5th retry.
W20251215 14:59:45.405916 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:45.736277 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 136: this message will repeat every 5th retry.
I20251215 14:59:45.862105 13123 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:45.862273 13123 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:45.862883 13123 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 14:59:45.863648 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 14:59:45.867897 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 14:59:45.868043 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 14:59:45.868285 13123 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 14:59:45.977386 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:46.329711 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 141: this message will repeat every 5th retry.
W20251215 14:59:46.497640 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:47.044740 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:47.263139 13144 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:47.263316 13144 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:47.263979 13144 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:47.264562 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:59:47.265413 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:59:47.265494 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:47.265671 13144 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:47.539979 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 136: this message will repeat every 5th retry.
W20251215 14:59:47.655130 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:48.086027 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:48.507081 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:48.684149 13124 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:48.684307 13124 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:48.684876 13124 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:48.689291 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 14:59:48.689651 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 14:59:48.689751 9115 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:48.690086 13161 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:48.951985 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:49.363118 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:49.511336 13156 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:49.511539 13156 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:59:49.512223 13156 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:49.512796 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:59:49.512974 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:59:49.513069 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:49.513288 13156 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:49.716327 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 141: this message will repeat every 5th retry.
W20251215 14:59:49.954954 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:50.300949 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 141: this message will repeat every 5th retry.
W20251215 14:59:50.372109 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:50.584481 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 141: this message will repeat every 5th retry.
W20251215 14:59:50.844432 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:51.230846 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:51.751632 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:52.190487 13176 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:52.190649 13176 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:52.191394 13176 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:52.191956 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 14:59:52.192553 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 14:59:52.192655 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:52.192888 13156 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:52.203024 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:52.817093 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:53.291117 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:53.479840 13176 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:53.479979 13176 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 14:59:53.480556 13176 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:53.481222 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 14:59:53.481349 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 14:59:53.481469 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 14:59:53.481714 13176 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 14:59:53.495290 13170 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:53.495460 13170 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:53.496181 13170 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:53.496892 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:59:53.497044 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:59:53.497144 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:59:53.497452 13170 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:53.785941 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:54.168823 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:54.526144 13170 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:54.526335 13170 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:54.526965 13170 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:54.527608 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:59:54.527762 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:59:54.527899 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:59:54.528216 13170 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:54.617871 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:55.133677 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:55.277560 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 141: this message will repeat every 5th retry.
W20251215 14:59:55.354031 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 141: this message will repeat every 5th retry.
W20251215 14:59:55.612085 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:55.653729 13192 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:55.653909 13192 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:59:55.654698 13192 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 14:59:55.655151 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:59:55.655248 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:59:55.655521 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:59:55.655954 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:59:55.656190 13192 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 14:59:56.190796 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 146: this message will repeat every 5th retry.
W20251215 14:59:56.201608 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:56.592195 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 141: this message will repeat every 5th retry.
W20251215 14:59:56.693660 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:57.001734 13190 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:57.001900 13190 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:57.002542 13190 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:57.003456 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 14:59:57.003616 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 14:59:57.003742 8976 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:59:57.003978 13190 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:57.165005 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:57.712145 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:58.243319 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:58.420495 13207 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:58.420702 13207 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 14:59:58.422047 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 14:59:58.422041 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 14:59:58.422277 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 14:59:58.423277 11424 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 14:59:58.423919 13208 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 14:59:58.423849 13207 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
W20251215 14:59:58.844646 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 14:59:58.932824 13190 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 14:59:58.932988 13190 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 14:59:58.933579 13190 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 14:59:58.934266 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 14:59:58.934424 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 14:59:58.934559 8976 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 14:59:58.934774 13112 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 14:59:59.429600 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 14:59:59.815763 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 146: this message will repeat every 5th retry.
W20251215 14:59:59.948498 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:00.288738 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 146: this message will repeat every 5th retry.
W20251215 15:00:00.416492 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 15:00:00.438058 13195 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 15:00:00.438221 13195 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 15:00:00.438800 13195 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 15:00:00.439666 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 15:00:00.440037 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 15:00:00.440143 9115 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 15:00:00.440361 13195 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 15:00:00.889966 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 146: this message will repeat every 5th retry.
W20251215 15:00:00.979985 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:01.532644 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 15:00:01.841249 13220 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 15:00:01.841411 13220 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 15:00:01.842134 13220 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 15:00:01.842738 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 15:00:01.843210 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 15:00:01.843324 9249 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 15:00:01.843552 13193 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 15:00:02.133352 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 15:00:02.343887 13221 raft_consensus.cc:493] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 15:00:02.344048 13221 raft_consensus.cc:515] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 15:00:02.344870 13221 leader_election.cc:290] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 15:00:02.345572 9115 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
W20251215 15:00:02.352203 9112 leader_election.cc:343] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 5dc81eb40614463cb5017475b378eea6
I20251215 15:00:02.352332 9112 leader_election.cc:304] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 15:00:02.355458 13215 raft_consensus.cc:2749] T 5dc81eb40614463cb5017475b378eea6 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251215 15:00:02.551956 13222 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 15:00:02.552112 13222 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 15:00:02.552672 13222 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 15:00:02.553262 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 15:00:02.553498 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 15:00:02.553583 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 15:00:02.553797 13222 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 15:00:02.580380 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:02.713956 9087 heartbeater.cc:646] Failed to heartbeat to 127.8.121.188:43131 (293 consecutive failures): Timed out: Failed to ping master at 127.8.121.188:43131: Ping RPC to 127.8.121.188:43131 timed out after 1.000s (SENT)
W20251215 15:00:03.028801 9227 heartbeater.cc:646] Failed to heartbeat to 127.8.121.189:45723 (283 consecutive failures): Timed out: Failed to ping master at 127.8.121.189:45723: Ping RPC to 127.8.121.189:45723 timed out after 1.000s (SENT)
W20251215 15:00:03.109668 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:03.524474 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 15:00:03.602182 13229 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 15:00:03.602351 13229 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 15:00:03.602963 13229 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 15:00:03.603406 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 15:00:03.603495 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 15:00:03.603783 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 15:00:03.604216 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 15:00:03.604486 13229 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 15:00:04.087265 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:04.467566 9362 heartbeater.cc:646] Failed to heartbeat to 127.8.121.189:45723 (281 consecutive failures): Timed out: Failed to ping master at 127.8.121.189:45723: Ping RPC to 127.8.121.189:45723 timed out after 1.000s (SENT)
W20251215 15:00:04.688736 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:04.948329 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 146: this message will repeat every 5th retry.
W20251215 15:00:05.143767 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 15:00:05.615747 13237 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 15:00:05.615919 13237 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 15:00:05.616497 13237 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 15:00:05.617115 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 15:00:05.617461 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 15:00:05.617573 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 15:00:05.617791 13237 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 15:00:05.730901 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 15:00:05.803354 13230 raft_consensus.cc:493] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 15:00:05.803514 13230 raft_consensus.cc:515] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } }
I20251215 15:00:05.804112 13230 leader_election.cc:290] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 15:00:05.804811 9115 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
W20251215 15:00:05.804983 9112 leader_election.cc:343] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c4f47c22111c427a8ab9c4ae1e105375
I20251215 15:00:05.805068 9112 leader_election.cc:304] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 15:00:05.805256 13230 raft_consensus.cc:2749] T c4f47c22111c427a8ab9c4ae1e105375 P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 15:00:05.831614 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 146: this message will repeat every 5th retry.
W20251215 15:00:06.205648 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:06.241310 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 151: this message will repeat every 5th retry.
W20251215 15:00:06.750952 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 146: this message will repeat every 5th retry.
W20251215 15:00:06.800558 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:07.305471 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:07.669268 8844 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet c276eb6ad0414bb8ae5d553ae623edac (table default.Table_d27029eebe7b40ad85ba792bad6d92c5 [id=7ec65d77d89d4e40a60b716f721e2940], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet c276eb6ad0414bb8ae5d553ae623edac consensus state has no leader
W20251215 15:00:07.735723 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:08.335856 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 15:00:08.378767 13246 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 15:00:08.379024 13246 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 15:00:08.379920 13246 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 15:00:08.380163 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 15:00:08.380401 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 15:00:08.383649 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 15:00:08.384193 11424 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 15:00:08.384474 13246 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251215 15:00:08.524695 13190 raft_consensus.cc:493] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 15:00:08.524850 13190 raft_consensus.cc:515] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 15:00:08.525498 13190 leader_election.cc:290] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 15:00:08.526103 8976 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
W20251215 15:00:08.526242 8978 leader_election.cc:343] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 61aef86a30e842f2a90f9f1c88c84f4d
I20251215 15:00:08.526377 8978 leader_election.cc:304] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 15:00:08.526607 13190 raft_consensus.cc:2749] T 61aef86a30e842f2a90f9f1c88c84f4d P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 15:00:08.682691 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 0a597fd6c7c044228ffb2a5a5f924e70 (table default.Table_5b7025739b9b4c3f97a21eb6d726c69c [id=045a7728fd7f4cbb9d2ee124f67af03f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0a597fd6c7c044228ffb2a5a5f924e70 consensus state has no leader
W20251215 15:00:08.908466 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:09.449291 9115 consensus_peers.cc:597] T 11a5a6a0895c49648c910fa2ea3ca373 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 11a5a6a0895c49648c910fa2ea3ca373. This is attempt 151: this message will repeat every 5th retry.
W20251215 15:00:09.503981 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:09.820752 8978 consensus_peers.cc:597] T 18cd1f63d51e4565bb8c55be13e3e099 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18cd1f63d51e4565bb8c55be13e3e099. This is attempt 151: this message will repeat every 5th retry.
W20251215 15:00:09.846518 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet bafc5063058a469bb9c9b3e5345eb1be (table default.Table_65ebe3bc96ae47f5b34c7515e82a0f6d [id=066e8ae14004436cb8b4f3f740b45b19], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet bafc5063058a469bb9c9b3e5345eb1be consensus state has no leader
W20251215 15:00:09.985675 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:10.389986 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:10.519461 8978 consensus_peers.cc:597] T 38e50a7f2bdd4907ab41436b59397ea6 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e50a7f2bdd4907ab41436b59397ea6. This is attempt 151: this message will repeat every 5th retry.
I20251215 15:00:10.623210 13257 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 15:00:10.623395 13257 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 15:00:10.624035 13257 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 15:00:10.624486 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 15:00:10.624728 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 15:00:10.624922 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 15:00:10.626953 11424 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 15:00:10.627295 13257 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 15:00:10.827497 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:10.893683 8843 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 (table default.Table_246abe888b0b4ab7b31cde9248c92e59 [id=9f4bc32583124d6e956b457792323ae1], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 08ca9ee6b76b4b13b7bc26d65dcc3979 consensus state has no leader
W20251215 15:00:11.292197 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:11.804137 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 15:00:11.847936 13234 raft_consensus.cc:493] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 15:00:11.848100 13234 raft_consensus.cc:515] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 15:00:11.848690 13234 leader_election.cc:290] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 15:00:11.849418 9112 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
W20251215 15:00:11.849573 9115 leader_election.cc:343] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: c8af1d0b67424bec90b59863a975254e
I20251215 15:00:11.849676 9115 leader_election.cc:304] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ea5306c36594ef4a62211f2bd6669a3; no voters: 67978ac4539d4b289e53f4eedd9a8156, e89303a500544272b601d7c29be802b4
I20251215 15:00:11.849944 13234 raft_consensus.cc:2749] T c8af1d0b67424bec90b59863a975254e P 3ea5306c36594ef4a62211f2bd6669a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 15:00:12.423297 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:12.867425 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:13.233654 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
W20251215 15:00:13.284745 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:13.844054 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 15:00:14.002550 13269 raft_consensus.cc:493] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 15:00:14.002738 13269 raft_consensus.cc:515] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cad1fca07ac7419cb608c21541f672f3" member_type: VOTER last_known_addr { host: "127.8.121.190" port: 44279 } } peers { permanent_uuid: "40747def373e4b19abfa5d21ba0a4315" member_type: VOTER last_known_addr { host: "127.8.121.189" port: 45723 } } peers { permanent_uuid: "1f310d741d8247488792985606a1c19e" member_type: VOTER last_known_addr { host: "127.8.121.188" port: 43131 } }
I20251215 15:00:14.004750 8798 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "40747def373e4b19abfa5d21ba0a4315" is_pre_election: true
I20251215 15:00:14.005561 13269 leader_election.cc:290] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40747def373e4b19abfa5d21ba0a4315 (127.8.121.189:45723), 1f310d741d8247488792985606a1c19e (127.8.121.188:43131)
I20251215 15:00:14.006011 8868 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cad1fca07ac7419cb608c21541f672f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 897 } } ignore_live_leader: false dest_uuid: "1f310d741d8247488792985606a1c19e" is_pre_election: true
I20251215 15:00:14.006243 8868 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 1f310d741d8247488792985606a1c19e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cad1fca07ac7419cb608c21541f672f3 for term 3 because replica has last-logged OpId of term: 2 index: 1055, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 897.
I20251215 15:00:14.006683 11421 leader_election.cc:304] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cad1fca07ac7419cb608c21541f672f3; no voters: 1f310d741d8247488792985606a1c19e, 40747def373e4b19abfa5d21ba0a4315
I20251215 15:00:14.006945 13269 raft_consensus.cc:2749] T 00000000000000000000000000000000 P cad1fca07ac7419cb608c21541f672f3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20251215 15:00:14.320801 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:14.448529 8775 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet eb309f7c439740c89470da5636523a69 (table default.Table_1b528fe70b3e4803a17a4755e2a7cc86 [id=40b600a183744fa992c73142cd90120b], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet eb309f7c439740c89470da5636523a69 consensus state has no leader
I20251215 15:00:14.738672 13258 raft_consensus.cc:493] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 15:00:14.738840 13258 raft_consensus.cc:515] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 15:00:14.739477 13258 leader_election.cc:290] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891), 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013)
W20251215 15:00:14.740249 9249 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
W20251215 15:00:14.740550 9248 leader_election.cc:343] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Not found: Tablet not found: 0215ff355fce46b5a4cf1bf4bd7164f3
I20251215 15:00:14.740694 9248 leader_election.cc:304] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e89303a500544272b601d7c29be802b4; no voters: 3ea5306c36594ef4a62211f2bd6669a3, 67978ac4539d4b289e53f4eedd9a8156
I20251215 15:00:14.740981 13258 raft_consensus.cc:2749] T 0215ff355fce46b5a4cf1bf4bd7164f3 P e89303a500544272b601d7c29be802b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20251215 15:00:14.763108 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:14.920305 9112 consensus_peers.cc:597] T 35326e99d413431583b25d11269d09dc P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer 67978ac4539d4b289e53f4eedd9a8156 (127.8.121.129:35891): Couldn't send request to peer 67978ac4539d4b289e53f4eedd9a8156. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35326e99d413431583b25d11269d09dc. This is attempt 151: this message will repeat every 5th retry.
I20251215 15:00:14.929432 11436 maintenance_manager.cc:419] P cad1fca07ac7419cb608c21541f672f3: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 46927 bytes on disk
I20251215 15:00:14.975569 11433 maintenance_manager.cc:643] P cad1fca07ac7419cb608c21541f672f3: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.046s user 0.012s sys 0.000s Metrics: {"dirs.queue_time_us":13907,"dirs.run_cpu_time_us":179,"dirs.run_wall_time_us":179,"thread_start_us":14601,"threads_started":2,"wal-append.queue_time_us":384}
W20251215 15:00:15.302634 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:15.414433 9249 consensus_peers.cc:597] T 7c9141d604c34314a462b892076b7224 P e89303a500544272b601d7c29be802b4 -> Peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Couldn't send request to peer 3ea5306c36594ef4a62211f2bd6669a3. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c9141d604c34314a462b892076b7224. This is attempt 156: this message will repeat every 5th retry.
W20251215 15:00:15.597113 8774 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 82ca60c5a63744ffb0a0c0a140ef665e (table default.Table_8794e4e1bca04ca694f7521050d4b376 [id=fa027087d00d452daa95b171d95c5a82], current schema version=3) failed: Not found: failed to reset TS proxy: No leader found: Tablet 82ca60c5a63744ffb0a0c0a140ef665e consensus state has no leader
W20251215 15:00:15.838542 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:16.197968 8978 consensus_peers.cc:597] T c7f760639a664cfb9f4af5578154b981 P 67978ac4539d4b289e53f4eedd9a8156 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7f760639a664cfb9f4af5578154b981. This is attempt 151: this message will repeat every 5th retry.
W20251215 15:00:16.233433 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:16.459880 9115 consensus_peers.cc:597] T 77780f8cfe544db7baee2c761fe52ca2 P 3ea5306c36594ef4a62211f2bd6669a3 -> Peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Couldn't send request to peer e89303a500544272b601d7c29be802b4. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77780f8cfe544db7baee2c761fe52ca2. This is attempt 151: this message will repeat every 5th retry.
I20251215 15:00:16.468426 13267 raft_consensus.cc:493] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251215 15:00:16.468590 13267 raft_consensus.cc:515] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67978ac4539d4b289e53f4eedd9a8156" member_type: VOTER last_known_addr { host: "127.8.121.129" port: 35891 } } peers { permanent_uuid: "3ea5306c36594ef4a62211f2bd6669a3" member_type: VOTER last_known_addr { host: "127.8.121.130" port: 38013 } } peers { permanent_uuid: "e89303a500544272b601d7c29be802b4" member_type: VOTER last_known_addr { host: "127.8.121.131" port: 32959 } }
I20251215 15:00:16.469170 13267 leader_election.cc:290] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013), e89303a500544272b601d7c29be802b4 (127.8.121.131:32959)
W20251215 15:00:16.470194 8976 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3ea5306c36594ef4a62211f2bd6669a3 (127.8.121.130:38013): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
W20251215 15:00:16.472653 8978 leader_election.cc:343] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e89303a500544272b601d7c29be802b4 (127.8.121.131:32959): Not found: Tablet not found: 96b2d20fd2304e7a9995206a043b7944
I20251215 15:00:16.472796 8978 leader_election.cc:304] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67978ac4539d4b289e53f4eedd9a8156; no voters: 3ea5306c36594ef4a62211f2bd6669a3, e89303a500544272b601d7c29be802b4
I20251215 15:00:16.473218 13267 raft_consensus.cc:2749] T 96b2d20fd2304e7a9995206a043b7944 P 67978ac4539d4b289e53f4eedd9a8156 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251215 15:00:16.701596 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20251215 15:00:16.825613 8773 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet a71d029bbd88416da1dbcad09dc93115 (table default.Table_83a70db13a46486d9ab7008ef949a790 [id=d9742d85ec7d4f2585a5a9b8ba41505f], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet a71d029bbd88416da1dbcad09dc93115 consensus state has no leader
W20251215 15:00:16.852736 9369 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToMaster RPC to 127.8.121.189:45723 timed out after 59.979s (SENT)
W20251215 15:00:16.853061 9369 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToMaster RPC to 127.8.121.189:45723 timed out after 59.979s (SENT)
W20251215 15:00:16.853165 9369 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToMaster RPC to 127.8.121.189:45723 timed out after 59.979s (SENT)
W20251215 15:00:16.853243 9369 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToMaster RPC to 127.8.121.189:45723 timed out after 59.979s (SENT)
F20251215 15:00:16.868165 9394 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToMaster RPC to 127.8.121.189:45723 timed out after 59.979s (SENT)
*** Check failure stack trace: ***
*** Aborted at 1765810816 (unix time) try "date -d @1765810816" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e8000021e6) received by PID 8678 (TID 0x7fc5f5641700) from PID 8678; stack trace: ***
@ 0x7fc611a6c980 (unknown) at ??:0
@ 0x7fc60a841fb7 gsignal at ??:0
@ 0x7fc60a843921 abort at ??:0
@ 0x7fc60d579dcd google::LogMessage::Fail() at ??:0
@ 0x7fc60d57db93 google::LogMessage::SendToLog() at ??:0
@ 0x7fc60d5797cc google::LogMessage::Flush() at ??:0
F20251215 15:00:16.884768 9390 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable RPC to 127.8.121.189:45723 timed out after 0.017s (SENT)
*** Check failure stack trace: ***
@ 0x7fc60d57af59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x40cb7c kudu::MasterStressTest::DeleteTableThread() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/master-stress-test.cc:351
@ 0x44aaf4 std::__invoke_impl<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:73
@ 0x44a9ad std::__invoke<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:95
@ 0x44a96a _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:234
@ 0x44a91e std::thread::_Invoker<>::operator()() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:243
@ 0x44a659 std::thread::_State_impl<>::_M_run() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:186
@ 0x7fc60aec96df (unknown) at ??:0
@ 0x7fc611a616db start_thread at ??:0
@ 0x7fc60a92471f clone at ??:0
I20251215 15:00:17.202716 8777 maintenance_manager.cc:419] P 40747def373e4b19abfa5d21ba0a4315: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 52530 bytes on disk
W20251215 15:00:17.214052 8844 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251215 15:00:17.231069 8776 maintenance_manager.cc:643] P 40747def373e4b19abfa5d21ba0a4315: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.028s user 0.008s sys 0.002s Metrics: {"dirs.queue_time_us":10883,"dirs.run_cpu_time_us":166,"dirs.run_wall_time_us":167,"thread_start_us":22166,"threads_started":2,"wal-append.queue_time_us":7404}